< draft-koster-rep-07.txt		draft-koster-rep-08.txt >
	Network Working Group M. Koster, Ed.		Network Working Group M. Koster, Ed.
	Internet-Draft Stalworthy Computing, Ltd.		Internet-Draft Stalworthy Computing, Ltd.
	Intended status: Informational G. Illyes, Ed.		Intended status: Standards Track G. Illyes, Ed.
	Expires: 6 November 2022 H. Zeller, Ed.		Expires: 6 November 2022 H. Zeller, Ed.
	L. Sassman, Ed.		L. Sassman, Ed.
	Google LLC.		Google LLC.
	5 May 2022		5 May 2022
	Robots Exclusion Protocol		Robots Exclusion Protocol
	draft-koster-rep-07		draft-koster-rep-08
	Abstract		Abstract
	This document specifies and extends the "Robots Exclusion Protocol"		This document specifies and extends the "Robots Exclusion Protocol"
	method originally defined by Martijn Koster in 1996 for service		method originally defined by Martijn Koster in 1996 for service
	owners to control how content served by their services may be		owners to control how content served by their services may be
	accessed, if at all, by automatic clients known as crawlers.		accessed, if at all, by automatic clients known as crawlers.
	Status of This Memo		Status of This Memo
End of changes. 2 change blocks.
	2 lines changed or deleted		2 lines changed or added
This html diff was produced by rfcdiff 1.48. The latest version is available from http://tools.ietf.org/tools/rfcdiff/