# Terms of Service ยง6 asks people not to scrape the site. Search engines that # obey this file are carved out of that, which is the only reading consistent # with shipping canonical tags, JSON-LD and share cards. # # /yours is a person's own space. Nothing under it belongs in an index, and # every page there also sends noindex. /pass is the retired recess pass: it # still answers for anyone holding a link, and it also sends noindex. # # /BusyWork/pkg holds the paid app. The path is unguessable and the only thing # that names it is a signed link, so the one way it lands in an index is a # crawler following a leaked URL. Also sent as X-Robots-Tag on the file itself, # because robots.txt is a request and a header is an instruction. User-agent: * Allow: / Disallow: /yours Disallow: /pass Disallow: /BusyWork/pkg