1 2 3 4 5 6 7 8
User-agent: Googlebot Disallow: /media/ User-agent: archive.org_bot Disallow: /media/ User-agent: * Disallow: /