User-agent: * Disallow: /adverts/ Disallow: /images/ Disallow: /logs/ Disallow: /wx/ Disallow: /lx/ Disallow: /sx/ Disallow: /cx/ User-agent: Googlebot Disallow: /adverts/ Disallow: /logs/ Disallow: /wx/ Disallow: /lx/ Disallow: /sx/ Disallow: /cx/ User-agent: Twiceler # experimental robot Disallow: / User-agent: TurnitinBot # student plagiarism robot Disallow: / User-agent: psbot # picsearch robot for picture searches Disallow: /