# /robots.txt file User-agent: * Disallow: /ubc/admin/ User-Agent: ConveraCrawler Disallow: / User-Agent: MJ12bot Disallow: / User-agent: Scooter Disallow: / Sitemap: https://you.ubc.ca/ubc/htmlemailupload/System/youbc.xml