# /robots.txt file for https://degreesearch.org/ # See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: * NoIndex: *krawlerz Disallow: *krawlerz Disallow: /api Disallow: /callcenter Disallow: /callcenter_nrt Disallow: /caller Disallow: /careergrey Disallow: /career_pro Disallow: /clicktale/ Disallow: /collegefinder Disallow: /collegefunnel Disallow: /easy Disallow: /easy_return Disallow: /financialaid Disallow: /financialaid2 Disallow: /flexible Disallow: /flexpro Disallow: /inlineschools Disallow: /inlinesimple Disallow: /jmobile Disallow: /mini Disallow: /mobile Disallow: /qschoolresults Disallow: /schools/*/program/ Disallow: /schoolsequence Disallow: /simplegrey3 Disallow: /simplewhite Disallow: /single Disallow: /singlewhite Disallow: /specialoffers Disallow: /step_ahead Disallow: /search/results/ Sitemap: https://degreesearch.org/sitemap.xml.gz