# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file User-agent: * Sitemap: https://ponysfm.com/sitemap.xml.gz Disallow: /admin Disallow: /search Disallow: /search/blog Disallow: /*/edit Disallow: /settings/* Disallow: /user/*/watchers Disallow: /user/*/watching Disallow: /password_reset Disallow: /password_reset_with_code Disallow: /reclaim Disallow: /blog/*/edit Disallow: /?tab=latest&page=* Disallow: /?tab=mostpopular&page=* Disallow: /?tab=featured&page=* Disallow: /rev_status_ajax Disallow: /maintenance Disallow: /*?tab=revisions Disallow: /rev/*/download Disallow: /rev/*/internal_download_redirect Disallow: /*/like Disallow: /*/dislike Disallow: /users/*/watchers Disallow: /users/*/watching Disallow: /watch/* Disallow: /reports/* Disallow: /rev/*/status Disallow: /external_link*