# TitansGo.net: robots.txt # # This file is used to let search engines correctly spider our website. # It does nothing else. # # Please do not edit this file if you do not understand the syntax. # User-agent: ia_archiver User-agent: Fasterfox User-agent: WebPix 1.0 (www.netwu.com) Disallow: / User-agent: * Crawl-Delay: 10 Disallow: /search.php Disallow: /bot-trap