################################# # YouPosted.com Smart Robots v2 ################################# # I have implemented a smart Robots.txt due to the incompatibility issues between different # robots and whether they support wildcards (*), multiple user-agents and end-anchors ($) # This means that I am now serving a spider-specific robots.txt to Google/Yahoo/MSNbot # and a generic one to every other bot/person. # # Detected Spider/Bot: None # Serving Robots.txt: Generic # # Headers Sent: # Content-Type: text/plain # Expires: Tue, 15 Apr 2008 06:16:21 GMT (2 day validity) # # My Sitemap - I don't provide it just for the fun of it User-agent: * # All Spiders should understand these # Default SMF Folders Sitemap: http://www.hackstore.net/sitemap.xml Disallow: cgi-bin/ Disallow: images/ Disallow: attachments/ Disallow: MurtadHeavenRSS/ Disallow: Packages/ Disallow: Smileys/ Disallow: Sources/ Disallow: Themes/ Disallow: index.php?wap2 Disallow: Sources Disallow: Smileys Disallow: Packages Disallow: avatars Disallow: attachments Disallow: Themes Disallow: index.php?action=printpage Disallow: index.php?action=post Disallow: profiles/*.html;sa,showPosts Disallow: profiles/*.html;sa,statPanel Disallow: */;sort=last_post;desc Disallow: */;sort=starter;desc Disallow: */;sort=subject Disallow: */;sort=subject;desc Disallow: */;sort=views Disallow: */;sort=views;desc Disallow: */;sort=starter;desc Disallow: */;sort=subject;desc Disallow: */;wap2= Disallow: *.html;wap2= Disallow: empty-*.0.html;topicseen Disallow: *wap* Disallow: *imode* Disallow: *tags*