# /robots.txt file for http://www.net4u.com # mail service@net4u.com for constructive criticism User-agent: gsa-crawler Disallow:/ User-agent: Redbot Disallow:/ User-agent: Wget Disallow:/ User-agent: shelob Disallow:/ User-agent: panscient.com Disallow:/ User-agent: Twiceler-0.9 Disallow:/ User-agent: Baiduspider Disallow:/