# Robots.txt file created by http://www.bijenkorf.hu # For domain: http://www.12web.hu # All robots will spider the domain User-agent: * Disallow: # Disallow directory /docs/ User-agent: * Disallow: /data/ # Disallow directory /assets/ User-agent: * Disallow: /assets/ # Disallow directory /modules/ User-agent: * Disallow: /modules/ # Disallow directory /etool/ User-agent: * Disallow: /etool/