#The meta tag allows for the whole site to be indexed. #Only to stop dynamic content being indexed. User-agent: * Disallow: /t/ Disallow: /track/ Disallow: /tr/ Disallow: /tra/ Disallow: /cgi-bin/