language:
Deutsch (de_DE)
English (en_US)
Español (es_ES)
Français (fr_FR)
Italiano (it_IT)
日本語 (ja_JP)
Русский (ru_RU)
Türkçe (tr_TR)
中文简体 (zh_CN)
projects
/
disclosr.git
/ blame
commit
author
committer
file
search:
summary
|
shortlog
|
log
|
commit
|
commitdiff
|
tree
plain
|
HEAD
| blame
july 2013 scraper fixes
[disclosr.git]
/
documents
/
robots.txt
2012-11-06 12:03:29
Maxious
1
# www.robotstxt.org/
2
# http://code.google.com/web/controlcrawlindex/
3
4
User-agent: *
2012-11-28 12:16:21
Maxious
5
Disallow: /admin/
2013-07-16 06:19:03
Maxious
6
Disallow: /viewDocument.php
2012-11-28 12:16:21
Maxious
7
Sitemap: http://disclosurelo.gs/sitemap.xml.php