Commit message (Expand) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Disallow robots from expensive queries on koschei | Michael Simacek | 2017-02-24 | 1 | -0/+2 |
* | Indexing /datagrepper is useless | Patrick Uiterwijk | 2016-02-11 | 1 | -0/+1 |
* | Robots have no use in fedoracommunity as its just an aggregator | Patrick Uiterwijk | 2015-09-16 | 1 | -0/+3 |
* | Just disallow /updates. Not much point in bodhi updates being in search engines. | Kevin Fenzi | 2015-04-23 | 1 | -0/+1 |
* | Also tell riddler we don't like them | Patrick Uiterwijk | 2015-04-23 | 1 | -0/+4 |
* | Drop crawl-delay down to 1 | Kevin Fenzi | 2015-01-29 | 2 | -2/+3 |
* | Working on the proxies-websites.yml playbook. | Ralph Bean | 2014-12-07 | 5 | -0/+20 |