Categories: None [Edit]

laws_of_robots_txt

https://rubygems.org/gems/laws_of_robots_txt
https://github.com/freerunningtech/laws_of_robots_txt
1. A robot may not index staging servers 2. A robot must obey the sitemap 3. A robot may not injure SEO or, through inaction, cause SEO to come to harm.

Total

Ranking: 34,041 of 197,350
Downloads: 41,107

Daily

Ranking: 101,725 of 197,335
Downloads: 0

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,827,539,756bundler
81,436,125,084rake
42822,930,873rack-test

Owners

#GravatarHandle
1iconjhawthorn