10 lines
154 B
Plaintext
10 lines
154 B
Plaintext
.googlebot.com.
|
|
.yandex.ru.
|
|
.yandex.net.
|
|
.yandex.com.
|
|
.search.msn.com.
|
|
.crawl.baidu.com.
|
|
.crawl.baidu.jp.
|
|
.crawl.yahoo.net.
|
|
.search.qwant.com.
|
|
.babbar.eu. |