| 47 различные роботы | Хиты | Объем | Последний визит |
|---|
| SemrushBot | 536,092+12434 | 8.22 ГБ | 30 Ноя 2019 - 23:59 |
| Yandex Bot | 330,282+4305 | 31.12 ГБ | 30 Ноя 2019 - 23:56 |
| AhrefsBot | 208,317+320 | 4.21 ГБ | 30 Ноя 2019 - 23:59 |
| Bingbot | 64,499+926 | 2.87 ГБ | 30 Ноя 2019 - 23:59 |
| DotBot, Open Site Explorer | 59,568+1933 | 6.13 ГБ | 30 Ноя 2019 - 23:53 |
| MJ12bot | 58,516+2273 | 1.55 ГБ | 30 Ноя 2019 - 23:59 |
| Googlebot | 33,282+361 | 5.48 ГБ | 30 Ноя 2019 - 23:49 |
| Unknown robot (identified by 'crawl') | 27,469+4 | 438.65 МБ | 30 Ноя 2019 - 22:49 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 17,856+83 | 419.02 МБ | 30 Ноя 2019 - 23:56 |
| Mail.ru bot | 4,531+148 | 90.51 МБ | 30 Ноя 2019 - 23:24 |
| Googlebot-Image | 4,098 | 971.44 МБ | 30 Ноя 2019 - 23:48 |
| Bing Preview bot | 2,021 | 178.75 МБ | 30 Ноя 2019 - 22:50 |
| Common Crawl | 1,902+68 | 157.12 МБ | 22 Ноя 2019 - 16:37 |
| Unknown robot (identified by empty user agent string) | 1,634+1 | 80.42 МБ | 30 Ноя 2019 - 23:56 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1535 | 1.35 МБ | 30 Ноя 2019 - 23:09 |
| MSNBot | 1,138+29 | 172.71 МБ | 30 Ноя 2019 - 23:31 |
| ltx71 | 740+173 | 87.94 МБ | 30 Ноя 2019 - 20:16 |
| Dataprovider Site Explorer | 592+2 | 53.19 МБ | 23 Ноя 2019 - 04:37 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 470+6 | 14.74 МБ | 29 Ноя 2019 - 06:38 |
| SeznamBot | 192+186 | 3.18 МБ | 26 Ноя 2019 - 16:54 |
| Alexa (IA Archiver) | 166 | 14.68 МБ | 29 Ноя 2019 - 05:37 |
| FavIconizer | 147 | 8.07 МБ | 30 Ноя 2019 - 18:59 |
| SMTBot | 104+2 | 3.89 МБ | 22 Ноя 2019 - 11:07 |
| SEOkicks Webcrawler | 72+8 | 2.11 МБ | 24 Ноя 2019 - 07:39 |
| StackRambler | 66 | 9.59 МБ | 31 Окт 2019 - 14:21 |
| Phantom | 53 | 6.38 МБ | 29 Ноя 2019 - 04:36 |
| Python-urllib | 41+2 | 2.39 МБ | 30 Ноя 2019 - 05:54 |
| 360spider | 40 | 2.34 МБ | 27 Ноя 2019 - 23:51 |
| Unknown robot (identified by 'spider') | 36 | 3.70 МБ | 24 Ноя 2019 - 21:55 |
| FaceBook bot | 30 | 2.37 МБ | 13 Ноя 2019 - 12:08 |
| Perl tool | 20 | 6.28 МБ | 25 Ноя 2019 - 22:09 |
| Microsoft Office Protocol Discovery/Microsoft Office Existence Discovery | 16 | 509.78 КБ | 27 Ноя 2019 - 16:06 |
| BaiDuSpider | 16 | 1.48 МБ | 23 Ноя 2019 - 04:52 |
| Netcraft | 12 | 3.63 МБ | 04 Ноя 2019 - 01:04 |
| Sogou Spider | 6+4 | 364.11 КБ | 26 Ноя 2019 - 16:30 |
| ips-agent Verisign(?) - no reliable information found. | 6+2 | 196.57 КБ | 13 Ноя 2019 - 09:28 |
| Suspected bot masqurading as Mozilla | 7 | 380.22 КБ | 29 Ноя 2019 - 08:29 |
| WGet tools | 2+2 | 641.46 КБ | 16 Ноя 2019 - 23:47 |
| CFNetwork | 4 | 100.09 КБ | 31 Окт 2019 - 02:02 |
| Suspected bot masqurading as Mozilla | 4 | 0 | 18 Ноя 2019 - 17:46 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 2 | 120.84 КБ | 22 Ноя 2019 - 17:08 |
| Java (Often spam bot) | 2 | 635.99 КБ | 31 Окт 2019 - 10:20 |
| CMS Crawler | 2 | 647.14 КБ | 28 Ноя 2019 - 13:50 |
| SpiderBot | 2 | 120.82 КБ | 20 Ноя 2019 - 09:08 |
| Web Core / Roots | 2 | 120.86 КБ | 22 Ноя 2019 - 23:33 |
| Xenu's Link Sleuth (TM), see Wikipedia | 2 | 0 | 17 Ноя 2019 - 20:52 |
| Unknown robot (identified by 'checker') | 2 | 640.80 КБ | 10 Ноя 2019 - 04:47 |
|