1 | 1884 | 43,47 | worldwebheritage.org/1.1 |
2 | 921 | 21,25 | bingbot/2.0 |
3 | 444 | 10,24 | MJ12bot/v1.4.5 |
4 | 428 | 9,88 | DotBot/1.1 |
5 | 137 | 3,16 | Googlebot/2.1 |
6 | 107 | 2,47 | YandexBot/3.0 |
7 | 87 | 2,01 | Yahoo! Slurp |
8 | 73 | 1,68 | compatible Mozilla/5.0 |
9 | 53 | 1,22 | SeznamBot/3.2-test1 |
10 | 39 | 0,90 | Exabot/3.0 |
11 | 38 | 0,88 | BLEXBot/1.0 |
12 | 30 | 0,69 | SeznamBot/3.2 |
13 | 25 | 0,58 | Linux x86_64 |
14 | 15 | 0,35 | GigablastOpenSource/1.0 |
15 | 9 | 0,21 | Jyxobot/1 |
16 | 5 | 0,12 | Twitterbot/1.0 |
17 | 5 | 0,12 | Y!J-ASR/0.1 crawler (http://www.yahoo-he... |
18 | 3 | 0,07 | MSIE 9.0 |
19 | 3 | 0,07 | CCBot/2.0 (http://commoncrawl.org/faq/) |
20 | 2 | 0,05 | betaBot |
21 | 2 | 0,05 | httpget |
22 | 2 | 0,05 | spbot/4.4.2 |
23 | 2 | 0,05 | meanpathbot/1.0 |
24 | 2 | 0,05 | Riddler (http://riddler.io/about) |
25 | 2 | 0,05 | ltx71 - (http://ltx71.com/) |
26 | 1 | 0,02 | psbot/0.1 (+http://www.picsearch.com/bot... |
27 | 1 | 0,02 | oBot/2.3.1 |
28 | 1 | 0,02 | compatible Mozilla/4.0 |
29 | 1 | 0,02 | ia_archiver |
30 | 1 | 0,02 | Python-urllib/1.17 |