1 reply to this topic

[SuperEly]

Para meu contador de acessos funcionar de forma descente eu desconsidero aqueles provenientes de robôs. Com isso, criei uma lista na qual estou sempre adicionando novos robôs que vejo no meu log de acesso. A lista atual é a seguinte:

• InternetSeer.com
• Googlebot/2.1 (+http://www.google.com/bot.html)
• Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
• msnbot/1.0 (+http://search.msn.com/msnbot.htm)
• Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.co.../ysearch/slurp)
• Mediapartners-Google/2.1"
• ia_archiver"
• ConveraCrawler/0.9d (+http://www.authoritativeweb.com/crawl)
• Gaisbot/3.0+(robot05@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php)
• appie 1.1 (www.walhello.com)
• ConveraCrawler/0.9 (+http://www.authoritativeweb.com/crawl)
• NG/2.0
• noxtrumbot/1.0 (crawler@noxtrum.com)
• Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.dlc@looksmart.net; http://www.WISEnutbot.com)
• Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; MSIECrawler)
• OmniExplorer_Bot/1.07 (+http://www.omni-explorer.com) Internet Categorizer
• IRLbot/1.0 (+http://irl.cs.tamu.edu/crawler)
• Mozilla/4.0 compatible ZyBorg/1.0 (wn-14.zyborg@looksmart.net; http://www.WISEnutbot.com)
• ConveraCrawler/0.8 (+http://www.authoritativeweb.com/crawl)
• SurveyBot/2.3 (Whois Source)
• NutchCVS/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net)
• Oracle Ultra Search
• Baiduspider+(+http://www.baidu.com/search/spider.htm)
  VJakarta Commons-HttpClient/3.0-rc1
• psbot/0.1 (+http://www.picsearch.com/bot.html)
• Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://sp.ask.com/docs/about/tech_crawling.html)
• Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; Girafabot; girafabot at girafa dot com; http://www.girafa.com)
• Gigabot/2.0
• Ipselonbot/0.46-beta (Ipselon; http://www.ipselon.c...pselonbot.html; ipselonbot@ipselon.com)
• OmniExplorer_Bot/4.32 (+http://www.omni-explorer.com) WorldIndexer
• msnbot/0.9 (+http://search.msn.com/msnbot.htm)
• tumba!-viuva negra/0.3.8 (http://www.tumba.pt/crawler.html)
• Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
• Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; MSIECrawler)
• StackRambler/2.0 (MSIE incompatible)
• Gigabot/2.0/gigablast.com/spider.html
• OmniExplorer_Bot/5.64 (+http://www.omni-explorer.com)
• EmeraldShield.com WebBot (http://www.emeraldsh...com/webbot.aspx)

Assim obtenho resultados muito semelhantes aos do Google Analytics, mas podendo fazer controles e estatísticas internas.

Chato é ficar olhando os logs quase todos os dias para encontrar os robôs que aparecem de vez em quando.

Minha dúvida é, o que vocês fazem para controlar os acessos de robôs em suas estatísticas?

[deko]

putz, nunca fiz este controle.