How2Do - Powered by Discuz! Board

標題: Googlebot 及 Yahoo Crawl [打印本頁]

作者: admin 時間: 2010-9-17 23:28 標題: Googlebot 及 Yahoo Crawl

*** 登錄論壇才可看到文章內的圖片 ***

我們在論壇以管理員身份去看 "在線用戶" 時，論壇會顯示訪問者的 IP 地址，有時我們會發現來遊客的數字一下子突然急升 (試過突然增加數十個)，再看一下IP 地址, 發現有一連串連續 IP 地址，例如我們試過看到 66.249.68.x 及 66.249.67.的多個來訪者，到我們論壇的不同帖子，好像在讀取資料，於是我們馬上利用Ping 去找一下這些IP 地址的來源，

ping -a 66.249.68.69

[attach]196[/attach]

發現 Host 為 crawl-66-249-68-69.googlebot.com，應該是google搜尋引擎的 googlebot 來讀取網頁資料。

作者: admin 時間: 2010-9-18 06:16 標題: Yahoo Crawl

Yahoo 也有，你 ping 一下 67.195.37.167 及 67.195.37.168 便找到了，host 名字叫 llf320042.crawl.yahoo.net 及 llf320043.crawl.yahoo.net

** crawl 解作 "爬行"，spider 是其中一種爬行的昆蟲

c:\ping -a 67.195.37.167
Pinging llf320042.crawl.yahoo.net [67.195.37.167] with 32 bytes of data:
Reply from 67.195.37.167: bytes=32 time=220ms TTL=48
Reply from 67.195.37.167: bytes=32 time=234ms TTL=48
Reply from 67.195.37.167: bytes=32 time=209ms TTL=48
Reply from 67.195.37.167: bytes=32 time=220ms TTL=48
Ping statistics for 67.195.37.167:
Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 209ms, Maximum = 234ms, Average = 220ms

c:\ping -a 67.195.37.168
Pinging llf320043.crawl.yahoo.net [67.195.37.168] with 32 bytes of data:
Reply from 67.195.37.168: bytes=32 time=222ms TTL=48
Reply from 67.195.37.168: bytes=32 time=233ms TTL=48
Reply from 67.195.37.168: bytes=32 time=219ms TTL=48
Reply from 67.195.37.168: bytes=32 time=210ms TTL=48
Ping statistics for 67.195.37.168:
Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 210ms, Maximum = 233ms, Average = 221ms

歡迎光臨 How2Do (http://forum.how2do.com.hk/)