Board logo

標題: Googlebot 及 Yahoo Crawl [打印本頁]

作者: admin    時間: 2010-9-17 23:28     標題: Googlebot 及 Yahoo Crawl


*** 登錄論壇才可看到文章內的圖片 ***

我們在論壇以管理員身份去看 "在線用戶" 時,論壇會顯示訪問者的 IP 地址,有時我們會發現來遊客的數字一下子突然急升 (試過突然增加數十個),再看一下IP 地址, 發現有一連串連續  IP 地址,例如我們試過看到 66.249.68.x 及 66.249.67.的多個來訪者,到我們論壇的不同帖子,好像在讀取資料,於是我們馬上利用Ping 去找一下這些IP 地址的來源,

ping -a 66.249.68.69

[attach]196[/attach]

發現 Host 為 crawl-66-249-68-69.googlebot.com,應該是google搜尋引擎的 googlebot 來讀取網頁資料。

作者: admin    時間: 2010-9-18 06:16     標題: Yahoo Crawl

Yahoo 也有,你 ping 一下 67.195.37.167 及 67.195.37.168 便找到了,host 名字叫 llf320042.crawl.yahoo.net  及  llf320043.crawl.yahoo.net

** crawl 解作 "爬行",spider 是其中一種爬行的昆蟲

c:\ping -a 67.195.37.167
Pinging llf320042.crawl.yahoo.net [67.195.37.167] with 32 bytes of data:
Reply from 67.195.37.167: bytes=32 time=220ms TTL=48
Reply from 67.195.37.167: bytes=32 time=234ms TTL=48
Reply from 67.195.37.167: bytes=32 time=209ms TTL=48
Reply from 67.195.37.167: bytes=32 time=220ms TTL=48
Ping statistics for 67.195.37.167:
    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 209ms, Maximum = 234ms, Average = 220ms

c:\ping -a 67.195.37.168
Pinging llf320043.crawl.yahoo.net [67.195.37.168] with 32 bytes of data:
Reply from 67.195.37.168: bytes=32 time=222ms TTL=48
Reply from 67.195.37.168: bytes=32 time=233ms TTL=48
Reply from 67.195.37.168: bytes=32 time=219ms TTL=48
Reply from 67.195.37.168: bytes=32 time=210ms TTL=48
Ping statistics for 67.195.37.168:
    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 210ms, Maximum = 233ms, Average = 221ms





歡迎光臨 How2Do (http://forum.how2do.com.hk/) Powered by Discuz! 7.2