crawler

音標(biāo)發(fā)音

The basic design of this crawler is to load the first link to check onto a queue.
這個爬蟲的基本設(shè)計是加載第一個鏈接并將其放入一個隊列。
You’re better off letting your site pages be found naturally by the crawler. Good global navigation and linking will serve you much better than relying only on an XML Sitemap.
你最好打消讓爬行者自動發(fā)現(xiàn)網(wǎng)站頁面的念頭，良好的全局導(dǎo)航和鏈接會為你服務(wù)，遠勝于僅僅依靠一個XML的網(wǎng)站地圖；
blog.sina.com.cn
Bathed in xenon spotlights, the white spaceship, attached to its twin solid rocket boosters and orange external fuel tank, crept 3.4 miles on the back of an enormous tractor called the Crawler.
沐浴著氙氣聚光燈光，白色的飛船，帶著一對固體火箭推進器和橙色外掛燃料箱，在稱為“爬行者”的巨大拖拉機上緩慢行駛了3.4英里。

Set up a crawler that can scrape some webpages and parse some basic data.
FORBES: What Are Some Useful Technical Skills I Can Learn Within A Day?
Set up a bigger crawler that has to fill out a form or two.
FORBES: What Are Some Useful Technical Skills I Can Learn Within A Day?
As with all dungeon-crawler, hack-and-slash action RPGs, the gameplay does get old after a while.
FORBES: The Bad

(MOVING) a baby who has not yet learned to walk
(TRYING TO PLEASE) a person who tries hard to please others in order to get an advantage

A crawler is a computer program that visits websites and collects information when you do an Internet search.

網(wǎng)絡(luò)爬蟲
Web-Crawler is a important part of search engine,it is responsible for the network information gathering.
網(wǎng)絡(luò)爬蟲是搜索引擎的重要組成部分，它在搜索引擎中負責(zé)網(wǎng)絡(luò)信息的采集。
爬行器
The discovery of Sybil group boils down to max-flow/min-cut problem, introduces virtual node and uses a crawler to find Sybil group.
將Sybil攻擊團體的發(fā)現(xiàn)歸結(jié)為最大流/最小割問題，引入虛擬節(jié)點并利用爬行器找到Sybil攻擊團體。
抓取器
Finally, an easy Web community seach engine system was constructed byusing Web crawler and open source Lucene, which has the function of rank according to the co-relation and group by search result.
最后,本文還利用Web抓取器和開放源代碼的lucene全文檢索部件構(gòu)造了簡單的Web社區(qū)搜索引擎系統(tǒng),提供了按照相關(guān)度對結(jié)果進行排序、對搜索結(jié)果進行分組等功能。
網(wǎng)頁爬蟲
Designing a web crawler. It can only download the target web page and outlink-pages in the same domain.
設(shè)計了相應(yīng)的網(wǎng)頁爬蟲,只下載待分類目標(biāo)網(wǎng)頁及其域內(nèi)后向鏈接網(wǎng)頁。
爬蟲
徐行機器人