crawler
Noun
Meaning
One who, or that which, crawls; a creeper; a reptile.
Source: Webster's dictionarySynonyms
Antonyms
Show all antonymsHypernyms
Hyponyms
Phrases with the word
Anagrams
Examples
Academic-focused crawler An example of the focused crawlers are academic crawlers, which crawls free-access academic related documents, such as the citeseerxbot, which is the crawler of CiteSeer X search engine.
Architectures High-level architecture of a standard Web crawler A crawler must not only have a good crawling strategy, as noted in the previous sections, but it should also have a highly optimized architecture.
Black Crappie – Fair: Use a small piece of crawler or minnow on a jig either drifting or fished under a bobber near submerged woody structure.
An important type of web agent that does crawl and read web pages automatically, without prior knowledge of what it might find, is the web crawler or search-engine spider.
Cho uses 10 seconds as an interval for accesses, and the WIRE crawler uses 15 seconds as the default.
By the time a Web crawler has finished its crawl, many events could have happened, including creations, updates and deletions.