Noun
One who, or that which, crawls; a creeper; a reptile.
Source: Webster's dictionaryAcademic-focused crawler An example of the focused crawlers are academic crawlers, which crawls free-access academic related documents, such as the citeseerxbot, which is the crawler of CiteSeer X search engine. Source: Internet
Architectures High-level architecture of a standard Web crawler A crawler must not only have a good crawling strategy, as noted in the previous sections, but it should also have a highly optimized architecture. Source: Internet
Black Crappie – Fair: Use a small piece of crawler or minnow on a jig either drifting or fished under a bobber near submerged woody structure. Source: Internet
An important type of web agent that does crawl and read web pages automatically, without prior knowledge of what it might find, is the web crawler or search-engine spider. Source: Internet
Cho uses 10 seconds as an interval for accesses, and the WIRE crawler uses 15 seconds as the default. Source: Internet
By the time a Web crawler has finished its crawl, many events could have happened, including creations, updates and deletions. Source: Internet