web crawler
Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering)
Also known as ant · automatic indexer · web spider · web scutter · web crawlers · spider
- Instance of
- Subclass of
Overview
All data
23 statements · 26% with external sources · numbers in brackets are citations
On other databases
18 identifiers linking web crawler across the web's reference databases
- ComputerLanguage.com definitioncrawler
- Dictionary of Archives Terminology IDspider
- Encyclopædia Britannica Online IDtechnology/Web-crawling-program
- Encyclopedia of China (Third Edition) ID (2026)2lOgjo
- Encyclopedia of China (Third Edition) old ID (2021)448083
- Freebase ID/m/08220
- GitHub topiccrawler
- GitLab.com topic IDweb-crawler
- GND ID4796298-7
- Gran Enciclopèdia Catalana IDaranya
- Gran Enciclopèdia Catalana ID (former scheme)0269275
- KBpedia IDWorldWideWebRobot
- Microsoft Academic ID (discontinued)13743948
- OpenAlex IDC13743948
- Quora topic IDWeb-Crawlers
- TDKIV term ID000000655
- TDKIV Wikibase IDQ682
- WordNet 3.1 Synset ID06591891-n