A web crawler is also popularly known as a web robot or spider. It is an automated script or program that browses the World Wide Web (www) in a systematic and automated way. This process is also known as web crawling or spidering.
Tag Archives: Web Crawling