A web crawler is also popularly known as a web robot or spider. It is an automated script or program that browses the World Wide Web (www) in a systematic and automated way. This process is also known as web crawling or spidering.
![](https://www.suntecindia.com/blog/wp-content/uploads/2016/04/samlll-web-crawling12.jpg)
A web crawler is also popularly known as a web robot or spider. It is an automated script or program that browses the World Wide Web (www) in a systematic and automated way. This process is also known as web crawling or spidering.