Web scraping refers to the process of crawling or spidering a website or multiple websites systematically and then extracting relevant data usually not intended for consumption by software programs. The difficulty comes in the fact that the web is haphazard, designed originally for humans, varied in implementation, and then the relevant data is not defined semantically.