Aside from our exercise of collecting information about a video game franchise, there are other popular use cases for web scraping, including but not limited to: Collecting information on stock prices, real estate data, product details, sports statistics, and the list goes on. Oftentimes, they’ll often need to perform such tasks on a consistent basis (daily, weekly, monthly), in which case, all that needs to be done is to schedule your script to run to collect the data rather than having to perform the same tasks over and over. Web scraping is extremely useful because the process of automating this data collection is much quicker than a human having to manually go from web page to web page and manually extract and retrieve the information they’ll need. In our example we will be creating a report. This could be in the form of a single report or an API call. The collection of data is automated by a script usually from multiple pages and sometimes multiple websites where the collected data is then exported into a format that is the most beneficial for the users. Web scraping is the process of automating the collection of data from websites. What is Web Scraping and What are its Benefits The site we will be collecting our data from will be Metacritic, which is a website which aggregates reviews from video games, movies, T.V. We will write all of the information we have collected to a single CSV file so by the end of this exercise, we will have generated one single report containing all of the information we need across multiple web pages. This tool will scrape key information about video games within The Legend of Zelda franchise.
This article will be an interactive tutorial where we will be building a web scraper using NodeJS and Puppeteer.
0 kommentar(er)
