This tutorial will show you how to extract product details from Wayfair using Web Scraper Chrome Extension. It helps to gather basic product details, pricing, ratings and more.

1. Web Scraper Add On Chrome Browser
2. Web Scraper Extension Chrome
3. Web Page Scraper
4. Web Scraper Add On Chrome Extension

To launch with Chrome instead of Chromium add executablePath option to the launch function. Below, we launch the browser, navigate to google and take a screenshot. The screenshot will be saved in the folder you are running the scraper.

1. What are the best options for performing Web Scraping of a not currently open tab from within a Google Chrome Extension with JavaScript and whatever more technologies are available. Other JavaScript-libraries are also accepted. The important thing is to mask the scraping to behave like a normal web-request.
2. Web Scraper Plus. Web Scraper Plus is a chrome browser extension built for data extraction from web pages. Using this extension you can create a plan (sitemap) how a web site should be traversed and what should be extracted. Using these sitemaps the Web Scraper will navigate the site accordingly and extract all data.

What data are we extracting from Wayfair?

1. Product Name
2. Seller
3. Rating
4. Number of Reviews
5. Sale Price
6. Original Price
7. Product Features
8. Product Details

The annotated screenshot below shows the data fields we will be scraping:

Prerequisites

• Google Chrome Browser – You will need to download the Chrome browser. The extension requires Chrome 49+.
• Web Scraper Chrome Extension – The Web Scraper extension can be downloaded from the Chrome Web Store. After downloading the extension you will see a spider icon in your browser toolbar.

Import the Wayfair Scraper

After installation, right-click anywhere on a page, go to ‘Inspect’ and the developer tools console will pop up. Click on the tab Web Scraper and go on to the ‘Create new sitemap’ button and click on the ‘Import sitemap’ option. Now paste the JSON given below in the Sitemap JSON box.

You can get the JSON from the GIST link below:

Obtaining the URL from Wayfair

Wayfair allows you to search for products that you can filter based on parameters like brand, price, material, rating, and more.This scraper allows you to scrape data from Wayfair based on your requirements. You can select the filters for the data you need and copy the corresponding URL. In the Web Scraper toolbar, click on the Sitemap button, select the option “Edit metadata’ and paste the new URL (based on your filter) as the Start URL.

Run the Scraper

Web Scraper Add On Chrome Browser

Go to the Sitemap and click ‘Scrape’ from the drop down. A new instance of Chrome will launch, enabling the extension to scroll and grab the data. Once the scrape is complete, the browser will close automatically and send a notification.

Download the Data

Web Scraper Extension Chrome

To download the scraped data as a CSV file that you can open in Microsoft Excel or Google Sheets, go to the Sitemap drop down > Export as CSV > Download Now.

We can help with your data or automation needs

Turn the Internet into meaningful, structured and usable data

Web Page Scraper

Web Scraper Add On Chrome Extension