Scraping Anthropologie.com and collecting products data

Scraping Anthropologie.com and collecting products data

Anthropologie is an American clothing retailer. Currently, the company manages more than 200 stores around the world and offers a carefully selected assortment of clothing, jewelry, underwear, home furnishings and decor, beauty products and gifts. In August 1992, Richard Hein came up with the idea to open a clothing store for creative and educated women aged 30-45 years, so the Anthropologie store appeared. Scraping anthropologie.com with Diggernaut is easy process, you can use provided web scraper to collect product and price data from the online store.

Approx number of goods: 50000
Approx number of page requests: 50000
Recommended subscription plan: Small

PLEASE NOTE! The number of requests can exceed the number of products, because data about variations, images, etc. can be scraped from other resources and will require additional requests. Also part of the product data can be delivered using XHR requests, which also increases the total number of required page requests.

How to use the web scraper to extract data about goods and prices from anthropologie.com

To use the web scraper for Anthropologie store’s website, you must have an account with our Diggernaut service. You can just simply follow this comprehensive guide:

  1. Go through this registration link to open free account with Diggernaut
  2. After registering and confirming the email address, you will need to log in to your account
  3. Create a project with any name and description, if you do not know how to do it, please refer to our documentation
  4. Switch to the created project and create a digger with any name, if you do not know how to do it, please refer to our documentation
  5. Copy the following digger configuration to the clipboard and paste it into the digger you created, if you do not know how to do it, refer to our documentation
  6. Switch the mode of the digger from Debug to Active, if you do not know how to do it, please refer to our documentation
  7. Run your digger and wait until the completion, if you do not know how to do it, please refer to our documentation
  8. Download the scraped dataset in the format you need, if you do not know how to do it, please refer to our documentation

You can also setup a schedule for running your scraper and collect data regularly.

Scraping configuration for the digger

Sample of scraped data

Below is a sample of a dataset with several products in JSON format (so you can easily review it and see data structure). The dataset can be downloaded as CSV, XLSX, XML, or any other text format using the templates.

Co-founder of cloud based web scraping and data extraction platform Diggernaut

Leave a Reply

Your email address will not be published. Required fields are marked *