Betsey Johnson is an American fashion designer, easily recognizable in the fashion world with her quirky designs for women. In her online store you can find clothes, shoes, accessories and jewelry. We are publishing digger configurations that will help you to scrape data from fashion stores and this scraper extracts data from the betseyjohnson.com online store.<\/p>\n
Approx number of goods:<\/strong> 1000 PLEASE NOTE!<\/strong> The number of requests can exceed the number of products, because data about variations, images, etc. can be scraped from other resources and will require additional requests. Also part of the product data can be delivered using XHR requests, which also increases the total number of required page requests.<\/p>\n To use the web scraper for Betsey Johnson store’s website, you must have an account with our Diggernaut service. You can just simply follow this comprehensive guide:<\/p>\n You can also setup a schedule for running your scraper and collect data regularly.<\/p>\n Below is a sample of a dataset with several products in JSON format (so you can easily review it and see data structure). The dataset can be downloaded as CSV, XLSX, XML, or any other text format using the templates.<\/p>\n Betsey Johnson is an American fashion designer, easily recognizable in the fashion world with her quirky designs for women. In her online store you can find clothes, shoes, accessories and jewelry. We are publishing digger configurations that will help you to scrape data from fashion stores and this scraper extracts data from the betseyjohnson.com online […]<\/p>","protected":false},"author":4,"featured_media":364,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[31,30,2],"tags":[],"class_list":["post-362","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ecommerce-scraping","category-free-scrapers","category-web-scraping"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/posts\/362","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/comments?post=362"}],"version-history":[{"count":2,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/posts\/362\/revisions"}],"predecessor-version":[{"id":650,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/posts\/362\/revisions\/650"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/media\/364"}],"wp:attachment":[{"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/media?parent=362"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/categories?post=362"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/tags?post=362"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\nApprox number of page requests<\/strong> 7000
\nRecommended subscription plan:<\/strong> X-Small<\/p>\nHow to use the web scraper to extract data about goods and prices from betseyjohnson.com<\/h3>\n
\n
Scraping configuration for the digger<\/h3>\n
---\nconfig:\n debug: 2\n agent: Firefox\ndo:\n- walk:\n to: http:\/\/www.betseyjohnson.com\/\n do:\n - find: \n path: .off > a \n do: \n - parse:\n attr: href\n - normalize:\n routine: replace_substring\n args:\n '\\s*#': ''\n\n - normalize:\n routine: url\n - link_add:\n pool: main\n- walk:\n to: links\n pool: main\n do:\n - find: \n path: .categoryNav a\n do: \n - parse:\n attr: href\n - walk:\n to: value\n do:\n - find: \n path: .viewAll \n do: \n - parse:\n attr: data-href\n - normalize:\n routine: url\n - walk:\n to: value\n do:\n - find: \n path: .mainImage \n do: \n - parse:\n attr: href\n filter: \n - (.+)\\?\n - (.+)\n - normalize:\n routine: url\n - link_add:\n pool: sub\n - find: \n path: .mainImage \n do: \n - parse:\n attr: href\n filter: \n - (.+)\\?\n - (.+)\n - normalize:\n routine: url\n - link_add:\n pool: sub\n- walk:\n to: links\n pool: sub\n do:\n - object_new: product\n - find: \n in: doc\n path: head \n do: \n - eval:\n routine: js\n body: '(function (){var d = new Date(); return d.toISOString()})();'\n - object_field_set:\n object: product\n field: date\n - static_get: url\n - object_field_set:\n object: product\n field: url\n - find: \n path: 'meta[itemprop="productID"]'\n do: \n - parse:\n attr: content\n - space_dedupe\n - trim\n - object_field_set:\n object: product\n field: sku\n - find: \n path: .breadcrumb a \n do: \n - parse\n - space_dedupe\n - trim\n - normalize:\n routine: lower\n - object_field_set:\n object: product\n field: category\n joinby: "|"\n - find: \n path: 'select.COLOR_NAME > option'\n do: \n - parse:\n attr: value\n - space_dedupe\n - trim\n - if:\n match: (\\S)\n do:\n - object_field_set:\n object: product\n field: variations\n joinby: "|"\n - find: \n path: .item-name \n do: \n - parse\n - space_dedupe\n - trim\n - object_field_set:\n object: product\n field: name\n - find: \n path: .productPrice \n do: \n - parse:\n filter:\n - ^\\s*\\$\\s*(\\d+\\.?\\d*)\n - if:\n match: (\\d+)\n do:\n - object_field_set:\n object: product\n field: price\n type: float\n - register_set: USD\n - object_field_set:\n object: product\n field: currency\n - find: \n path: script:matches(variantMatrices)\n do: \n - parse:\n filter: \n - \\\/\\\/var\\s*thumbsAndStuff\\s*=\\s*(.+);\\s* \n - normalize:\n routine: json2xml\n - to_block\n - find:\n path: alts\n do:\n - parse\n - walk:\n to: http:\/\/www.betseyjohnson.com\/scene7_proxy.jsp?cb=&req=set,json,utf-8&id=\n do:\n - find:\n path: body\n do:\n - parse\n - normalize:\n routine: replace_substring\n args:\n - \\\/\\*jsonp\\*\\\/\\s*: ''\n - s7jsonResponse\\(: ''\n - \\}\\}\\}\\,\\"\\"\\)\\;: '}}}'\n - normalize:\n routine: unescape_html\n - normalize:\n routine: json2xml\n - to_block\n - find: \n path: item > i > n \n do: \n - parse\n - register_set: http:\/\/s7d9.scene7.com\/is\/image\/?scl=1\n - object_field_set:\n object: product\n field: images\n joinby: "|"\n - find: \n path: .detailsWrap > p\n do: \n - parse\n - space_dedupe\n - trim\n - object_field_set:\n object: product\n field: description\n - find: \n path: meta[itemprop="brand"] \n do: \n - parse:\n attr: content\n - space_dedupe\n - trim\n - object_field_set:\n object: product\n field: brand\n - object_save:\n name: product<\/code><\/pre>\nSample of scraped data<\/h3>\n
[{\n "product": {\n "brand": "Betsey Johnson",\n "category": "accessories|all accessories|gifty goodies",\n "currency": "USD",\n "date": "2017-12-07T18:45:38.519Z",\n "description": "This pen is an extra special gift. Its candy-hued coloring gets extra girly flair with a soft, feathery accent.",\n "images": "http:\/\/s7d9.scene7.com\/is\/image\/BetseyJohnson\/HOLIDAY-GIVING-BUNNY-PEN_PINK?scl=1|http:\/\/s7d9.scene7.com\/is\/image\/BetseyJohnson\/HOLIDAY-GIVING-BUNNY-PEN_PINK_PACKAGED?scl=1",\n "name": "HOLIDAY GIVING BUNNY PEN",\n "price": 35,\n "sku": "247714",\n "url": "https:\/\/www.betseyjohnson.com\/product\/HOLIDAY-GIVING-BUNNY-PEN\/247714.uts",\n "variations": "PINK"\n }\n}\n,{\n "product": {\n "brand": "Betsey Johnson",\n "category": "accessories|all accessories|gifty goodies",\n "currency": "USD",\n "date": "2017-12-07T18:45:40.633Z",\n "description": "This black cat pen will bring your favorite friend some good luck! Its colorful, oil slick surface is topped off by a feathery black cat embellishment.",\n "images": "http:\/\/s7d9.scene7.com\/is\/image\/BetseyJohnson\/HOLIDAY-GIVING-BLACK-CAT-PEN_BLACK?scl=1|http:\/\/s7d9.scene7.com\/is\/image\/BetseyJohnson\/HOLIDAY-GIVING-BLACK-CAT-PEN_BLACK_PACKAGED?scl=1",\n "name": "HOLIDAY GIVING BLACK CAT PEN",\n "price": 35,\n "sku": "247715",\n "url": "https:\/\/www.betseyjohnson.com\/product\/HOLIDAY-GIVING-BLACK-CAT-PEN\/247715.uts",\n "variations": "BLACK"\n }\n}\n,{\n "product": {\n "brand": "Betsey Johnson",\n "category": "accessories|all accessories|gifty goodies",\n "currency": "USD",\n "date": "2017-12-07T18:45:41.840Z",\n "description": "This colorful parrot pen is the perfect way to add some color to the holiday season! Its pastel surface is accented by a vivid feather plump on an opal parrot.",\n "images": "http:\/\/s7d9.scene7.com\/is\/image\/BetseyJohnson\/HOLIDAY-GIVING-PARROT-PEN_MULTI?scl=1|http:\/\/s7d9.scene7.com\/is\/image\/BetseyJohnson\/HOLIDAY-GIVING-PARROT-PEN_MULTI_PACKAGING?scl=1",\n "name": "HOLIDAY GIVING PARROT PEN",\n "price": 35,\n "sku": "247716",\n "url": "https:\/\/www.betseyjohnson.com\/product\/HOLIDAY-GIVING-PARROT-PEN\/247716.uts",\n "variations": "MULTI"\n }\n}]\n<\/code><\/pre>","protected":false},"excerpt":{"rendered":"