{"id":300,"date":"2018-02-05T20:15:23","date_gmt":"2018-02-05T20:15:23","guid":{"rendered":"https:\/\/www.diggernaut.com\/blog\/?p=300"},"modified":"2019-01-12T17:04:59","modified_gmt":"2019-01-12T17:04:59","slug":"american-eagle-outfitters-product-scraper","status":"publish","type":"post","link":"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/","title":{"rendered":"American Eagle Outfitters product scraper"},"content":{"rendered":"<p>American Eagle Outfitters is an American retailer of clothing and accessories headquartered in Pittsburgh, Pennsylvania. The brand was founded in 1977 by brothers Jay and Mark Silverman. Using this product scraper, you can collect information about the products and prices from ae.com website.<\/p>\n<p><strong>Approx number of goods:<\/strong> 10000<br><strong>Approx number of page requests:<\/strong> 20000<br><strong>Recommended subscription plan:<\/strong> X-Small<\/p>\n<p><strong>PLEASE NOTE!<\/strong> The number of requests can exceed the number of products, because data about variations, images, etc. can be scraped from other resources and will require additional requests. Also part of the product data can be delivered using XHR requests, which also increases the total number of required page requests.<\/p>\n<h3>How to use the web scraper to extract data about products and prices from ae.com<\/h3>\n<p>To use the web scraper for American Eagle Outfitters, you must have an account with our Diggernaut service. You can just simply follow this comprehensive guide:<\/p>\n<ol>\n<li>Go through this <a href=\"https:\/\/www.diggernaut.com\/accounts\/signup\/\">registration link<\/a> to open free account with <a href=\"https:\/\/www.diggernaut.com\">Diggernaut<\/a><\/li>\n<li>After registering and confirming the email address, you will need to <a href=\"https:\/\/www.diggernaut.com\/accounts\/login\/\">log in to your account<\/a><\/li>\n<li>Create a project with any name and description, if you do not know how to do it, please refer to our <a href=\"https:\/\/www.diggernaut.com\/dev\/website-projects-create-new-project.html\">documentation<\/a><\/li>\n<li>Switch to the created project and create a digger with any name, if you do not know how to do it, please refer to our <a href=\"https:\/\/www.diggernaut.com\/dev\/website-projects-create-new-digger.html\">documentation<\/a><\/li>\n<li>Copy the following digger configuration to the clipboard and paste it into the digger you created, if you do not know how to do it, refer to our <a href=\"https:\/\/www.diggernaut.com\/dev\/website-projects-digger-config.html\">documentation<\/a><\/li>\n<li>Switch the mode of the digger from Debug to Active, if you do not know how to do it, please refer to our <a href=\"https:\/\/www.diggernaut.com\/dev\/website-projects-edit-digger.html\">documentation<\/a><\/li>\n<li>Run your digger and wait until the completion, if you do not know how to do it, please refer to our <a href=\"https:\/\/www.diggernaut.com\/dev\/website-projects-run-digger.html\">documentation<\/a><\/li>\n<li>Download the scraped dataset in the format you need, if you do not know how to do it, please refer to our <a href=\"https:\/\/www.diggernaut.com\/dev\/website-projects-scraped-data.html\">documentation<\/a><\/li>\n<\/ol>\n<p>You can also setup a schedule for running your scraper and collect data regularly.<\/p>\n<h3>Scraping configuration for the digger<\/h3>\n<pre class=\"language-yaml line-numbers\"><code class=\"language-yaml\">---\nconfig:\n    debug: 2\ndo:\n- pool_clear: pages\n- walk:\n    to: https:\/\/www.ae.com\n    do:\n    - find:\n        path: a.third-level,a.second-level-item\n        do:\n        - parse:\n            attr: href\n        - normalize:\n            routine: url\n        - link_add:\n            pool: catalog\n- walk:\n    to: links\n    pool: catalog\n    do:\n    - find:\n        path: div.product-tile&gt;div.product-details-container&gt;a[data-qa-link-to=&quot;pdp&quot;]\n        do:\n        - parse:\n            attr: href\n            filter: ^([^\\?]+)\n        - normalize:\n            routine: url\n        - link_add:\n            pool: pages\n- walk:\n    to: links\n    pool: pages\n    do:\n    - sleep: 3\n    - find:\n        path: div.container-fluid[itemtype=&quot;http:\/\/schema.org\/Product&quot;]\n        do:\n        - variable_clear: pid\n        - object_new: product\n        - eval:\n            routine: js\n            body: &#039;(function (){var d = new Date(); return d.toISOString()})();&#039;\n        - object_field_set:\n            object: product\n            field: date\n        - static_get: url\n        - object_field_set:\n            object: product\n            field: url\n        - find:\n            path: h1.psp-product-name\n            do:\n            - parse\n            - space_dedupe\n            - trim\n            - object_field_set:\n                object: product\n                field: name\n        - find:\n            path: span.pdp-about-cs\n            do:\n            - parse\n            - space_dedupe\n            - trim\n            - object_field_set:\n                object: product\n                field: sku\n        - find:\n            in: doc\n            path: script:contains(&quot;var $AWP_ENV&quot;)\n            do:\n            - parse:\n                filter: var\\s+\\$AWP_ENV\\s+\\=\\s+(.+)\\s*$\n            - normalize:\n                routine: json2xml\n            - to_block\n            - find:\n                path: body_safe&gt;viewdata&gt;availableproducts\n                do:\n                - find:\n                    path: brandname\n                    slice: 0\n                    do:\n                    - parse\n                    - space_dedupe\n                    - trim\n                    - object_field_set:\n                        object: product\n                        field: brand\n                - find:\n                    path: colorname\n                    do:\n                    - parse\n                    - space_dedupe\n                    - trim\n                    - if:\n                        match: \\w+\n                        do:\n                        - object_field_set:\n                            object: product\n                            joinby: &quot;|&quot;\n                            field: variations\n                - find:\n                    path: largeimages\n                    do:\n                    - parse\n                    - space_dedupe\n                    - trim\n                    - if:\n                        match: \\w+\n                        do:\n                        - normalize:\n                            routine: url\n                        - variable_set: iurl\n                        - register_set: &quot;?scl=1&quot;\n                        - object_field_set:\n                            object: product\n                            joinby: &quot;|&quot;\n                            field: images\n        - find:\n            path: span.psp-product-regularprice[itemprop=&quot;priceCurrency&quot;]\n            do:\n            - parse:\n                attr: content\n            - object_field_set:\n                object: product\n                field: currency\n        - find:\n            path: span.psp-product-regularprice[itemprop=&quot;price&quot;]\n            do:\n            - parse:\n                attr: content\n            - object_field_set:\n                object: product\n                type: float\n                field: price\n        - find:\n            path: span.psp-product-saleprice[itemprop=&quot;priceCurrency&quot;],span.psp-product-sale-currency[itemprop=&quot;priceCurrency&quot;]\n            do:\n            - parse:\n                attr: content\n            - object_field_set:\n                object: product\n                field: currency\n        - find:\n            path: span.psp-product-saleprice[itemprop=&quot;price&quot;]\n            do:\n            - parse:\n                attr: content\n            - object_field_set:\n                object: product\n                type: float\n                field: price\n        - find:\n            in: doc\n            path: div.pdp-about-details-equit\n            slice: 0\n            do:\n            - parse\n            - space_dedupe\n            - trim\n            - object_field_set:\n                object: product\n                field: description\n        - find:\n            in: doc\n            path: ol.breadcrumb&gt;li.bc-item\n            slice: 0:-2\n            do:\n            - variable_clear: list_item\n            - parse\n            - space_dedupe\n            - trim\n            - if:\n                match: \\w{2,}\n                do:\n                - object_field_set:\n                    object: product\n                    joinby: &quot;|&quot;\n                    field: category\n        - object_save:\n            name: product<\/code><\/pre>\n<h3>Sample of scraped ae.com data<\/h3>\n<p>Below is a sample of a dataset with several products in JSON format (so you can easily review it and see data structure). The dataset can be downloaded as CSV, XLSX, XML, or any other text format using the templates.<\/p>\n<pre><code class=\"language-js\">[{\n    &quot;product&quot;: {\n        &quot;brand&quot;: &quot;AEO&quot;,\n        &quot;category&quot;: &quot;Women|Featured|Best Sellers&quot;,\n        &quot;currency&quot;: &quot;USD&quot;,\n        &quot;date&quot;: &quot;2017-12-05T09:15:17.642Z&quot;,\n        &quot;description&quot;: &quot;Sweater weather forever.&quot;,\n        &quot;images&quot;: &quot;https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_020_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_020_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_020_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_020_b?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_020_d1?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_410_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_410_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_410_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_410_b?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_410_d1?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_639_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_639_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_639_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_639_b?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_951_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_951_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_951_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_951_b?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_7976_951_d1?scl=1&quot;,\n        &quot;name&quot;: &quot;AE Chenille Balloon-Sleeve Sweater&quot;,\n        &quot;price&quot;: 26.97,\n        &quot;url&quot;: &quot;https:\/\/www.ae.com\/women-gifts-ae-chenille-balloon-sleeve-sweater-light-gray\/web\/s-prod\/0341_7976_951&quot;,\n        &quot;variations&quot;: &quot;Gray|Navy|Rose|Light Gray&quot;\n    }\n}\n,{\n    &quot;product&quot;: {\n        &quot;brand&quot;: &quot;AEO&quot;,\n        &quot;category&quot;: &quot;Women|Featured|Best Sellers&quot;,\n        &quot;currency&quot;: &quot;USD&quot;,\n        &quot;date&quot;: &quot;2017-12-05T09:15:37.475Z&quot;,\n        &quot;description&quot;: &quot;Sweater weather forever.&quot;,\n        &quot;images&quot;: &quot;https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_401_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_401_os?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_401_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_401_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_401_b?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_401_d1?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_500_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_500_os?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_500_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_500_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_500_b?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_500_d1?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_639_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_639_os?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_639_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_639_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/0341_8032_639_b?scl=1&quot;,\n        &quot;name&quot;: &quot;AE Soft &amp; Pretty Sweater&quot;,\n        &quot;price&quot;: 24.99,\n        &quot;url&quot;: &quot;https:\/\/www.ae.com\/women-gifts-ae-soft-pretty-sweater-rose\/web\/s-prod\/0341_8032_639&quot;,\n        &quot;variations&quot;: &quot;Light Blue|Purple|Rose&quot;\n    }\n}\n,{\n    &quot;product&quot;: {\n        &quot;brand&quot;: &quot;AEO&quot;,\n        &quot;category&quot;: &quot;Women|Featured|New Arrivals|Tops|Sweaters&quot;,\n        &quot;currency&quot;: &quot;USD&quot;,\n        &quot;date&quot;: &quot;2017-12-05T09:15:58.845Z&quot;,\n        &quot;description&quot;: &quot;Sweater weather forever.&quot;,\n        &quot;images&quot;: &quot;https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_020_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_020_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_020_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_020_b?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_401_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_401_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_401_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_401_b?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_410_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_410_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_410_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_410_b?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_580_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_580_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_580_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_613_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_613_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_613_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7951_613_b?scl=1&quot;,\n        &quot;name&quot;: &quot;AE Waffle Knit Turtleneck Tunic&quot;,\n        &quot;price&quot;: 32.97,\n        &quot;url&quot;: &quot;https:\/\/www.ae.com\/women-gifts-ae-waffle-knit-turtleneck-tunic-gray\/web\/s-prod\/1341_7951_020&quot;,\n        &quot;variations&quot;: &quot;Gray|Light Blue|Navy|Lavender|Burgundy&quot;\n    }\n}\n,{\n    &quot;product&quot;: {\n        &quot;brand&quot;: &quot;AEO&quot;,\n        &quot;category&quot;: &quot;Women|Featured|New Arrivals|Tops|Sweaters&quot;,\n        &quot;currency&quot;: &quot;USD&quot;,\n        &quot;date&quot;: &quot;2017-12-05T09:16:41.537Z&quot;,\n        &quot;description&quot;: &quot;Sweater weather forever.&quot;,\n        &quot;images&quot;: &quot;https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7947_286_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7947_286_os?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7947_286_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7947_286_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7947_286_b?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7947_286_d1?scl=1&quot;,\n        &quot;name&quot;: &quot;AE Destroyed Cutout-Collar Sweater&quot;,\n        &quot;price&quot;: 26.97,\n        &quot;url&quot;: &quot;https:\/\/www.ae.com\/women-gifts-ae-destroyed-cutout-collar-sweater-oatmeal\/web\/s-prod\/1341_7947_286&quot;,\n        &quot;variations&quot;: &quot;Oatmeal&quot;\n    }\n}\n,{\n    &quot;product&quot;: {\n        &quot;brand&quot;: &quot;AEO&quot;,\n        &quot;category&quot;: &quot;Women|Featured|Statement Sleeves&quot;,\n        &quot;currency&quot;: &quot;USD&quot;,\n        &quot;date&quot;: &quot;2017-12-05T09:17:09.343Z&quot;,\n        &quot;description&quot;: &quot;Sweater weather forever.&quot;,\n        &quot;images&quot;: &quot;https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_008_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_008_os?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_008_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_008_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_008_b?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_106_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_106_os?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_106_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_106_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_106_b?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_309_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_309_b?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_628_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_628_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_628_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_628_b?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_639_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_639_os?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_639_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_639_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7819_639_b?scl=1&quot;,\n        &quot;name&quot;: &quot;AE Zip-Back Bell Sleeve Sweater&quot;,\n        &quot;price&quot;: 26.97,\n        &quot;url&quot;: &quot;https:\/\/www.ae.com\/women-ae-zip-back-bell-sleeve-sweater-neon-pink\/web\/s-prod\/1341_7819_628&quot;,\n        &quot;variations&quot;: &quot;Charcoal|Cream|Olive|Neon Pink|Rose&quot;\n    }\n}\n,{\n    &quot;product&quot;: {\n        &quot;brand&quot;: &quot;AEO&quot;,\n        &quot;category&quot;: &quot;Women|Featured|New Arrivals|Tops|Sweaters&quot;,\n        &quot;currency&quot;: &quot;USD&quot;,\n        &quot;date&quot;: &quot;2017-12-05T09:17:29.820Z&quot;,\n        &quot;description&quot;: &quot;Sweater weather forever.&quot;,\n        &quot;images&quot;: &quot;https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7808_001_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7808_001_b?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7808_300_of?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7808_300_os?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7808_300_ob?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7808_300_f?scl=1|https:\/\/s7d2.scene7.com\/is\/image\/aeo\/1341_7808_300_b?scl=1&quot;,\n        &quot;name&quot;: &quot;AE Chenille Side-Tie Sweater&quot;,\n        &quot;price&quot;: 26.97,\n        &quot;url&quot;: &quot;https:\/\/www.ae.com\/women-ae-chenille-side-tie-sweater-green\/web\/s-prod\/1341_7808_300&quot;,\n        &quot;variations&quot;: &quot;Black|Green&quot;\n    }\n}\n]\n<\/code><\/pre>","protected":false},"excerpt":{"rendered":"<p>American Eagle Outfitters is an American retailer of clothing and accessories headquartered in Pittsburgh, Pennsylvania. The brand was founded in 1977 by brothers Jay and Mark Silverman. Using this product scraper, you can collect information about the products and prices from ae.com website. Approx number of goods: 10000Approx number of page requests: 20000Recommended subscription plan: [&hellip;]<\/p>","protected":false},"author":4,"featured_media":302,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[31,30,2],"tags":[],"class_list":["post-300","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ecommerce-scraping","category-free-scrapers","category-web-scraping"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.5.1 - aioseo.com -->\n\t<meta name=\"description\" content=\"American Eagle Outfitters is an American retailer of clothing and accessories headquartered in Pittsburgh, Pennsylvania. The brand was founded in 1977 by brothers Jay and Mark Silverman. Using this product scraper, you can collect information about the products and prices from ae.com website. Approx number of goods: 10000 Approx number of page requests: 20000 Recommended\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Mikhail Sisin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/\" \/>\n\t\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.5.1\" \/>\n\t\t<meta property=\"og:locale\" content=\"en_US\" \/>\n\t\t<meta property=\"og:site_name\" content=\"Diggernaut - Leave the work to the robots\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"American Eagle Outfitters product scraper - Diggernaut\" \/>\n\t\t<meta property=\"og:description\" content=\"American Eagle Outfitters is an American retailer of clothing and accessories headquartered in Pittsburgh, Pennsylvania. The brand was founded in 1977 by brothers Jay and Mark Silverman. Using this product scraper, you can collect information about the products and prices from ae.com website. Approx number of goods: 10000 Approx number of page requests: 20000 Recommended\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2018-02-05T20:15:23+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2019-01-12T17:04:59+00:00\" \/>\n\t\t<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n\t\t<meta name=\"twitter:title\" content=\"American Eagle Outfitters product scraper - Diggernaut\" \/>\n\t\t<meta name=\"twitter:description\" content=\"American Eagle Outfitters is an American retailer of clothing and accessories headquartered in Pittsburgh, Pennsylvania. The brand was founded in 1977 by brothers Jay and Mark Silverman. Using this product scraper, you can collect information about the products and prices from ae.com website. Approx number of goods: 10000 Approx number of page requests: 20000 Recommended\" \/>\n\t\t<script type=\"application\/ld+json\" class=\"aioseo-schema\">\n\t\t\t{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"BlogPosting\",\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/american-eagle-outfitters-product-scraper\\\/#blogposting\",\"name\":\"American Eagle Outfitters product scraper - Diggernaut\",\"headline\":\"American Eagle Outfitters product scraper\",\"author\":{\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/author\\\/mikhail\\\/#author\"},\"publisher\":{\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/#organization\"},\"image\":{\"@type\":\"ImageObject\",\"url\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/02\\\/ae.jpg\",\"width\":1280,\"height\":500,\"caption\":\"American Eagle Outfitters product scraper\"},\"datePublished\":\"2018-02-05T20:15:23+00:00\",\"dateModified\":\"2019-01-12T17:04:59+00:00\",\"inLanguage\":\"en-US\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/american-eagle-outfitters-product-scraper\\\/#webpage\"},\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/american-eagle-outfitters-product-scraper\\\/#webpage\"},\"articleSection\":\"Ecommerce scraping, Free Scrapers, Web scraping\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/american-eagle-outfitters-product-scraper\\\/#breadcrumblist\",\"itemListElement\":[{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/#listItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/category\\\/web-scraping\\\/#listItem\",\"name\":\"Web scraping\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/category\\\/web-scraping\\\/#listItem\",\"position\":2,\"name\":\"Web scraping\",\"item\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/category\\\/web-scraping\\\/\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/american-eagle-outfitters-product-scraper\\\/#listItem\",\"name\":\"American Eagle Outfitters product scraper\"},\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/#listItem\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/american-eagle-outfitters-product-scraper\\\/#listItem\",\"position\":3,\"name\":\"American Eagle Outfitters product scraper\",\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/category\\\/web-scraping\\\/#listItem\",\"name\":\"Web scraping\"}}]},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/#organization\",\"name\":\"Diggernaut\",\"description\":\"Leave the work to the robots\",\"url\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/author\\\/mikhail\\\/#author\",\"url\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/author\\\/mikhail\\\/\",\"name\":\"Mikhail Sisin\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/american-eagle-outfitters-product-scraper\\\/#authorImage\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/a815178e6ae64bfffeef99fba7f44d291346fff103deeaaa05e0ebb0f82573df?s=96&d=mm&r=g\",\"width\":96,\"height\":96,\"caption\":\"Mikhail Sisin\"}},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/american-eagle-outfitters-product-scraper\\\/#webpage\",\"url\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/american-eagle-outfitters-product-scraper\\\/\",\"name\":\"American Eagle Outfitters product scraper - Diggernaut\",\"description\":\"American Eagle Outfitters is an American retailer of clothing and accessories headquartered in Pittsburgh, Pennsylvania. The brand was founded in 1977 by brothers Jay and Mark Silverman. Using this product scraper, you can collect information about the products and prices from ae.com website. Approx number of goods: 10000 Approx number of page requests: 20000 Recommended\",\"inLanguage\":\"en-US\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/#website\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/american-eagle-outfitters-product-scraper\\\/#breadcrumblist\"},\"author\":{\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/author\\\/mikhail\\\/#author\"},\"creator\":{\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/author\\\/mikhail\\\/#author\"},\"image\":{\"@type\":\"ImageObject\",\"url\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/02\\\/ae.jpg\",\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/american-eagle-outfitters-product-scraper\\\/#mainImage\",\"width\":1280,\"height\":500,\"caption\":\"American Eagle Outfitters product scraper\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/american-eagle-outfitters-product-scraper\\\/#mainImage\"},\"datePublished\":\"2018-02-05T20:15:23+00:00\",\"dateModified\":\"2019-01-12T17:04:59+00:00\"},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/\",\"name\":\"Diggernaut\",\"description\":\"Leave the work to the robots\",\"inLanguage\":\"en-US\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.diggernaut.com\\\/blog\\\/#organization\"}}]}\n\t\t<\/script>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"American Eagle Outfitters product scraper - Diggernaut","description":"American Eagle Outfitters is an American retailer of clothing and accessories headquartered in Pittsburgh, Pennsylvania. The brand was founded in 1977 by brothers Jay and Mark Silverman. Using this product scraper, you can collect information about the products and prices from ae.com website. Approx number of goods: 10000 Approx number of page requests: 20000 Recommended","canonical_url":"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"BlogPosting","@id":"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/#blogposting","name":"American Eagle Outfitters product scraper - Diggernaut","headline":"American Eagle Outfitters product scraper","author":{"@id":"https:\/\/www.diggernaut.com\/blog\/author\/mikhail\/#author"},"publisher":{"@id":"https:\/\/www.diggernaut.com\/blog\/#organization"},"image":{"@type":"ImageObject","url":"https:\/\/www.diggernaut.com\/blog\/wp-content\/uploads\/2018\/02\/ae.jpg","width":1280,"height":500,"caption":"American Eagle Outfitters product scraper"},"datePublished":"2018-02-05T20:15:23+00:00","dateModified":"2019-01-12T17:04:59+00:00","inLanguage":"en-US","mainEntityOfPage":{"@id":"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/#webpage"},"isPartOf":{"@id":"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/#webpage"},"articleSection":"Ecommerce scraping, Free Scrapers, Web scraping"},{"@type":"BreadcrumbList","@id":"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/#breadcrumblist","itemListElement":[{"@type":"ListItem","@id":"https:\/\/www.diggernaut.com\/blog\/#listItem","position":1,"name":"Home","item":"https:\/\/www.diggernaut.com\/blog\/","nextItem":{"@type":"ListItem","@id":"https:\/\/www.diggernaut.com\/blog\/category\/web-scraping\/#listItem","name":"Web scraping"}},{"@type":"ListItem","@id":"https:\/\/www.diggernaut.com\/blog\/category\/web-scraping\/#listItem","position":2,"name":"Web scraping","item":"https:\/\/www.diggernaut.com\/blog\/category\/web-scraping\/","nextItem":{"@type":"ListItem","@id":"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/#listItem","name":"American Eagle Outfitters product scraper"},"previousItem":{"@type":"ListItem","@id":"https:\/\/www.diggernaut.com\/blog\/#listItem","name":"Home"}},{"@type":"ListItem","@id":"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/#listItem","position":3,"name":"American Eagle Outfitters product scraper","previousItem":{"@type":"ListItem","@id":"https:\/\/www.diggernaut.com\/blog\/category\/web-scraping\/#listItem","name":"Web scraping"}}]},{"@type":"Organization","@id":"https:\/\/www.diggernaut.com\/blog\/#organization","name":"Diggernaut","description":"Leave the work to the robots","url":"https:\/\/www.diggernaut.com\/blog\/"},{"@type":"Person","@id":"https:\/\/www.diggernaut.com\/blog\/author\/mikhail\/#author","url":"https:\/\/www.diggernaut.com\/blog\/author\/mikhail\/","name":"Mikhail Sisin","image":{"@type":"ImageObject","@id":"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/#authorImage","url":"https:\/\/secure.gravatar.com\/avatar\/a815178e6ae64bfffeef99fba7f44d291346fff103deeaaa05e0ebb0f82573df?s=96&d=mm&r=g","width":96,"height":96,"caption":"Mikhail Sisin"}},{"@type":"WebPage","@id":"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/#webpage","url":"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/","name":"American Eagle Outfitters product scraper - Diggernaut","description":"American Eagle Outfitters is an American retailer of clothing and accessories headquartered in Pittsburgh, Pennsylvania. The brand was founded in 1977 by brothers Jay and Mark Silverman. Using this product scraper, you can collect information about the products and prices from ae.com website. Approx number of goods: 10000 Approx number of page requests: 20000 Recommended","inLanguage":"en-US","isPartOf":{"@id":"https:\/\/www.diggernaut.com\/blog\/#website"},"breadcrumb":{"@id":"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/#breadcrumblist"},"author":{"@id":"https:\/\/www.diggernaut.com\/blog\/author\/mikhail\/#author"},"creator":{"@id":"https:\/\/www.diggernaut.com\/blog\/author\/mikhail\/#author"},"image":{"@type":"ImageObject","url":"https:\/\/www.diggernaut.com\/blog\/wp-content\/uploads\/2018\/02\/ae.jpg","@id":"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/#mainImage","width":1280,"height":500,"caption":"American Eagle Outfitters product scraper"},"primaryImageOfPage":{"@id":"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/#mainImage"},"datePublished":"2018-02-05T20:15:23+00:00","dateModified":"2019-01-12T17:04:59+00:00"},{"@type":"WebSite","@id":"https:\/\/www.diggernaut.com\/blog\/#website","url":"https:\/\/www.diggernaut.com\/blog\/","name":"Diggernaut","description":"Leave the work to the robots","inLanguage":"en-US","publisher":{"@id":"https:\/\/www.diggernaut.com\/blog\/#organization"}}]},"og:locale":"en_US","og:site_name":"Diggernaut - Leave the work to the robots","og:type":"article","og:title":"American Eagle Outfitters product scraper - Diggernaut","og:description":"American Eagle Outfitters is an American retailer of clothing and accessories headquartered in Pittsburgh, Pennsylvania. The brand was founded in 1977 by brothers Jay and Mark Silverman. Using this product scraper, you can collect information about the products and prices from ae.com website. Approx number of goods: 10000 Approx number of page requests: 20000 Recommended","og:url":"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/","article:published_time":"2018-02-05T20:15:23+00:00","article:modified_time":"2019-01-12T17:04:59+00:00","twitter:card":"summary_large_image","twitter:title":"American Eagle Outfitters product scraper - Diggernaut","twitter:description":"American Eagle Outfitters is an American retailer of clothing and accessories headquartered in Pittsburgh, Pennsylvania. The brand was founded in 1977 by brothers Jay and Mark Silverman. Using this product scraper, you can collect information about the products and prices from ae.com website. Approx number of goods: 10000 Approx number of page requests: 20000 Recommended"},"aioseo_meta_data":{"post_id":"300","title":null,"description":null,"keywords":null,"keyphrases":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_custom_url":null,"og_image_custom_fields":null,"og_image_width":null,"og_image_height":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"none","tabs":null,"priority":null,"frequency":null,"local_seo":null,"breadcrumb_settings":null,"created":"2024-01-16 21:30:22","updated":"2026-10-26 02:53:55","focus_keyword":null,"additional_keywords":null,"truseo_locale":null,"primary_term":null,"og_image_url":null,"twitter_image_url":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"BlogPosting","isEnabled":true},"graphs":[]},"limit_modified_date":false,"ai":null,"seo_analyzer_scan_date":null},"aioseo_breadcrumb":"<div class=\"aioseo-breadcrumbs\"><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/www.diggernaut.com\/blog\/\" title=\"Home\">Home<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">\u00bb<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/www.diggernaut.com\/blog\/category\/web-scraping\/\" title=\"Web scraping\">Web scraping<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">\u00bb<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\tAmerican Eagle Outfitters product scraper\n\t\t<\/span><\/div>","aioseo_breadcrumb_json":[{"label":"Home","link":"https:\/\/www.diggernaut.com\/blog\/"},{"label":"Web scraping","link":"https:\/\/www.diggernaut.com\/blog\/category\/web-scraping\/"},{"label":"American Eagle Outfitters product scraper","link":"https:\/\/www.diggernaut.com\/blog\/american-eagle-outfitters-product-scraper\/"}],"_links":{"self":[{"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/posts\/300","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/comments?post=300"}],"version-history":[{"count":3,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/posts\/300\/revisions"}],"predecessor-version":[{"id":659,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/posts\/300\/revisions\/659"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/media\/302"}],"wp:attachment":[{"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/media?parent=300"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/categories?post=300"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/tags?post=300"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}