{"id":21,"date":"2016-08-30T23:55:49","date_gmt":"2016-08-30T23:55:49","guid":{"rendered":"https:\/\/blog.diggernaut.com\/?p=21"},"modified":"2019-01-12T22:57:46","modified_gmt":"2019-01-12T22:57:46","slug":"how-scraping-data-is-becoming-the-norm-and-not-the-black-sheep","status":"publish","type":"post","link":"https:\/\/www.diggernaut.com\/blog\/how-scraping-data-is-becoming-the-norm-and-not-the-black-sheep\/","title":{"rendered":"How scraping data is becoming the norm and not the black sheep"},"content":{"rendered":"<p>Scraping data is a great tool to use if you need a lot of data, but there is always that fear of getting in trouble for scraping that data. Of course, some websites have copyright issues with taking data from them, but there are also websites that are a free game such as government websites. Scraping data has always been a grey area, but it seems that that grey area is becoming clearer.<\/p>\n<p>With these three new trials in favor of scraping, I believe the adage of scraping is bad and illegal will be exchanged with \u201cwell hey, this is a lot of data so why not just scrape it.\u201d Companies begin to become\u00a0laxer on scraping data; even if there is a cut for them.\u00a0 Why not benefit from it? If there is a benefit for both sides, isn\u2019t it a win-win for both sides? I think so. Companies begin to realize that scraping is a business and if they can get a cut of that business they will. I don\u2019t see why more companies aren\u2019t willing to work with scrapers. Companies are so fast to get upset and think they are being taken for when scrapers can take the next step and begin to work with companies\u00a0to find a middle ground.<\/p>\n<p>The internet is an excellent place with good and bad things. We can all admit that. Saying that there is a lot of data that other people need, want, or desire for many reasons. The internet is full of information, ready at everyone\u2019s hands. Why can\u2019t we all come to a big kumbaya and accept that we all can share information? The information is just floating out there in, and everyone can see it. What is the difference between someone manually writing all the data down or a scraper collecting all the data? Well, one takes longer, and the other doesn\u2019t. Companies need to realize, their data is going to be collected and used no matter if it\u2019s done manually or by a scraper; so why not just work with a scraping company?<\/p>\n<p>Additional Information: <a href=\"http:\/\/www.bna.com\/web-scraping-era-n57982073780\/\">Cases for Scraping<\/a><\/p>","protected":false},"excerpt":{"rendered":"<p>Scraping data is a great tool to use if you need a lot of data, but there is always that fear of getting in trouble for scraping that data. Of course, some websites have copyright issues with taking data from them, but there are also websites that are a free game such as government websites. [&hellip;]<\/p>","protected":false},"author":3,"featured_media":23,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[7,8,6],"class_list":["post-21","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-web-scraping","tag-data","tag-information","tag-scraping"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/posts\/21","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/comments?post=21"}],"version-history":[{"count":8,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/posts\/21\/revisions"}],"predecessor-version":[{"id":694,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/posts\/21\/revisions\/694"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/media\/23"}],"wp:attachment":[{"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/media?parent=21"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/categories?post=21"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/tags?post=21"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}