DATA
SCRAPING,EXTRACTION,COLLECTION
JUST BECAME EASY

Turn website content into datasets
No programming skills required

REGISTER FOR FREE


Turn unorganized web content into well structured datasets

Who is Diggernaut and what is a digger?

Diggernaut is a cloud based service for web scraping, data extraction and other ETL tasks. If you are a reseller of goods and your supplier doesn't let you have their data in a suitable format, such as excel or csv, you will have to manually retrieve data from their website.

All you need to do is to create a digger, a tiny robot that can do web scraping on your behalf and extract data from websites for you, normalize it and save data to the cloud. Once it’s done, you can download it in CSV, XLS, JSON format or even retrieve it using our Rest API.

 

 

 

What type of data can Diggernaut extract for you?

  • Product prices and other related information, reviews and ratings from retailer sites.
  • Different types of events happening in different locations of the world.
  • News and headlines from different news agencies websites.
  • Statistical data from different sources.
  • Different government data and reports (police, sheriff, fire depts.). Even obtain court related documents.
  • Licenses and permits issued from municipal and governmental structures.
  • People opinions and comments on forums or social media platform.
  • Real estate property information that may contain recorder, assessor, or tax information.
  • Mostly anything on the web

 

 

Do I need to be an expert in programming to use Diggernaut?

If you don’t have any programming skills, you can use our Visual Extractor tool to build configuration for your digger. Its simple point & click application where you select what data you want to extract and set how you want to have it in your output data structure. We have video lessons explaining how to use it on our sandbox website.

If you are a programmer or web-developer, you can use meta-language to build configuration for a digger. This way you can solve really complex data extraction tasks. We have comprehensive meta-language documentation which helps you to get used into it; also we have many posts on our blog where we show how you can use different meta-language functions to solve different real cases.

If you just don’t want to spend any time on it, you can hire our developer who will do all this for you and all you need to do is to receive data in a requested format.

People ask, Diggernaut answer

WHY DO I NEED DIGGERNAUT?
 

Imagine spending hours or even days manually collecting data from thousands of pages. It's very cumbersome and time consuming. With Diggernaut, you can speed up the data collection process a thousand times and save time to do more important tasks.

CAN I USE ONE DIGGER FOR MULTIPLE SITES/PAGES?

Every digger can work with many pages, on one or multiple websites. So basically your digger can jump from page to page or even to another website and grab all data you need; however make sure that all root data objects you have to contain the same structure.

CAN I RUN DIGGERS ON MY OWN SERVER? WILL I BE CHARGED FOR IT?

You can compile your digger into an executable file for Windows, Linux or Mac, and then download the file on your own computer or server to run it there. You will not be charged for running it on your side; you can run it as many times and as long as you need.

WHAT IS YOUR BACKEND FOR DIGGERS?

We are using Golang, compiled programming language, as backend for our diggers. With Golang, we can compile fast and efficient executable files, compared to anything written with interpreted programming language (eg. Python, Ruby, JS, Perl, PHP) so you spend less of your server resources to get more data.

DO YOU HAVE A FREE TRIAL?

We have a free plan, which is better than a free trial, as you can use the free plan as long as you like. Free users can use the same functionality but have lower limits in page requests, bandwidth, number of projects and diggers they can have.

CAN I EXTRACT TEXT FROM IMAGES?

Yes, we have an OCR module and you can use it with your digger to extract text from images. Please note, that OCR functionality is not available for compiled diggers. You can use it only for diggers that are running in our cloud.

FREE DEBUG RESOURCES

Test it free before start.

SATISFACTION GUARANTEE

Work easy and with pleasure.

ONLINE SUPPORT 24/7

We are happy to help you.