All Stories

Diggernaut can run JS routines

How to execute JavaScript snippet in the middle of the scraping process? Sometimes, when you scrape something, you may need to calculate some parameter...
Evgeniy Solomanidin
1 min read

I want to have my data flow directly…

Do you want to save data to RDBMS? It’s not that hard. So today I’m going to show you how easy it can be...
Evgeniy Solomanidin
1 min read

Self-hosted scraping? No problem!

Do you want to scrape some data from the website, but you are not ready to deploy your web scraper to the cloud and...
Mikhail Sisin
2 min read

How journalists can save time with data extraction.

Journalists have a difficult job. They have to do much research, and that takes time. Facts and figures are vital to a story or...
David Kostyshock
1 min read

What to do when server respond with JSON?

Diggernaut makes it easy to work with JSON format by converting it to XML. So now I’ll show you how you can work with...
Evgeniy Solomanidin
3 min read

Extract data from iCal? It couldn’t be easier.

Extract data from iCal? It couldn’t be easier. Today we write a script for scraping various resources which uses files in an iCal format...
Mikhail Sisin
4 min read

I have to scrape data from a website,…

No, you don’t. Let’s look at this in more detail. For web scraping, you need to know at least the basics of HTML markup,...
Evgeniy Solomanidin
2 min read

Web scraping as a tool for the participants…

In today’s world, information plays a key role. As Nathan Rothschild said, “Who owns the information, he owns the world,” and indeed it is....
Mikhail Sisin
2 min read

How scraping data is becoming the norm and…

Scraping data is a great tool to use if you need a lot of data, but there is always that fear of getting in...
David Kostyshock
1 min read