Diggers

PUT diggers/:id/start

The request sends a command to immediately start the digger, waits for the completion of the execution, and returns the scraped data in the JSON format. You can send arguments to the digger in the body of the request. Digger will use passed values as variables. This functionality is called "data on demand". For example, you can send a specific search string to a specific URL, collect the results found and download them in the dataset. Basically this functionality turning any website to an API.

Reference information about the resource:

API Endpoint https://www.diggernaut.com/api/diggers/:id/start
Request Format JSON
Response Format JSON
Access Level User with paid subscription
Limits Yes

Request parameters:

variables Name-value pairs of parameters that will be used as variables [hashmap[string]string].
                    curl -v -X PUT -H "Content-type: application/json" -H "Authorization: Token 9944b09199c62bcf9418ad846dd0e4bbdfc6ee4b" https://www.diggernaut.com/api/diggers/ -d '{"variables":{"section":"CoolRobot","age":"10"}}'
                    
                    HTTP/1.0 200 OK
Date: Fri, 19 Aug 2016 17:36:48 GMT
Server: WSGIServer/0.1 Python/2.7.12
Vary: Accept, Accept-Language, Cookie
X-Frame-Options: SAMEORIGIN
Content-Type: application/json
Content-Language: en
Allow: GET, PUT, PATCH, HEAD, OPTIONS
                    [
    {
        "incident": {
            "call_number": "EP17192020",
            "time": "8:43am",
            "grid": "5100",
            "disposition": "No Info",
            "address": "715 Aspen Dr SECURITY",
            "date": "12/12/2017",
            "problem": "Harassment Cold"
        },
        "_id": {
            "$oid": "5a301427b6f82c2216f0e869"
        }
    },
    {
        "incident": {
            "call_number": "EP17192017",
            "time": "8:39am",
            "grid": "4607",
            "disposition": "No Info",
            "address": "11520 Eureka Rd PEYTON",
            "date": "12/12/2017",
            "problem": "Suspicious Incident"
        },
        "_id": {
            "$oid": "5a301427b6f82c2216f0e86a"
        }
    }
]