All requests that a digger makes are done through a network of proxy servers. By default we provide you with our network of proxy servers for free use.
Users using a paid subscription can take advantage of geographic targeting by country and (or) city. In this case, when starting the digger, only proxies from the specified country or city are selected. If geotargeting is not used, or user is on the free plan, then all proxies from our pool from all countries of the world are selected.
You can use geo parameter to set geo zone:
# SELECT ONLY USA PROXIES - config: geo: country: US # SELECT PROXIES ONLY FROM CHICAGO - config: geo: city: Chicago # SELECT PROXIES ONLY FROM MOSCOW, USA - config: geo: country: US city: Moscow
Note that if no proxy is found for the specified geo-zone, the execution will fail. Currently, the following cities and countries are supported:
|US||Anchorage, Atlanta, Chicago, Dallas, Denver, Des Moines, Honolulu, Los Angeles,
Miami, New York City, Omaha, Phoenix, Salem, San Jose, Seattle
Also, there may be situations when you need to use your own proxy server or a list of proxy servers with rotation inside the digger. To install your proxy server or list of proxy servers, you can use the proxy parameter:
# SETTING UP YOUR OWN PROXY SERVER FOR REQUESTS - config: proxy: 18.104.22.168:8080 # SETTING UP YOUR OWN PROXY SERVER WITH BASIC AUTH - config: proxy: username:firstname.lastname@example.org:8080 # SETTING UP LIST OF PROXIES - config: proxy: - 22.214.171.124:8080 - 126.96.36.199:8080
As you can see, your proxies should be written in the IPADDRESS: PORT notation. We do not provide IP addresses of our servers, so if your proxies require authorization, make sure that you can use login and password for authorization, not IP address.
We also integrate with various services for the automated provision of proxy servers. At the moment you can easily use the Luminati service within your diggers, if you have an account in their service. In this case, you should use the proxy parameter as follows:
# USING LUMINATI SERVICE AS PROXY-PROVIDER - config: proxy: provider: Luminati username: your_luminati_login password: your_luminati_password zone: geo_zone_you_want_to_use