Death by Captcha<\/a> service. This service is not free, solving 1000 such captchas going to cost you approx 2.89$ (at least this is an actual price on 02.28.2018).<\/p>\nDiggernaut solve captcha automatically. You need to load the page with captcha and call special command captcha_resolve<\/strong> with specific parameters:<\/p>\nprovider<\/strong>: captcha solution provider, should be set to deathbycaptcha.com<\/em>\n
\ntype<\/strong>: captcha type, should be set to nocaptchav2<\/em>\n
\nusername<\/strong>: your death by captcha account username
\npassword<\/strong>: your death by captcha account password<\/p>\nAlso please NOTE!<\/strong> To have such captcha successfully resolved, persons who resolve your captcha should be able to connect page with captcha using the same IP as your web scraper. So, the only way to achieve it is to use YOUR OWN PROXY SERVER<\/strong> in the digger configuration. Any IP outside of our network cannot access our rotating proxies, so they cannot be used for this operation.<\/p>\nSo base code for our scraper to resolve captcha would be:<\/p>\n
---\nconfig:\n debug: 2\n agent: Firefox\n proxy: PUT YOUR OWN PROXY HERE\ndo:\n# We are going to retry calls until we get successfully resolved captcha (yes its not 100% successful rate), so we set variable we going to use in the walk command\n- variable_set:\n field: repeat\n value: "yes"\n# Loading page with captcha\n- walk:\n to: http:\/\/www.receita.fazenda.gov.br\/PessoaJuridica\/CNPJ\/cnpjreva\/cnpjreva_solicitacao2.asp\n repeat: \n do:\n # Resolving captcha\n - captcha_resolve:\n provider: deathbycaptcha.com\n type: nocaptchav2\n username: YOUR DBC USERNAME HERE\n password: YOUR DBC PASSWORD HERE<\/code><\/pre>\nDon\u2019t run this code yet.<\/strong> If the captcha has been successfully resolved, you get token value in the captcha<\/strong> variable. So the first thing we are going to do after captcha resolve process is to check if we have some value in the variable and depending on check results either retry call or submit token to the server and get the results.<\/p>\n---\nconfig:\n debug: 2\n agent: Firefox\n proxy: PUT YOUR OWN PROXY HERE\ndo:\n# We are going to retry calls until we get successfully resolved captcha (yes its not 100% successful rate), so we set variable we going to use in the walk command\n- variable_set:\n field: repeat\n value: "yes"\n# Loading page with captcha\n- walk:\n to: http:\/\/www.receita.fazenda.gov.br\/PessoaJuridica\/CNPJ\/cnpjreva\/cnpjreva_solicitacao2.asp\n repeat: \n do:\n # Resolving captcha\n - captcha_resolve:\n provider: deathbycaptcha.com\n type: nocaptchav2\n username: YOUR DBC USERNAME HERE\n password: YOUR DBC PASSWORD HERE\n # Switching to the body block\n - find:\n path: body\n do:\n # Reading captcha variable value to the register\n - variable_get: captcha\n # Checking if register has not empty value\n - if:\n match: \\w+\n do:\n # If its not empty, turn off repeat mode for walk command\n - variable_set:\n field: repeat\n value: "no"\n # Submit token along with other form data we need to submit to get information we need: we are getting information about the company using its CNPJ number\n - walk:\n to:\n post: http:\/\/www.receita.fazenda.gov.br\/PessoaJuridica\/CNPJ\/cnpjreva\/valida_recaptcha.asp\n data:\n origem: comprovante\n cnpj: 05754558000186\n g-recaptcha-response: \n submit1: Consultar\n search_type: cnpj\n do:\n - find:\n path: 'div#principal'\n do:\n - object_new: item\n - find:\n path: td:haschild(font:contains('N\u00daMERO DE INSCRI\u00c7\u00c3O')) b\n slice: 0\n do:\n - parse\n - space_dedupe\n - trim\n - object_field_set:\n object: item\n field: registration_number\n - find:\n path: td:haschild(font:contains('DATA DE ABERTURA')) b\n slice: 0\n do:\n - parse\n - space_dedupe\n - trim\n - object_field_set:\n object: item\n field: registration_date\n - find:\n path: td:haschild(font:contains('NOME EMPRESARIAL')) b\n slice: 0\n do:\n - parse\n - space_dedupe\n - trim\n - object_field_set:\n object: item\n field: company_name\n - find:\n path: td:haschild(font:contains('C\u00d3DIGO E DESCRI\u00c7\u00c3O DA ATIVIDADE ECON\u00d4MICA PRINCIPAL')) b\n slice: 0\n do:\n - parse\n - space_dedupe\n - trim\n - object_field_set:\n object: item\n field: primary_code\n - find:\n path: td:haschild(font:contains('C\u00d3DIGO E DESCRI\u00c7\u00c3O DAS ATIVIDADES ECON\u00d4MICAS SECUND\u00c1RIAS')) b\n do:\n - parse\n - space_dedupe\n - trim\n - object_field_push:\n object: item\n field: secondary_codes\n - find:\n path: td:haschild(font:contains('C\u00d3DIGO E DESCRI\u00c7\u00c3O DA NATUREZA JUR\u00cdDICA')) b\n slice: 0\n do:\n - parse\n - space_dedupe\n - trim\n - object_field_set:\n object: item\n field: legal_code\n - find:\n path: td:haschild(font:contains('LOGRADOURO')) b\n slice: 0\n do:\n - parse\n - space_dedupe\n - trim\n - object_field_set:\n object: item\n field: street\n - find:\n path: td:haschild(font:contains('BAIRRO\/DISTRITO')) b\n slice: 0\n do:\n - parse\n - space_dedupe\n - trim\n - object_field_set:\n object: item\n field: district\n - find:\n path: td:haschild(font:contains('MUNIC\u00cdPIO')) b\n slice: 0\n do:\n - parse\n - space_dedupe\n - trim\n - object_field_set:\n object: item\n field: municipal\n - find:\n path: td:haschild(font:contains('TELEFONE')) b\n slice: 0\n do:\n - parse\n - space_dedupe\n - trim\n - object_field_set:\n object: item\n field: phone\n - find:\n path: td:haschild(font:contains('E-MAIL')) b\n slice: 0\n do:\n - parse\n - space_dedupe\n - trim\n - object_field_set:\n object: item\n field: email\n - object_save:\n name: item<\/code><\/pre>\nYou should get the following data when you run it.<\/p>\n
[{\n "item": {\n "company_name": "LIST - LOGISTICA INTEGRADA, SERVICOS E TRANSPORTES LTDA",\n "district": "COROADO",\n "legal_code": "206-2 - Sociedade Empres\u00e1ria Limitada",\n "municipal": "MANAUS",\n "phone": "(92) 3622-7885",\n "primary_code": "52.12-5-00 - Carga e descarga",\n "registration_date": "26\/06\/2003",\n "registration_number": "05.754.558\/0001-86",\n "secondary_codes": [\n "49.30-2-02 - Transporte rodovi\u00e1rio de carga, exceto produtos perigosos e mudan\u00e7as, intermunicipal, interestadual e internacional",\n "77.39-0-99 - Aluguel de outras m\u00e1quinas e equipamentos comerciais e industriais n\u00e3o especificados anteriormente, sem operador",\n "77.19-5-99 - Loca\u00e7\u00e3o de outros meios de transporte n\u00e3o especificados anteriormente, sem condutor",\n "52.29-0-99 - Outras atividades auxiliares dos transportes terrestres n\u00e3o especificadas anteriormente",\n "49.30-2-01 - Transporte rodovi\u00e1rio de carga, exceto produtos perigosos e mudan\u00e7as, municipal",\n "52.50-8-03 - Agenciamento de cargas, exceto para o transporte mar\u00edtimo"\n ],\n "street": "R PROFESSORA RAYMUNDA MAGALHAES"\n }\n}\n]\n<\/code><\/pre>\nThis particular solution can be used in \u201cData on demand\u201d scenario when someone enters a number on your website. Your website sends a command to the Diggernaut API to run digger with a specific incoming parameter. API then return results to your website and its render results to your user. Please note, that captcha resolve process is not very fast. For example, resolve process for reCaptcha v2 may take more than a minute.<\/p>\n
However, in any case, we are hoping that this article was useful for you and you now know, how to bypass recaptcha v2 with Diggernaut and Death by Captcha. We are planning to implement other captcha solutions soon, so please keep tuned.<\/p>","protected":false},"excerpt":{"rendered":"
Google reCaptcha v2 is not a problem for our users anymore. We recently implemented integration with Death by Captcha service, and you can easily bypass such captcha now. Let\u2019s see how reCaptcha v2 looks like: If you see such captcha on the website you need to scrape, you can continue reading as we are going […]<\/p>","protected":false},"author":4,"featured_media":447,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[32,9,2],"tags":[],"class_list":["post-441","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-codeproject","category-learning-meta-language","category-web-scraping"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/posts\/441","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/comments?post=441"}],"version-history":[{"count":7,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/posts\/441\/revisions"}],"predecessor-version":[{"id":634,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/posts\/441\/revisions\/634"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/media\/447"}],"wp:attachment":[{"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/media?parent=441"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/categories?post=441"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.diggernaut.com\/blog\/wp-json\/wp\/v2\/tags?post=441"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
![\"Bypass](\"https:\/\/www.diggernaut.com\/blog\/wp-content\/uploads\/2018\/02\/recaptchav21.jpg\")
<\/a><\/figure>\n