Proxy Integration With WebHarvy

3. Click on Proxy Settings. Select to mark Enable network connection via Proxy Server and choose HTTP, HTTPS, or SOCKS5 as your Type.

To configure Oxylabs proxies, add the following details.

Residential Proxies

Type: HTTP, HTTPS, or SOCKS5

Host: pr.oxylabs.io

Port: 7777

You can also use country-specific entries. For example, if you fill in us-pr.oxylabs.io under Address and 10000 under Port, you’ll acquire a US exit node. For a complete list of country-specific entry nodes or if you need a sticky session, please refer to our documentation.

Enterprise Dedicated Datacenter Proxies

Specify the following if you purchased Dedicated Datacenter Proxies via sales.

Type: HTTP or SOCKS5

Host: a specific IP address (e.g., 1.2.3.4)

Port: 60000

For Enterprise Dedicated Datacenter Proxies, you’ll have to choose an IP address from the acquired list. Visit our documentation for more details.

Self-Service Dedicated Datacenter Proxies

Specify the following if you purchased Dedicated Datacenter Proxies via the dashboard.

Type: HTTP or HTTPS

Host: ddc.oxylabs.io

Port: 8001

For Self-Service Dedicated Datacenter Proxies, the port indicates the sequential number of an IP address from the acquired list. Check our documentation for more details.

Shared Datacenter Proxies

Type: HTTP

Host: dc.pr.oxylabs.io

Port: 10000

You can also use a country-specific entry. For example, entering dc.ca-pr.oxylabs.io under Host and 34000 under Port will acquire a Canadian exit node. Please refer to our documentation for a complete list of country-specific entry nodes.

4. Click to mark Requires authentication to enter your Oxylabs proxy user’s Username and Password. Click on the + button to add your newly input proxy to the list. Lastly, press Apply to finish your WebHarvy proxy servers integration.

And that’s all. With proxies, WebHarvy can scrape data anonymously without being blocked.

How do you scrape with WebHarvy?

1. To begin, navigate to a target website. In this case, search results from https://sandbox.oxylabs.io/products.

2. Press Start to begin target data selection.

3. Select the desired attributes, for example, book titles and prices. The browser allows you to click on specific content for scraping. The cursor detects data patterns that occur on a webpage. If the data repeats, the tool scrapes it automatically without additional user input.

4. Choose Capture Text and name your items accordingly.

5. After selecting data to be scraped, press Stop to finish the configuration.

6. Click Start-Mine and press ▶Start to extract your data.

7. After the extraction process is over, click Export and select the export method. WebHarvy saves scraped data in Excel, XML, CSV, JSON, and TSV formats. Alternatively, a database destination could be used as well.

And that’s it. Here’s the final result – a spreadsheet with titles, prices, availability, and description.