How to Set Up Proxies With Octoparse

3. Type the URL of the webpage you intend to extract data from in the URL Input and click Save. Let's use Oxylabs scraping sandbox as an example.

4. After your selected URL loads, go to Task Settings > Anti-blocking. Now, check Access websites via proxies, enable Use my own proxies, and click Configure.

5. Configure your Oxylabs proxies by specifying the following format:

IP/host:port:username:password

Residential Proxies

IP/host: pr.oxylabs.io

Port: 7777

You can also use country-specific entries. For example, entering ie-pr.oxylabs.io under IP/host and 25000 under Port will acquire an Irish exit node. Please refer to our documentation for a complete list of country-specific entry nodes or if you need a sticky session.

Enterprise Dedicated Datacenter Proxies

IP/host: a specific IP address (e.g., 1.2.3.4)

Port: 60000

For Enterprise Dedicated Datacenter Proxies, you’ll have to choose an IP address from the acquired list. Visit our documentation for more details.

Self-Service Dedicated Datacenter Proxies

IP/host: ddc.oxylabs.io

Port: 8001

For Self-Service Dedicated Datacenter Proxies, the port indicates the sequential number of an IP address from the acquired list. Check our documentation for more details.

Shared Datacenter Proxies

IP/host: dc.pr.oxylabs.io

Port: 10000

You can also use a country-specific entry. For example, entering dc.jp-pr.oxylabs.io under IP/host and 12000 under Port will acquire a Japanese exit node. Please refer to our documentation for a complete list of country-specific entry nodes.

6. Depending on whether you use a rotating or sticky session type, set up the Switch interval.

7. Enter your Oxylabs proxy user’s credentials. Use the same username and password you entered to create a new proxy user in the Oxylabs dashboard.

Proxies are now set up.

2. Set up pagination to scrape multiple pages. This particular website uses numbered pages, prompting you to choose Next page button.

3. Choose the exact button in the page layout that opens the following page – Forward – to automate pagination.

4. Complete the scraping setup and press ▶Run.

5. Choose Run on your device with Standard Mode to receive data as a file on your PC.

6. Let the scraping process run until complete. The process will be over when the final product page is reached or when you stop it manually.

7. Extract the collected data and select the file format.

Here's the final result in a spreadsheet.

That’s it – you are all set up and ready to focus on your web scraping tasks with Octoparse.

Conclusion

Combined with Oxylabs proxies, Octoparse can assist businesses in their data extraction operations. The tool is simple and doesn’t need any coding, yet fast and efficient. If you still have questions about the Octoparse proxy integration process, don’t hesitate to contact us.

Check for more similar web scraping tools like WebHarvy in our integrations.

Please be aware that this is a third-party tool not owned or controlled by Oxylabs. Each third-party provider is responsible for its own software and services. Consequently, Oxylabs will have no liability or responsibility to you regarding those services. Please carefully review the third party's policies and practices and/or conduct due diligence before accessing or using third-party services.