Back to blog
Web scraping presents plenty of challenges. Thankfully, solutions are abundant with various data extraction libraries, proxies, custom approaches, and all-inclusive third-party services.
Augustas Pelakauskas
2023-06-30
6 min read
In this tutorial, we will focus on describing the asynchronous approach to scraping multiple URLs and by comparing it to the synchronous one, demonstrate why it can be more beneficial.
Yelyzaveta Nechytailo
2023-06-27
6 min read
Check this technical tutorial to learn how to bypass CAPTCHA with Puppeteer and an advanced AI-based tool, Web Unblocker.
Maryia Stsiopkina
2023-06-22
4 min read
Choosing between a SOCKS vs HTTP proxy requires a thorough understanding of how each type works and what configurations they convey. Only then you will be able to efficiently juggle between different types of proxies and find the best option for your specific use case. Continue reading this article to learn more about SOCKS and HTTP proxies.
Vejune Tamuliunaite
2023-06-21
5 min read
Check this step-by-step guide where Oxylabs' affiliate partner ESPY shares how to leverage open-source intelligence to grow your business.
Maryia Stsiopkina
2023-06-20
2 min read
OxyCon is back for its fourth year with inspiring speakers and captivating presentations.
Enrika Pavlovskytė
2023-06-19
2 min read
Read about the key differences between SQL and NoSQL databases and determine which type may be more relevant for your projects.
Danielius Radavicius
2023-06-15
7 min read
See the latest Scraping Experts video lesson for insights on product monitoring systems, including their importance, initial challenges, and effective solutions.
Vytenis Kaubre
2023-06-13
2 min read
cURL is a lightweight yet powerful tool for sending POST requests from CLI. Read this tutorial for detailed instructions on sending POST requests with cURL.
Yelyzaveta Nechytailo
2023-06-09
3 min read
See this extensive guide on how to scrape Google Maps with an Oxylabs solution.
Danielius Radavicius
2023-06-09
5 min read
Read this article to learn sending simple cURL GET requests or with parameters effortlessly. Find out how to retrieve JSON data and the main request arguments.
Iveta Vistorskyte
2023-06-09
4 min read
Join Oxylabs at Travel Tech Show, London, to discover the latest travel industry trends and innovations as well as connect with industry experts.
Iveta Vistorskyte
2023-06-08
2 min read
Even if you've never heard of it, this tutorial will help you learn the basics of parsing data with Beautiful Soup.
Adomas Sulcas
2023-06-06
9 min read
An action chain of processes and solutions for public web data collection in the travel industry.
Augustas Pelakauskas
2023-06-02
1 min read
Check this step-by-step tutorial to learn how to parse XML data in Python, what libraries you should use, how to handle invalid XML, and more.
Maryia Stsiopkina
2023-06-02
6 min read
In our second installment, we will be discussing how to scrape images from websites. We reuse code used in our older article so be sure to read that one as well!
Adomas Sulcas
2023-06-01
5 min read
Watch Oxylabs Webinar and find out how AI is becoming an essential part of web scraping.
Danielius Radavicius
2023-05-31
2 min read
Kickstart your journey with whis Mobile Proxies guide. Learn about the features, pricing plans, query formation, and much more.
Vytenis Kaubre
2023-05-31
3 min read
Get Oxylabs Mobile Proxies in a hassle-free way and access new payment plans that fit your needs!
Danielius Radavicius
2023-05-31
3 min read
This guide covers various aspects of sending and receiving HTTP headers using cURL. The content discloses tips for use cases and discusses troubleshooting cURL header issues.
Augustas Pelakauskas
2023-05-25
4 min read
"4β" established a new partnership with #SRNT - a nonprofit Crisis Aide platform, that aims to can provide real-time support and assistance for individuals facing difficult life situations.
Gabija Birgile
2023-05-24
2 min read
Discover the functionalities of caching in Python and see how you can speed up large-scale web scraping tasks.
Vytenis Kaubre
2023-05-17
9 min read
Follow this detailed tutorial and learn how to combine cURL with Python for effective data transfer processes.
Roberta Aukstikalnyte
2023-05-17
4 min read
A detailed yet clear step-by-step tutorial on using cURL with REST API. Check it out and implement the gathered insights to future projects.
Yelyzaveta Nechytailo
2023-05-16
4 min read
Watch Oxylabs webinar on-demand to make sure you get all the needed insights to step into the e-commerce data collection confidently.
Yelyzaveta Nechytailo
2023-05-10
2 min read
The partnership between "Project 4β"and Debunk.org will provide the organization with Oxylabs' cutting-edge web scraping technology and expertise to combat false information online on a pro-bono basis.
Gabija Birgile
2023-05-10
2 min read
Learn how to understand, avoid, and solve Python syntax errors by following this in-depth guide.
Vytenis Kaubre
2023-05-08
9 min read
Explore web page snapshots, their functionalities, benefits, and various use cases.
Enrika Pavlovskytė
2023-05-05
4 min read
Join Oxylabs at the heart of Silicon Valley for countless learning and networking opportunities at AI & Big Data Expo in Santa Clara.
Enrika Pavlovskytė
2023-05-04
2 min read
Discover the most popular types of proxy lists available and choose which one fits your scraping needs best.
Yelyzaveta Nechytailo
2023-05-04
4 min read
Need help deciding what integration method to use? Check this article to learn about primary Scraper APIs integration methods, their key advantages, and some helpful tips.
Maryia Stsiopkina
2023-05-02
5 min read
Learn what Data as a Service (DaaS) is, how it works, what role it plays in business development, and what to consider when choosing your own DaaS provider.
Augustas Pelakauskas
2023-04-28
5 min read
An extensive Scrapy Splash tutorial on scraping public web data from JavaScript-rendered websites.
Roberta Aukstikalnyte
2023-04-25
5 min read
Read our in-depth guide, where we compare structured and unstructured data, identifying each types’ pros, cons, use cases, and more.
Roberta Aukstikalnyte
2023-04-13
5 min read
Get access to Oxylabs’ top products using a quick self-checkout process – request and start using in just a few clicks!
Yelyzaveta Nechytailo
2023-04-06
3 min read
Discover the essentials of Web Unblocker and learn how to get started with it.
Vytenis Kaubre
2023-04-06
2 min read
Check out our newest Python tutorial where we outline how to use the Requests library. Get some easy -o-use tips for GET and POST methods.
Adomas Sulcas
2023-04-06
11 min read
Oxylabs has been featured in a special report, created by the Raconteur as an important asset to the global AI and data industry. Check out the post to read the report.
Adomas Sulcas
2023-04-04
1 min read
This article covers everything you need to get started with Crawlee. Learn more about its benefits and see a working example of scraping a website with Crawlee.
Yelyzaveta Nechytailo
2023-04-04
6 min read
A step-by-step tutorial on extracting data from Wayfair’s product pages at scale and in real time. The guide details actionable code and considers various aspects before and during the scraping process.
Augustas Pelakauskas
2023-04-03
6 min read
Learn how to extract data from Best Buy product pages at scale and in real time with Best Buy Scraper API. The API automates the underlying processes and delivers ready-to-use data.
Augustas Pelakauskas
2023-04-02
3 min read
See the various popular languages used in public web scraping operations and determine each's strengths and limitations.
Danielius Radavicius
2023-03-31
7 min read
Read this article where we discuss a few useful ways of making public data collection faster as well as provide sample codes that you can implement in your scraping activities.
Yelyzaveta Nechytailo
2023-03-29
6 min read
This article explains everything about Playwright and how it can be used for automation and even web scraping.
Iveta Vistorskyte
2023-03-29
9 min read
When it comes to hiding your identity online, using proxies is a great way to stay anonymous and keep your real IP address hidden. In this article, you’ll get an answer to the question, why dedicated proxies are usually better than shared ones.
Gabija Fatenaite
2023-03-29
4 min read
The latest Scraping Experts lesson on sophisticated anti-bot systems and how to sucessfully bypass them.
Enrika Pavlovskytė
2023-03-27
2 min read
A detailed guide on scraping public real estate data from Zillow.
Roberta Aukstikalnyte
2023-03-24
5 min read
Got your IP banned from a website? This blog post will walk you through the best solutions on how to prevent IP bans from ever happening again.
Enrika Pavlovskytė
2023-03-24
5 min read
Read this article to learn the ins and outs of the Extract, Load, and Transform process.
Vytenis Kaubre
2023-03-23
5 min read
This technical tutorial will walk you through the key steps of web scraping with Scrapy.
Maryia Stsiopkina
2023-03-23
5 min read
Scale up your business with Oxylabs®
GET IN TOUCH
General:
hello@oxylabs.ioSupport:
support@oxylabs.ioCareer:
career@oxylabs.ioCertified data centers and upstream providers
Connect with us
Advanced proxy solutions
Resources
Innovation hub