Blog > Python

Web scraping with Python language and libraries


How to Implement User Agent Rotation for Web Scraping

Web scraping is a powerful tool for acquiring valuable data from the internet. However, it often entails overcoming obstacles like bot detection and IP blocking. One possible solution to these challenges is user agent rotation. This blog post will explore the importance of user agents in web scraping, the need for rotating user agents, and various techniques to implement user agent rotation in Python

Posted by Vlad Mishkin | October 2, 2023
Web Scraping with Python and Selenium

Web Scraping with Python and Selenium

In this post, we are going to look at how we can scrape data using Selenium, Chrome Web Driver, and Python

Posted by Vlad Mishkin | March 12, 2023
Twitter Scraping in 2023

Twitter Scraping in 2023

Twitter is one of the most popular social media platforms, with millions of users tweeting and sharing their thoughts and opinions every day. Here is how to scrape it.

Posted by Vlad Mishkin | March 8, 2023
Web Scraping with Python

Web Scraping with Python

A tutorial about web scraping in Python with examples. We will take a look at the most popular Python tools for web scraping: Requests, BeautifulSoup, lxml and others.

Posted by Vlad Mishkin | February 5, 2023