Escape from Blocking IP using Rotating Proxy in Python Yell.com Case Study

image from Unsplash

Often what we encounter in scraping is IP blocking, which is a condition where our IP is blocked when making requests to a site, there are several ways to bypass it.

  • Using VPN
  • Using Proxy

With these two ways, we can avoid our IP being blocked by the destination website when we send a lot of requests

Using VPN

in this case, we must have a VPN, there are several ways to get a VPN such as buying or we can get it for free there are also we activate the VPN on our host computer and then using it for scraping

Using Proxy

To Implement Proxy with Python for scraping, we can use many tools for example are requests

and here if using selenium

Conclusion

Well, this way we can bypass and do scraping without having to worry about our IP being blocked, okay that's it, originally posted in: https://blog.perykun.xyz/p/escape-from-blocking-ip-using-rotating-proxy-in-python-yell.com-case-study/

Interesting with Blockchain and Opensource Project my journal: https://www.perykun.xyz/

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Behind the SHELL when you type ls -l

Top 4 GitHub Action Slack integrations

How to Connect MetaMask to Polygon (MATIC) network-

API Management — Apigee #1

VSCode set up for Bioinformatics

Python Single Webpage Scraping Tutorial

Liquid left navigation using SVG animate

Silence Trimmer — Your first speech/audio processing exercise in Python

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Feri Lukmansyah

Feri Lukmansyah

Interesting with Blockchain and Opensource Project my journal: https://www.perykun.xyz/

More from Medium

Building a news app using newsapi and Django.

How to deploy Django on AWS elastic beanstalk with CICD (Part 2)

How To Deploy Your Django App On OVH (VPS with Nginx) + SSL certificate + Domain Name

Integrating Django and Stripe — Case Study: Online Shop