Hello
I am a professional python developer. My main specializations are automation, web scrapers and bots development.
I have already developed over 200 scrapers. From the simplest (for example, a competitor's price collector) to complex parsers (with authorization, bypassing captcha, rotating ips and others) which can collect millions of products from amazon.
I have done web scrapers for:
- Amazon
- Instagram
- Facebook
- Google
- Twitter
- LinkedIn
- Pinterest
- Walmart
- And many others
For scraping I use:
- Python
- Requests
- BeautifulSoup
- Selenium
- Scrapy
- Pyautogui
- Undetected Chromedriver
- Rotating ips
I can bypass:
- CloudFlare
- IP blocking
- Captcha
- Authorization required
- Other limitations
Django / PostgreSQL
For big scraping projects I usually use Django with PostgreSQL. This allows us to store information in a database for further processing and use. I also set up an administration area which allows us to check the data and set up scraper configs.
If you need a professional solution in this area - I am ready to cooperate.
I am ready to make a sample script before we start
Regards, Oleg