Python Developer ( Web Scraping)

This role is for one of the Weekday's clients

Salary range: Rs 200000 - Rs 600000 (ie INR 2-6 LPA)

Min Experience: 1 years

Location: Pune

JobType: full-time

The Python Developer (Web Scraping) will be responsible for building, maintaining, and scaling web scraping systems capable of efficiently handling large volumes of structured and unstructured data. This role focuses on reliability, performance optimization, and automation of data extraction workflows.

Requirements

Key Responsibilities

• Maintain, enhance, and optimize existing web scraping and data extraction frameworks.
• Identify and resolve scraping failures, website bans, CAPTCHAs, and performance bottlenecks.
• Develop robust Python scripts for scheduled and periodic data collection.
• Scale scraping pipelines to support high-volume and distributed data extraction.
• Monitor scraper health and ensure data accuracy, consistency, and completeness.
• Collaborate with internal teams to improve scraping efficiency and reliability.
• Implement best practices for code quality, performance, and maintainability.

Required Skills & Experience

• 1+ year of hands-on experience in Python-based web scraping.
• Strong proficiency with scraping frameworks and libraries such as:
• Scrapy
• Selenium
• Playwright
• Requests
• BeautifulSoup (bs4)
• Solid understanding of HTML5, CSS3, JavaScript, and dynamic web pages.
• Strong Linux command-line skills.
• Experience using Git for version control.
• Ability to debug scraping issues related to website changes or anti-bot mechanisms.

Good to Have

• Experience working with databases for storing and managing scraped data.
• Familiarity with scheduling tools or task automation.
• Exposure to proxy management, IP rotation, or CAPTCHA-solving techniques.

Skills

Python · Web Scraping · Scrapy · Selenium · Playwright · BeautifulSoup · Requests · Linux · Git