01Overview
Python Developer Web Scraping
Experience: 25 Years
Location: Chennai
Employment Type: Full-time
Job Summary
We are looking for a Python Developer (25 years) with hands-on experience in Web Scraping, Data Extraction, and Automation. The ideal candidate should have strong Python programming skills and experience in building scalable web scraping solutions for collecting and processing data from various websites.
Key Responsibilities
Develop and maintain web scraping applications using Python.
Extract data from static and energetic websites.
Build scraping solutions using Scrapy, BeautifulSoup, Selenium, Playwright, and Requests.
Handle JavaScript-rendered websites, authentication, cookies, sessions, and pagination.
Integrate scraped data into databases and APIs.
Optimize scraping performance and ensure data quality.
Troubleshoot scraping issues caused by website structure changes.
Write clean, scalable, and maintainable Python code.
Required Skills
25 years of experience in Python Development.
Robust experience in Python, Web Scraping, and Automation.
Hands-on experience with:
Scrapy
BeautifulSoup
Selenium
Playwright
Requests
Pandas
Valuable knowledge of HTML, CSS, XPath, JSON, XML, and REST APIs.
Experience with MySQL/PostgreSQL/MongoDB.
Familiarity with Git and Linux environment.
Robust debugging and problem-solving skills.
Good to Have
Experience with FastAPI, Flask, or Django.
Knowledge of Docker and AWS.
Experience with Celery, Airflow, or scheduling tools.
Knowledge of asynchronous programming (AsyncIO/Aiohttp).
Preferred Candidate
Strong analytical and logical thinking.
Excellent problem-solving skills.
Good communication and teamwork.
Ability to work independently and deliver high-quality solutions.
Location: Chennai
Experience: 25 Years .
