Skip to content

Serverless webscapping

Latest
Compare
Choose a tag to compare
@vieer-dwivedi vieer-dwivedi released this 24 Nov 10:46
· 2 commits to main since this release
d9d28fb

🚀 AWS Lambda Web Scraping with Selenium & Headless Chrome 🎉
📝 Overview:
This release creates an AWS Lambda function that runs headless Chrome for web scraping and automation using Selenium and Python in a serverless environment. After scraping, the function takes a screenshot and uploads it to an S3 bucket.

⚡ Key Features:
🖥️ Headless Chrome for seamless browser automation.
🐍 Python & Selenium for web scraping and task automation.
💾 S3 Integration: Uploads screenshots to an S3 bucket, specified via environment variable.
⚡ Serverless: Fully scalable and cost-effective with AWS Lambda.
💻 How It Works:
Lambda runs headless Chrome using Selenium.
After scraping, it captures a screenshot.
Uploads the screenshot to S3 (bucket name from environment variable).