Skip to content

Running a Selenium-based web scraper with a headless chrome browser on an AWS lambda function that gets triggered by a CloudWatch Event

Notifications You must be signed in to change notification settings

shashankpolanki/Selenium-AWS-Lambda

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 

Repository files navigation

Selenium-AWS-Lambda

In the project I run a selenium-based web scraper using serverless AWS lambda functions. The purpose of the project was to scrape company websites for internship opportunities once a day using a cloudwatch event as a trigger; however, the code here could also be used as a reference on how to deploy selenium as a serverless lambda function to do periodic jobs like data-scraping and automation work.

In order to deploy the code in a lambda environment, zip up the aws-lambda-scraper directory in a unix environment and deploy as a AWS lambda function.

About

Running a Selenium-based web scraper with a headless chrome browser on an AWS lambda function that gets triggered by a CloudWatch Event

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages