Skip to content

Python app that scans URLs of job boards and notifies the user via text message using Twilio API or email whenever there is a new listing containing a user defined keyword.

Notifications You must be signed in to change notification settings

aalap07/scrappy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 

Repository files navigation

scrappy

This is a Python script that allows a user to enter in URLs of job boards they want to watch as well as the keywords or job titles they are seeking by scraping the pages with BeautifulSoup. The script will run through all of the URLs and check if there are any matches for those keywords on that page.

Notification options

  • Text message using Twilio API
  • Email

If a match is found on a given URL, the app will send a notification immediately. It will then wait 24 hours before sending another one as an additional check/reminder. If there are no matches, the page will be checked again at 30 minute intervals.

Screenshots

ScrappyMobile ScrappyEmail

Inspiration

Making the job searching process easier! This can be utilized for any careers page that does not have a mailing list of its own to notify candidates of future opportunities and reduces the amount of manual checking required to keep up with new listings.

Use case

This application was designed to be run continuously but can also be run as a batch job. Running this on a VM/server will produce optimal results since matches may disappear by the time the batch job is run.

Note

All credentials must be provided by the user. This includes email address and email authentication key as well as Twilio API sid, auth token, and phone numbers.

About

Python app that scans URLs of job boards and notifies the user via text message using Twilio API or email whenever there is a new listing containing a user defined keyword.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages