Skip to content

Web scraping GC public service rates of pay in Go

License

Notifications You must be signed in to change notification settings

ToferC/payscraper

Repository files navigation

PayScraper - Web Scraper for Government of Canada rates of pay

This go project is a Web scraper designed to feed into an API.

The Web scraper that crawls the TBS Rates of pay for public service employees page, pulls down pay-date and transforms it into a machine readable format. It can currently parse 40 collective agreements and extract pay-related data.

You can find the scraped data in the /rates_of_pay_groups folder.

This data is then used to power the gc-payscales API, available here: https://gc-payscales.herokuapp.com/playground

Sample

Rates of Pay sample scrape

Initial testing and improvements to the scraper are still ongoing.

About

Web scraping GC public service rates of pay in Go

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages