Skip to content

A scraper which takes the information in the RAND incident database and outputs it into a csv

Notifications You must be signed in to change notification settings

JohnYangSam/rand_incident_database_scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 

Repository files navigation

This is a simple ruby scraper which scrape's RAND's incident database at http://smapp.rand.org/rwtid/search_form.php and outputs the information of all the incidents into a csv file.

There are two versions:

  1. randScraper.rb uses a single large query but may be susceptiable to idle timeout errors.
  2. randScraper2.rb uses 5 year queries to fix the issue in the original, but may run a little slower

About

A scraper which takes the information in the RAND incident database and outputs it into a csv

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages