Skip to content

denvermullets/teq-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Teq::Scraper

This is a basic scraper that works on JS framework sites

Installation

Execute:

$ bundle install

Usage

Teqscaper.rb gets an array of urls TQDB.rb runs through array of urls

ruby lib/teq/teqscraper.rb
ruby lib/teq/tqdb.rb

If you're getting nothing as a response then you might be getting an 'are you a robot' prompt. Open a incognito chrome and fill out the captcha.

Contributing

Bug reports and pull requests are welcome on GitHub at https://github.com/denvermullets/teq-scraper.

This was based on this great guide written by Sylwia Vargas

License

The gem is available as open source under the terms of the MIT License.

About

scrape the teq

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published