Puppy scraper is a script that runs from time to time, to scape/crawl animal shelter web pages. It collects all data of new Dogs and sends them to a telegram Bot. This bot is in a group and posts the Dogs with their names, their shelter and a picture of the dog (if available).
Currently only some shelters are supported. They are scraped with scala-scraper and the list
could be extended easily. Supported shelters are:
- Iserlohn (http://www.tierheim-iserlohn.de/)
- Olpe (https://www.tierheim-olpe.de)
For now the script only runs locally and not on a server.
To run it locally an application.conf file needs to be created
with the credentials of the Bot. The relevant config params can be found
under Model.ServiceConf.
Use the command sbt "~reStart" from sbt-revolver to get fast reloads while developing
The service can also run via Docker. To build the image use sbt docker:publishLocal and then run it with
docker run puppy-scraper:0.0.1