Skip to content

Script for scraping the mastery survey threads on /r/FFRecordKeeper

License

Notifications You must be signed in to change notification settings

multibottlerocket/FFRK-Mastery-Scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
 
 
 
 
 
 
 
 

Repository files navigation

FFRK-Mastery-Scraper

Script for scraping the mastery survey threads on /r/FFRecordKeeper

To run this yourself, you'll need Python 3 plus a few dependencies, all of which you can get with "pip install blah":

PRAW - the Python Reddit API

strsimpy - string similarity library for catching typos/abbreviations

numpy - for doing the stats for string similarity metrics

You'll also need to add your own client ID and secret inside the script to use the Reddit API. Visual directions are here - it only takes like two minutes if you already have a Reddit account:

https://www.geeksforgeeks.org/how-to-get-client_id-and-client_secret-for-python-reddit-api-registration/

You then put your client ID and secret into the "redditClientInfo.txt" file that stays on your local computer.

If you run into any issues or have questions or suggestions, PM me on reddit at /u/mutlibottlerocket.

About

Script for scraping the mastery survey threads on /r/FFRecordKeeper

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages