Scraping data off of LinkedIn is against their User Agreement. This is purely intended for educational purposes.
Thanks to David Craven who I took inspiration from (link here)
This was a tool capable of scraping linkedin profiles in 2018/2019. As of today, this repository can only represent a starting point, but it will most likely not work as expected.
It is based on selenium and BeautifulSoup
Back in the days, you would first download the Chrome Driver from here and extract it to your favourite location.
Create a python3 virtual environment following this.
Within the virtual environment
pip install -r requirements.txt
Edit the conf.json
config file accordingly specifying the chrome bin path, e.g. by typying
which google-chrome
in a UNIX shell command line, the chrome driver path, the desired queries
and so forth.
Ultimately to scrape users, you would've run
python scrape_users.py --conf conf.json
or jobs
python scrape_jobs.py --conf conf.json