Skip to content

Generate a visual map of youtube by using channel relations.

Notifications You must be signed in to change notification settings

nvalis/MappingYoutube

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 

Repository files navigation

MappingYoutube

This python script generates a graph of Youtube by scraping the related channels from the "about" page using requests and lxml because unfortunately this data is not provided by the Youtube API. The gathered data is streamed to Gephi for visualization using the gephistreamer library.

The scraping is coordinated by a size limited, thread-safe python set as the queue to keep track of the channels to explore. It makes use of multithreading and a simple history to accelerate the exploration.

Screenshot

Example map created in about 14 min of scraping consisting of about 10000 channels. With the ForceAtlas 2 layout in LinLog mode one can observe different youtube communities mostly grouped around one or more central hubs (node color shows its in-degree, red is higher).

Requirements

For data streaming to Gephi you need the Graph Streaming plugin available in Gephis plugin manager. When installed you will need to rightclick -> start the streaming master server.

About

Generate a visual map of youtube by using channel relations.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages