SQLite Database structure

The latest version (WAN Show April 5, 2024) of the SQLite database file can be downloaded here.

All of these data were gathered using yt-dlp, and computed using python with the help of scikit-learn

Using yt-dlp auto generated English substitle files were downloaded.

Tables 📊

inverted_index: Stores the mapping between words and the documents they appear in.
word_time: Stores words and the time stamp they appear in.
time_dialogue: Links timestamps to specific dialogue snippets within videos.
all_dialogues: Stores all dialogue text extracted from the videos.
video_titles: Stores the titles of the videos.
term_positions: Indicates the specific positions of words within documents.
all_episodes_tfidf_count: Stores tfidf, count and magnitude for each term in a document.

Column	Data type	Example
index	INTEGER	3178
term	TEXT	tax
video_id	TEXT	z6alcVTRJMo,nVZTLLLkaXU,sEuVZcru_-A,3NjtRPnPsSc,td6zO4r2ogI,aBhIJQH-x7I,4QIMSsrJ8Vk,ILBz-SBVg08,w5boVxmH_Yc,c6pYG0olgEI, ...

Column	Data type	Example
index	INTEGER	72674
video_id	TEXT	b6LnXwytBuA
time	TEXT	1396s
dialogue	TEXT	turn your nfts into a tax write-off that

Column	Data type	Example
index	INTEGER	95
video_id	TEXT	z6alcVTRJMo
words	TEXT	what is up everyone and welcome to the wan show we have a great topic lined up for you guys today luke and i both got some ...

Column	Data type	Example
index	INTEGER	326
title	TEXT	4K YouTube Is Getting PAYWALLED - WAN Show October 7 2022
video_id	TEXT	ltyntSIVsjA