Generative AI Generating Buzz: Volume, Engagement, and Content of Initial Reactions to ChatGPT in Discussions Across Education-Related Subreddits

Abstract

The emergence of generative artificial intelligence (GenAI) has ignited debates regarding its potential benefits and detriments for education. Despite widespread discussions, insights into GenAI’s impact on education have been limited because early studies have often been narrow in scope and focused on specific contexts. Therefore, the purpose of this study is to explore and analyze the volume, engagement, and content of initial reactions to one leading GenAI tool, ChatGPT. Specifically, we collected and analyzed public online discussions of ChatGPT in the first four months following the tool’s release. We collected 345 posts and 6,463 comments about ChatGPT from 25 education-focused subreddits. We analyzed the volume, engagement, and content of ChatGPT discussions through descriptive statistics and natural language processing techniques. Findings show relatively low volume of ChatGPT discussions, unevenly spread across education-related subreddits—with the majority of the discussions occurring in two subreddits, while six subreddits did not have any discussions. Despite this, the level of engagement within ChatGPT posts was substantial; for instance, a ChatGPT post hosted a median of 15 comments, and these comments were lengthy, indicating rich engagement rather than superficial. The content of ChatGPT discussions across the six largest education-related subreddits differed in the degree of analytical thinking and emotional tone even while sharing a predominant focus on students and AI. Diverse reactions to and perspectives on GenAI—observed from varied levels of volume, engagement, and content of ChatGPT across educational-related subreddits—highlights how diverse educational stakeholders reacted to GenAI differently, offering insights into how to explore, analyze, and comprehend the spread and adoption of technological innovation in education.

Keywords

ChatGPT, GenAI, Reddit, affinity spaces, technology reaction, learning analytics

Citation

Staudt Willet, K. B., & Na, H. (2024). Generative AI generating buzz: Volume, engagement, and content of initial reactions to ChatGPT in discussions across education-related subreddits. Online Learning. https://olj.onlinelearningconsortium.org/

R Scripts

1. Collecting posts containing the keyword text "chatgpt" from 25 different education-related subreddits
2. Consolidating all posts into one file
3. Collecting comments related to those posts
4. Analyzing these collected posts and comments

Note

If you would like access to the previously collected data used to produce the results in the output folder, please email Dr. Bret: bret.staudtwillet@fsu.edu. This dataset included 345 posts and 6,463 comments pertaining to ChatGPT in 19 education-related subreddits (i.e., six subreddits had no discussions of ChatGPT in the first four months), spanning December 6, 2022 to March 31, 2023.