Designing for Discernment: A Mixed-Methods Case Study of GenAI-Supported Critical Thinking

Abstract

Against the backdrop of the rapid proliferation of generative AI tools, which bring both new opportunities and challenges to higher education, particularly in cultivating critical thinking within STEM fields, this paper probes into how integrating a Generative AI (GenAI) tool into an undergraduate engineering course impacts students’ critical thinking and teamwork, and examines strategies for instructors to facilitate ethical, effective use of AI in learning. In a one-semester case study involving 69 students, a novel “GenAI - CT” instructional model was deployed, integrating GenAI - driven activities with critical thinking exercises. Employing a mixed - methods approach, quantitative tests gauged improvements in critical thinking skills, while qualitative analyses of student reflections and group interaction logs elucidated their experiences of engaging with GenAI. The integration of GenAI was generally feasible and beneficial. Students showed improvement in certain critical thinking tasks (such as problem analysis and idea synthesis), and reported that GenAI support enriched group collaboration by offering timely feedback and diverse perspectives. However, significant challenges were observed – many students struggled with tasks requiring complex logical structuring even with AI assistance, and there was a tendency for some to over-rely on AI-generated answers without sufficient critical evaluation. This study introduces a GenAI - CT framework, which delineates the ethical and pedagogical integration of AI tools into STEM education. Our findings furnish empirical evidence that GenAI can augment learning when utilized responsibly, and offer practical insights for educators striving to balance innovative AI assistance with the pivotal goal of fortifying students’ independent critical thinking skills

Keywords: Critical Thinking, Generative Artificial Intelligence, STEM Education, Higher Education, Pedagogical Strategies

How to Cite: