AI Chatbots as Tools for Designing Evaluations in Road Geometric Design According to Bloom’s Taxonomy

Abstract

In the realm of educational assessment, the integration of artificial intelligence (AI) offers a promising pathway for the development of robust evaluations. This study explores the application of AI chatbots in crafting and validating examinations tailored to road geometric design, while adhering to the principles of Bloom’s Taxonomy. Utilizing Gemini AI Studio, three distinct exam versions were generated, covering eight crucial topics within road geometric design. A panel of expert chatbots, including Chat GPT 3.5, Claude 3, Sonet, Copilot, Perplexity, and You, assessed the validity of the exam content. These chatbots achieved scores of 9.17 or higher, establishing their proficiency as experts. Subsequent evaluations focused on relevance and wording, revealing high scores for both metrics, indicating the adequacy of the assessment tools. The two remaining versions were administered to student groups enrolled in the Road Construction II course at the Universidad Técnica Particular de Loja. Only 1.2% of students reached Bloom’s Taxonomy level 3, with many questions deemed easy, leading to varying trends in cognitive levels. Comparative analysis of student scores revealed significant discrepancies between a previous “classic” exam. While AI shows potential in crafting valid assessments aligned with Bloom’s Taxonomy, greater human involvement is necessary to ensure high-quality instrument generation.

Ähnliche Arbeiten