ANALYZING STUDENTS’ ENGLISH-SPEAKING SKILLS USING SPEECHACE: INSIGHTS FROM AN AI-POWERED ASSESSMENT TOOL

Fitria Ningsih

doi:10.70574/9w2prx09

Authors

Fitria Ningsih UIN Sayyid Ali Rahmatullah Tulungagung Author

DOI:

https://doi.org/10.70574/9w2prx09

Keywords:

Speechace, AI Assessment Tool, English Speaking Skills, Pronunciation, Fluency

Abstract

AI technology has increasingly integrated into language learning and assessment, offering efficient and engaging environment. This study evaluated the effectiveness of Speechace, an AI powered language assessment tool, in improving speaking skills among first semester students through a mixed-method approach. The findings revealed an average overall performance score of 5.69 out of 9, with female students consistently outperforming males students in pronunciation, fluency, vocabulary, grammar and overall speaking competence. The question-specific analysis showed that students performed better on personal topics, exhibiting higher fluency and fewer pauses. Speechace provided valuable feedback, particularly in evaluating fluency-including the report of word per minute and bad pauses-as well as pronunciation accuracy via color-coded feedback. These findings highlight the potential use of AI tools in language education and offer insight for educators on integrating technology into English language instruction, more specifically in speaking skills.

References

Alnafisah, M. (2022). Technology Review: Speechace. Pronunciation in Second Language Learning and Teaching Proceedings, 12(1).

Amin, M. Y. M. (2023). AI and Chat GPT in Language Teaching: Enhancing EFL Classroom Support and Transforming Assessment Techniques. International Journal of Higher Education Pedagogies, 4(4), 1–15. https://doi.org/10.33422/ijhep.v4i4.554

Aprianto, D., Syahid, A., & Abdussamad, Z. (2024). Examining the Correlation among Motivation, Self-efficacy, and English Language Proficiency (ELP) across Gender. Journal of Language and Literature Studies, 4(2), 277–295.

Arjulayana, A., & Márquez Martínez, M. (2022). STUDENT’S PRONUNCIATION ERROR IN SPEAKING PERFORMANCE. Globish: An English-Indonesian Journal for English, Education, and Culture, 11(2), 101. https://doi.org/10.31000/globish.v11i2.6451

Cendra, A. N., & Sulindra, E. (2022). SPEAKING ACCURACY, FLUENCY, AND BEYOND: INDONESIAN VOCATIONAL STUDENTS’ VOICES. LLT Journal: A Journal on Language and Language Teaching, 25(2), 379–394. https://doi.org/10.24071/llt.v25i2.4579

Cohen, S., Mompelat, L., Mann, A., & Connors, L. (2024). The Linguistic Leap: Understanding, Evaluating, and Integrating AI in Language Education. Journal of Language Teaching, 4(2), 23–31. https://doi.org/10.54475/jlt.2024.012

Iftanti, E., Awalin, A. S., & Izza, F. N. (2023). The use of artificial Intelligence as the potential supporting learning tools for doing learning projects. International Conference on Education, 455–467.

Kic-Drgas, J., & Kılıçkaya, F. (2024). Using Artificial Intelligence (AI) to create language exam questions: A case study. XLinguae, 17(1), 20–33. https://doi.org/10.18355/XL.2024.17.01.02

Latifatul Isro’iyah, Dwi Ima Herminingsih, Ervian Dinta H, & Fathan Rifqi Amanatillah. (2024). Students’ Needs Survey On Speaking Class Of UIN Satu Tulungagung. International Journal of Education, Vocational and Social Science, 3(02), 110–123. https://doi.org/10.99075/ijevss.v3i02.837

Mahgoub Kamel Mohammad, & Nik Aloesnita Alwi. (2023). The effect of task complexity and gender differences on EFL learners’ writing performance. World Journal of Advanced Research and Reviews, 20(1), 840–858. https://doi.org/10.30574/wjarr.2023.20.1.2131

Moxon, S. (2021). Exploring the Effects of Automated Pronunciation Evaluation on L2 Students in Thailand. IAFOR Journal of Education, 9(3), 41–56.

Mutiara, A., Wakhda, S. C., Alfidariyani, I. M., & Indriani, L. (2024). The Effectiveness of Speech-Ace Website on Students’ Pronunciation. English Education:Journal of English Teaching and Research, 9(1), 92–104. https://doi.org/10.29407/jetar.v9i1.22372

Ningsih, F. (2023). Classtime. com As An AI-based Testing Platform: Analysing Esp Students’ Performances and Feedback. Journal of Languages and Language Teaching, 11(3), 390–404.

Puspitasari, E., & Dewi, M. F. E. (2023). Capturing the teaching of English oral skills in an Indonesian university: classroom activities and pedagogical challenges. Journal on English as a Foreign Language, 13(2), 681–705. https://doi.org/10.23971/jefl.v13i2.6466

Rifiyanti, H., & Dewi, D. U. (2023). English as a Medium of Instruction (EMI) in Learning Practice: Perspectives and Strategies of Educators. Tamaddun, 22(2), 183–192. https://doi.org/10.33096/tamaddun.v22i2.551

Umar, U. (2024). Advancements in English Language Teaching: Harnessing the Power of Artificial Intelligence. FLIP Foreign Language Instruction Probe, 3(1), 29–42. https://doi.org/10.54213/flip.v3i1.402

Zainuddin, N. M., & Mohamad, M. (2024). Utilising Speechace to Enhance Speaking Skills among English as a Second Language Pre-University Students. International Journal of Academic Research in Progressive Education and Development, 13(2)