INVESTIGATING THE EFFECTS OF GENERATIVE-AI RESPONSES ON USER EXPERIENCE AFTER AI HALLUCINATION

Authors

  • Hayoen Kim Yonsei University, Seoul, South Korea

DOI:

https://doi.org/10.20319/icssh.2024.92101

Keywords:

Generative Artificial Intelligence, Hallucination, Politeness Strategy, Attribution Theory

Abstract

The integration of generative artificial intelligence (GenAI) systems into our daily lives has led to the phenomenon of "AI hallucination," where AI produces convincing yet incorrect information, undermining both user experience and system credibility. This study investigates the impact of AI's responses, specifically appreciation and apology, on user perception and trust following AI errors. Utilizing attribution theory, we explore whether users prefer AI systems that attribute errors internally or externally and how these attributions affect user satisfaction. A qualitative methodology, featuring interviews with individuals aged 20 to 30 who have experience with conversational AI, has been employed. Respondents preferred AI to apologize in hallucination situations and to attribute the responsibility for the error to the outside world. Results show that transparency in error communication is essential for maintaining user trust, with detailed explanations. The research contributes to the understanding of how politeness and attribution strategies can influence user engagement with AI and has significant implications for AI development, emphasizing the need for error communication strategies that balance transparency and user experience.

References

Athaluri, S. A., Manthena, S. V., Kesapragada, V. K. M., Yarlagadda, V., Dave, T., & Duddumpudi, R. T. S. (2023). Exploring the boundaries of reality: investigating the phenomenon of artificial intelligence hallucination in scientific writing through ChatGPT references. Cureus, 15(4).

Brown, P., & Levinson, S. C. (1987). Politeness: Some universals in language usage (Vol. 4). Cambridge university press.

De Vynck, G. (2023). Forget AI. For a moment Silicon Valley was obsessed with floating rocks. The Washington Post. Retrieved from https://www.washingtonpost.com/technology/2023/08/11/superconductors-hype-lk99-silicon-valley/

Hart, C. W., Heskett, J. L., & Sasser Jr, W. E. (1990). The profitable art of service recovery. Harvard business review, 68(4), 148-156.

Heider, F. (1958). The psychology of interpersonal relations. Wiley.

Lv, X., Liu, Y., Luo, J., Liu, Y., & Li, C. (2021). Does a cute artificial intelligence assistant soften the blow? The impact of cuteness on customer tolerance of assistant service failure. Annals of Tourism Research, 87, 103114.

Nißen, M., Selimi, D., Janssen, A., Cardona, D. R., Breitner, M. H., Kowatsch, T., & von Wangenheim, F. (2022). See you soon again, chatbot? A design taxonomy to characterize user-chatbot relationships with different time horizons. Computers in Human Behavior, 127, 107043.

Song, M., Zhang, H., Xing, X., & Duan, Y. (2023). Appreciation vs. apology: Research on the influence mechanism of chatbot service recovery based on politeness theory. Journal of Retailing and Consumer Services, 73, 103323.

Weiner, B. (1994). Integrating social and personal theories of achievement striving. Review of Educational research, 64(4), 557-573

Downloads

Published

2024-01-31

How to Cite

Kim, H. (2024). INVESTIGATING THE EFFECTS OF GENERATIVE-AI RESPONSES ON USER EXPERIENCE AFTER AI HALLUCINATION. PEOPLE: International Journal of Social Sciences, 92–101. https://doi.org/10.20319/icssh.2024.92101