AFFECT-BASED, MULTIMODAL, VIDEO TUTORING SYSTEM FOR A NEUROMARKETING

Authors

  • Arturas Kaklauskas Vilnius Gediminas Technical University, Vilnius, Lithuania
  • Ieva Ubarte Ilnius Gediminas Technical University, Vilnius, Lithuania
  • Vytautas Bucinskas Ilnius Gediminas Technical University, Vilnius, Lithuania
  • Darius Skirmantas Ilnius Gediminas Technical University, Vilnius, Lithuania
  • Dainius Raupys Ilnius Gediminas Technical University, Vilnius, Lithuania

DOI:

https://doi.org/10.20319/mijst.2020.63.0124

Keywords:

Neuromarketing, Tutoring System, Affect-based, Multimodal, Affective Tutoring System, Arousal, Valence

Abstract

Considerable research has been conducted globally showing how study results are substantially conditional to the interest and productivity of a learner in the studies and the emotions and stress the learner experiences. Scholars emphasize that learning should be pleasing, enticing, and emotionally positive leading to increased effectiveness of the studying. Tests were conducted regarding the effectiveness of the MSc Property management studies process among students. Development of the ARTSY Model involved five iterative phases over the course of the research. ARTSY Model, intelligent and physiological technologies that had helped as the foundation for creating the Affect-based, Multimodal, Video Tutoring System for a Neuromarketing (ARTSY) were applied for this research. The research motivation and one of the main purposes are to increase students learning productivity, interest, emotions and decrease stress levels. According to this research motivation, ARTSY was developed. Upon comparison with the most advanced, existing affective tutoring systems, two innovative elements are distinguishing ARTSY. First, automatic means to develop and select the most effective variants from thousands of textual and video learning material alternatives by considering learner interest, productivity and stress levels. Secondly, exams or tests are unnecessary for assessing student knowledge levels by employing the newly developed Calculating a Student’s Self-assessment Grade. ARTSY’s future betterments are expected to achieve comprehensive and dependable, real-time information, not only about student needs but also about existing opportunities. A consequent outcome could be greater flexibility in the study process for students. This paper composed of Introduction (Section 1), Research background (Section 2), ARTSY Model description (Section 3) and the Construction of ARTSY (Section 4). The conclusions and notes for future study provide the ending to this article in Section 5.

References

Ainley, M., & Hidi, S. (2002). Dynamic measures for studying interest and learning. Advances in motivation and achievement: New directions in measures and methods, 12, 43-76.

Balanou, E., van Gils, M., & Vanhala, T. (2013, June). State-of-the-art of wearable EEG for personalized health applications. In Proceedings of the 10th International Conference on Wearable Micro and Nano Technologies for Personalized Health (Tallin: VTT Technical Research Centre of Finland) (pp. 119-123).

Boz, H., Arslan, A., & Koc, E. (2017). Neuromarketing aspect of tourısm pricing psychology. Tourism Management Perspectives, 23, 119-128. https://doi.org/10.1016/j.tmp.2017.06.002

Brown, L., van de Molengraft, J., Yazicioglu, R. F., Torfs, T., Penders, J., & Van Hoof, C. (2010). A low-power, wireless, 8-channel EEG monitoring headset. In 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology (pp. 4197-4200). IEEE. https://doi.org/10.1109/IEMBS.2010.5627393

Carlsson-Szlezak, P., Reeves, M., & Swartz, P. (2020). What Coronavirus Could Mean for the Global Economy. Retrieved from: https://hbr.org/2020/03/what-coronavirus-could-mean-for-the-global-economy [5 March 2020].

Damasio, A.R. (1994). Descartes’ Error: emotion, reason, and the human brain. Grosset/Putnam, New York.

dos Santos, R. D. O. J., de Oliveira, J. H. C., Rocha, J. B., & Giraldi, J. D. M. E. (2015). Eye-tracking in neuromarketing: a research agenda for marketing studies. International journal of psychological studies, 7(1), 32. https://doi.org/10.5539/ijps.v7n1p32

FaceReader™. (2015). Reference Manual, Version 6.1. Retrieved from: https://student.hva.nl/binaries/content/assets/serviceplein-a-z-lemmas/media-creatie-en-informatie/media--communicatie/observatorium/factsheet-facial-coding-reference-manual.pdf?2900513938585 [14 April 2016].

Gallego, J., Lemos, D., Meneses, G. A., & Hernandez, A. M. (2010, January). Development of a wearable vital signs monitors for healthcare. In 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology (pp. 6401-6404). IEEE. https://doi.org/10.1109/IEMBS.2010.5627311

Gilbert, I. (2013). Essential motivation in the classroom. Routledge. https://doi.org/10.4324/9780203079003

Goetz, T., Frenzel, A. C., Stoeger, H., & Hall, N. C. (2010). Antecedents of everyday positive emotions: An experience sampling analysis. Motivation and Emotion, 34(1), 49-62. https://doi.org/10.1007/s11031-009-9152-2

Golnar-Nik, P., Farashi, S., & Safari, M. S. (2019). The application of EEG power for the prediction and interpretation of consumer decision-making: A neuromarketing study. Physiology & behaviour, 207, 90-98. https://doi.org/10.1016/j.physbeh.2019.04.025

Gough, P. B. (2002). Interest matters. Phi Delta Kappan, 83(8), 566. https://doi.org/10.1177/003172170208300801

Gupta, R., & Falk, T. H. (2016). Relevance vector classifier decision fusion and EEG graph-theoretic features for automatic affective state characterization. Neurocomputing, 174, 875-884. https://doi.org/10.1016/j.neucom.2015.09.085

Harley, J. M., Bouchet, F., Hussain, M. S., Azevedo, R., & Calvo, R. (2015). A multi-componential analysis of emotions during complex learning with an intelligent multi-agent system. Computers in Human Behavior, 48, 615-625. https://doi.org/10.1016/j.chb.2015.02.013

Hazari, A. (2020). Schools closed over coronavirus use e-learning, video conferencing to continue lessons and counsel students. Retrieved from: https://flipboard.com/@SCMPNews/-schools-closed-over-coronavirus-use-e-l/a-OHY4QFJWSIiBA9U9vnE8Aw%3Aa%3A2290161508-df04111327%2Fscmp.com [5 March 2020].

Hernandez, Y., Arroyo-Figueroa, G., & Sucar, L. E. (2007). Intelligent tutoring system with affective behaviour. In 2007 Sixth Mexican International Conference on Artificial Intelligence, Special Session (MICAI) (pp. 352-362). IEEE. https://doi.org/10.1109/MICAI.2007.15

Hernandez, Y., Sucar, L. E., & Arroyo-Figueroa, G. (2008). Building an effective model for intelligent tutoring systems with a base on teachers’ expertise. In Mexican International Conference on Artificial Intelligence (pp. 754-764). Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88636-5_71

Hidi, S., & Harackiewicz, J. M. (2000). Motivating the academically unmotivated: A critical issue for the 21st century. Review of educational research, 70(2), 151-179. https://doi.org/10.3102/00346543070002151

Jalongo, M. R. (2007). Beyond benchmarks and scores: Reasserting the role of motivation and interest in children's academic achievement an ACEI position paper. Childhood Education, 83(6), 395-407. https://doi.org/10.1080/00094056.2007.10522958

Kaklauskas, A. (1999). Multi-criteria decision support of building life cycle: A research report presented for habilitation (DrSc), 118 pp. Technological sciences, civil engineering (02T). Technika, Vilnius Gediminas Technical University, Vilnius.

Kaklauskas, A. (2015). Biometric and intelligent decision-making support. Cham, Heidelberg: Springer. https://doi.org/10.1007/978-3-319-13659-2

Kaklauskas, A. (2016). Degree of Project Utility and Investment Value Assessments. International Journal of Computers, Communications & Control, 11(5). https://doi.org/10.15837/ijccc.2016.5.2679

Kaklauskas, A., Seniut, M., Amaratunga, D., Lill, I., Safonov, A., Vatin, N., Cerkauskas, J., Jackute,l I., Kuzminske, A., & Peciure, L. (2014). Text analytics for android project. Procedia Economics and Finance, 18, 610-617. https://doi.org/10.1016/S2212-5671(14)00982-4

Kaklauskas, A., Zavadskas, E. K., Banaitis, A., Meidute-Kavaliauskiene, I., Liberman, A., Dzitac, S., ... & Naumcik, A. (2018). A neuro-advertising property video recommendation system. Technological Forecasting and Social Change, 131, 78-93. https://doi.org/10.1016/j.techfore.2017.07.011

Kaklauskas, A., Zavadskas, E. K., Seniut, M., Vainiunas, P., Krutinis, M., & Tupenaite, L. (2010). Electronic information retrieval method and system. Patent EP 2187319 A1, issued 2010 08 25. Retrieved from: https://patents.google.com/patent/EP2187319A1/en,%202010 [2 September 2016].

Kensinger, E. A. (2004). Remembering emotional experiences: The contribution of valence and arousal. Reviews in the Neurosciences, 15(4), 241-252. https://doi.org/10.1515/REVNEURO.2004.15.4.241

Ko, E. S., Song, K. H., Cho, S. H., & Kim, J. H. (2017). A study on neuro sports marketing by using pupil's size of men: focusing on the basketball game. Science of Emotion and Sensibility, 20(1), 31-40. https://doi.org/10.14695/KJSOS.2017.20.1.31

Lang, P. J., Greenwald, M. K., Bradley, M. M., & Hamm, A. O. (1993). Looking at pictures: Affective, facial, visceral, and behavioural reactions. Psychophysiology, 30(3), 261-273. https://doi.org/10.1111/j.1469-8986.1993.tb03352.x

Latham, A., Crockett, K., & McLean, D. (2014). An adaptation algorithm for an intelligent natural language tutoring system. Computers & Education, 71, 97-110. https://doi.org/10.1016/j.compedu.2013.09.014

Latham, A., Crockett, K., McLean, D., & Edmonds, B. (2012). A conversational intelligent tutoring system to automatically predict learning styles. Computers & Education, 59(1), 95-109. https://doi.org/10.1016/j.compedu.2011.11.001

Lejk, M., & Wyvill, M. (2001). The effect of the inclusion of self-assessment with peer assessment of contributions to a group project: A quantitative study of the secret and agreed assessments. Assessment & Evaluation in Higher Education, 26(6), 551-561. https://doi.org/10.1080/02602930120093887

Mao, X., & Li, Z. (2010). Agent-based affective tutoring systems: A pilot study. Computers & Education, 55(1), 202-208. https://doi.org/10.1016/j.compedu.2010.01.005

Mibe. (2020). CORONAVIRUS: E-Learning activated from 2 March until 7 March. Retrieved from: https://mibe.unipv.it/coronavirus-e-learning-activated-from-2-march-until-7-march/ [5 March 2020].

Mileti, A., Guido, G., & Prete, M. I. (2016). Nano marketing: a new frontier for neuromarketing. Psychology & Marketing, 33(8), 664-674. https://doi.org/10.1002/mar.20907

Moridis, C. N., & Economides, A. A. (2008). Toward computer-aided effective learning systems: a literature review. Journal of Educational Computing Research, 39(4), 313-337. https://doi.org/10.2190/EC.39.4.a

Moridis, C. N., & Economides, A. A. (2009). Prediction of student’s mood during an online test using the formula-based and neural network-based method. Computers & Education, 53(3), 644-652. https://doi.org/10.1016/j.compedu.2009.04.002

Nelson, K. (2007). Young minds in social worlds. Harvard University Press. https://doi.org/10.4159/9780674041400

Papinczak, T., Young, L., Groves, M., & Haynes, M. (2007). An analysis of peer, self, and tutor assessment in problem-based learning tutorials. Medical teacher, 29(5), e122-e132. https://doi.org/10.1080/01421590701294323

Parker, C. (2020). In pictures: how the world is reacting to Coronavirus. Retrieved from: https://www.weforum.org/agenda/2020/03/in-pictures-how-the-world-is-reacting-to-coronavirus/ [5 March 2020].

Pullmann, H., & Allik, J. (2008). Relations of academic and general self-esteem to school achievement. Personality and Individual Differences, 45(6), 559-564. https://doi.org/10.1016/j.paid.2008.06.017

Qi-rong, C. (2010). Research on intelligent tutoring system based on an effective model. In 2010 Second International Conference on Multimedia and Information Technology (Vol. 1, pp. 7-9). IEEE. https://doi.org/10.1109/MMIT.2010.127

Rahmani, P. (2011). The relationship between self-esteem, achievement goals and academic achievement among the primary school students. Procedia-Social and Behavioral Sciences, 29, 803-808. https://doi.org/10.1016/j.sbspro.2011.11.308

Rushton, S., & Larkin, E. (2001). Shaping the learning environment: Connecting developmentally appropriate practices to brain research. Early Childhood Education Journal, 29(1), 25-33. https://doi.org/10.1023/A:1011304805899

Saadat, M., Ghasemzadeh, A., & Soleimani, M. (2012). Self-esteem in Iranian university students and its relationship with academic achievement. Procedia-social and behavioural sciences, 31, 10-14. https://doi.org/10.1016/j.sbspro.2011.12.007

Sarrafzadeh, A., Alexander, S. T., & Shanbehzadeh, J. (2009). Affective tutoring system for better learning. International Journal of Mobile and Blended Learning (IJMBL), 1(1), 61-77. https://doi.org/10.4018/jmbl.2009010105

Snow, C. E., Griffin, P. E., & Burns, M. (2005). Knowledge to support the teaching of reading: Preparing teachers for a changing world. Jossey-Bass.

Sparks, S. D. (2012). Studies link students' boredom to stress. Available [28 Jan. 2014] http://www.edweek.org/ew/articles/2012/10/10/07boredom_ep.h32.html.

Sung, Y. T., Chang, K. E., Chang, T. H., & Yu, W. C. (2010). How many heads are better than one? The reliability and validity of teenagers' self-and peer assessments. Journal of Adolescence, 33(1), 135-145. https://doi.org/10.1016/j.adolescence.2009.04.004

Ungureanu, F., Lupu, R. G., Cadar, A., & Prodan, A. (2017, October). Neuromarketing and visual attention study using eye-tracking techniques. In 2017 21st international conference on system theory, control and computing (ICSTCC) (pp. 553-557). IEEE. https://doi.org/10.1109/ICSTCC.2017.8107093

Wang, Y. (2020). China’s E-Learning Leaders Add $3.2 Billion As Coronavirus Fears Drive Students Online. Retrieved from: https://www.forbes.com/sites/ywang/2020/02/27/chinas-e-learning-leaders-add-32-billion-as-coronavirus-fears-drive-students-online/#3040c9154fb6 [5 March 2020].

Zurawicki, L. (2010). Neuromarketing -Exploring the brain of the consumer. Springer-Verlag, Berlin. https://doi.org/10.1007/978-3-540-77829-5

Downloads

Published

2020-11-12

How to Cite

Kaklauskas, A., Ubarte, I., Bucinskas, V., Skirmantas, D., & Raupys, D. (2020). AFFECT-BASED, MULTIMODAL, VIDEO TUTORING SYSTEM FOR A NEUROMARKETING . MATTER: International Journal of Science and Technology, 6(3), 01–24. https://doi.org/10.20319/mijst.2020.63.0124