DIGITAL MULTISENSORY STORYTELLING AS EDUCATIONAL-DIDACTIC METHODOLOGY

Claudia Chierichetti, Elisabetta Tombolini

Abstract


The learning process can benefit from the support of digital and multisensory components. This research investigates the effect produced by two different narration methodologies on a sample of 40 5-year-old children. The control group participated in storytelling, while the experimental group took part in digital multisensory storytelling. The results have shown that the second methodology is linked to a higher ability to recall the story orally and to the implication of greater emotions in children in retelling phase.


Full Text:

PDF (Italiano)

References


Beauchamp, M., Lee, K., Argall, B. & Martin, A., (2004), Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus, Neuron, vol. 41, n. 5, pp. 809-823, https://doi.org/10.1016/S0896-6273(04)00070-4.

Bottaccioli, A.G., Mariani, U., Schiralli, R., Mari, M.G., Pontani, M., Bologna, M., Muzi, P., Giannoni, S.D., Ciummo, V., Necozione, S., Cofini, V., Chiariotti, L., Cuomo, M., Costabile, D. & Bottaccioli, F., (2023), Empathy at school project: Effects of didactics of emotions on emotional competence, cortisol secretion and inflammatory profile in primary school children. A controlled longitudinal psychobiological study, Comprehensive Psychoneuroendocrinology, vol. 14, p. 100183, https://doi.org/10.1016/j.cpnec.2023.100183.

Brink, T. T., Urton, K., Held, D., Kirilina, E., Hofmann, M., Klann-Delius, G., Arthur M. J., & Kuchin, L. (2011), The role of orbitofrontal cortex in processing empathy stories in 4-to 8-year-old children, Front. Psychol, 2(80), https://doi.org/10.3389/fpsyg.2011.00080.

Carmona-Halty, M., Salanova, M., Llorens, S. & Schaufeli, W., ( 2021), Linking positive emotions and academic performance: The mediated role of academic psychological capital and academic engagement, Current Psychology, vol. 40, pp. 2938-2947, https://doi.org/10.1007/s12144-019-00227-8.

Catalano, H. & Catalano, C. (2022), Using digital storytelling in early childhood

education to promote child centredness, ERD 2021

th International Conference Education, Reflection, Development, doi:10.15405/epes.22032.16.

Damasio, A., (2021), Feeling, Knowing Making Minds Conscious, Pantheon Books, New York.

Di Fuccio, R., Ponticorvo, M., Ferrara, F., Miglino, O., (2016), Digital and Multisensory Storytelling: Narration with Smell, Taste and Touch, Lecture Notes in Computer Science, v. 9891, 509-512, https://dx.doi.org/10.1007/978-3-319-45153-4_51.

Domínguez-Borràs, J., Guex, R., Méndez-Bértolo, C., Guillaume Legendre, G., Spinelli, L., Stephan, M., Frühholz, S., Mégevand, P., Arnal, L., Strange, B., Seeck, M. & Vuilleumier, P., (2019), Human amygdala response to unisensory and multisensory emotion input: No evidence for superadditivity from intracranial recordings, Neuropsychologia, vol. 131, pp. 9-24, https://doi.org/10.1016/j.neuropsychologia.2019.05.027.

Domínguez-Borràs, J., Moyne, M., Saj, A., Guex, R. & Vuilleumier, P., (2020), Impaired emotional biases in visual attention after bilateral amygdala lesion, Neuropsychologia, vol. 137, n. 3, p. 107292, https://doi.org/10.1016/j.neuropsychologia.2019.107292 .

Domínguez-Borràs, J. & Vuilleumier P., (2022), Amygdala function in emotion, cognition, and behavior, Handbook of Clinical Neurology, vol. 187, pp. 359-380, https://doi.org/10.1016/B978-0-12-823493-8.00015-8 .

Dong, H., Lil, N., Fan, L., Wei, J. & Xu, J., (2022), Integrative interaction of emotional speech in audio-visual modality, Frontiers in Neurosceince, vol.16, https://doi.org/10.3389/fnins.2022.797277.

Donnelly, J., Hillman, C., Catelli, D., Etnier, J., Lee, S., Tomporowski, P., Lambourne, K. & Szabo-Reed, A., (2016), Physical Activity, Fitness, Cognitive Function, and Academic Achievement in Children A Systematic Review, Medicine & Science in Sports & Exercise, vol. 48, n. 6, pp. 1197-1222, doi:10.1249/MSS.0000000000000901.

Fuhrman, O., Eckerling, A., Friedmann, N., Tarrasch, R. & Raz, G., (2020), The moving learner: Object manipulation in virtual reality improves vocabulary learning, Journal of Computer Assisted Learning, vol. 37, n. 3, pp. 672-683, https://doi.org/10.1111/jcal.12515.

Gao, C., Weber, C. & Shinkareva, S., (2019), The brain basis of audiovisual affective processing: Evidence from a coordinate-based activation likelihood estimation meta-analysis, Cortex, vol. 120, pp. 66-77, https://doi.org/10.1016/j.cortex.2019.05.016.

Gardner, H., (2018), Formae mentis: saggio sulla pluralità dell’intelligenza, Feltrinelli, Milano.

Gu, X., Liu, X., Van Dam, N., Hof, P. & Fan, J., (2012), Cognition–Emotion Integration in the Anterior Insular Cortex, Cerebral Cortex, vol. 23, n. 1, pp. 20-27, https://doi.org/10.1093/cercor/bhr367.

Henriksen A., Katarzyna Topor M., Hansen R., Damsgaard L., Veber Nielsen A., Wulff-Abramsson A., Wienecke J., (2023), Virtual reality and embodied learning for improving letter-sound knowledge and attentional control in preschool children: A study protocol, Computers & Educational: X Reality, vol. 2, p. 100019.

Hernández del Barco, M., Cañada, F., Cordovilla Moreno, A. & Airado-Rodríguez, D., (2022), An approach to epistemic emotions in physics’ teaching-learning. The case of pre-service teachers, Heliyon, vol. 8, n. 11, p. 11444, https://doi.org/10.1016/j.heliyon.2022.e11444.

Hsu, C. T., Jacobs, A. M., Citron, F. M., & Conrad, M. (2015), The emotion potential of words and passages in reading Harry Potter–An fMRI study. Brain Lang, 142, 96–114, https://doi.org/10.1016/j.bandl.2015.01.011.

Henriksen, A., Katarzyna Topor, M., Ahmt Hansen, R., Damsgaard, L., Veber Nielsen, A., Wulff-Abramsson, A. & Wienecke, J., (2023), Virtual reality and embodied learning for improving letter-sound knowledge and attentional control in preschool children: A study protocol, Computers & Educationa: X Reality, vol. 2, pp. 100019, https://doi.org/10.1016/j.cexr.2023.100019.

Indriani, S., Suteja, H., (2023), Fostering reading interest through digital storytelling for young learners in the early childhood, Journal of Education and Learning (EduLearn) 17(2):301-306, doi: 10.11591/edulearn.v17i2.18372.

Isbell, R., Sobol, J., Lindauer, L., and Lowrance, A. (2004), The effects of storytelling and story reading on the oral language complexity and story comprehension of young children. Early Child. Educ. J. 32, 157–163, doi:10.1023/B:ECEJ.0000048967.94189.a3.

Jean Ayres, A., Muratori, F. & Campatelli, G., (2012), Il bambino e l’integrazione sensoriale. Le sfide nascoste della sensorialità, Giovanni Fioriti Editore, Roma, p. 93.

Lehne, M., Engel, P., Rohrmeier, M., Menninghaus, W., Jacobs, A. M., & Koelsch, S. (2015), Reading a suspenseful literary text activates brain areasrelated to social cognition and predictive inference, PLoS One, 10(5), https://doi.org/10.1371/journal.pone.0124550.

Li, J. & Deng, W. S., (2022), Facilitation and interference effects of the multisensory context on learning: a systematic review and meta-analysis, Psychol Res., doi: 10.1007/s00426-022-01733-4.

Li, S., Tang, Y. & Zheng, Y., (2023), How the home learning environment contributes to children’s social–emotional competence: A moderated mediation mode, Frontiers Psychology, vol. 14, https://doi.org/10.3389/fpsyg.2023.1065978.

Mahoney, J. L., Weissberg, R., Greenberg, M., Dusenbury, L., Jagers, R. J., Niemi, K., Schlinger, M., Schlund, J., Shriver, T., Van Ausdal, K. & Yoder, N., (2020), Systemic Social and Emotional Learning: Promoting Educational Success for All Preschool to High School Students, American Psyghologist, vol. 76, n. 7, pp. 1128-1142, https://doi.org/10.1037/amp000070.

Matos, A., Rocha, T., Cabral, L. & Bessa, M., (2015), Multi-sensory storytelling to support learning for people with intellectual disability: an exploratory didactic study, Procedia Computer Science, pp. 12-18, doi:10.1016/j.procs.2015.09.244.

Merjovaara, O., Nousiainen, T., Turja, L., & Isotalo, S. (2020), Digital Stories with Children: Examining Digital Storytelling as a Pedagogical Process in ECEC. Journal of Early Childhood Education Research, 9(1), 99-123. https://journal.fi/jecer/article/view/114125.

Monacis, D. & Colella, D., (2019), The contribution of technologies for learning and development of motor skills in early age, Italian Journal of Educational Research, vol. 12, n.22.

Montes-Lourid, P., Vincente, A., Gonzalez, B. & Gonzalez, F., (2015), Neural activity in monkey amygdala during performance of a multisensory operant task, Journal of Integrative Neuroscience, vol. 14, n. 3, pp. 309-323, https://doi.org/10.1142/S021963521550020X.

O’Byrne, W. I., Stone, R., & White, M. (2018), Digital Storytelling in Early Childhood: Student Illustrations Shaping Social Interactions. Frontiers in psychology, 9, 1800, http://doi.org/10.3389/fpsyg.2018.01800.

Poncelet, J., Rinck, F., Bourgeat, F., Schaal, B., Rouby, C., Bensafi, M. & Hummel, T., (2010), The effect of early experience on odor perception in humans: Psychological and physiological correlates, Behavioural Brain Research, vol. 208, n. 2, pp. 458-465, https://doi.org/10.1016/j.bbr.2009.12.011.

Rahiem, M.D.H. (2021), Storytelling in early childhood education: Time to go digital. International Journal of Child Care and Education Policy, 15, 4 https://doi.org/10.1186/s40723-021-00081-x.

Rambli Awang, D., Matcha, W. & Sulaiman, S., (2013), Fun Learning with AR Alphabet Book for Preschool Children, Procedia Computer Science, vol. 25, pp. 211-219, https://doi.org/10.1016/j.procs.2013.11.026.

Romero-Ayuso, D., Toledano-González, A., Rodríguez-Martínez, M., Arroyo-Castillo, P., Matías Triviño-Juárez, J., González, P., Ariza-Vega, P., Del Pino, G. & Segura-Fragoso, A., (2021), Effectiveness of Virtual Reality-Based Interventions for Children and Adolescents with ADHD: A Systematic Review and Meta-Analysis, New Research in Children with Neurodevelopmental Disorders, vol. 8, n.2, https://doi.org/10.3390/children8020070.

Royet, J., Plailly, J., Delon-Martin, C., Kareken, D. & Segebarth C., (2003), fMRI of emotional responses to odors: influence of hedonic valence and judgment, handedness, and gender, Neurolmage, vol. 20, n. 2, pp. 713-728, https://doi.org/10.1016/S1053-8119(03)00388-4.

Sarko, D., Nidiffer, A., Powers, A. R., Ghose, D., Hillock-Dunn, A., Fister, M., Krueger, J., & Wallace, M. T., (2012), Le basi neurali del processi multisensoriali, CRC Press/Taylor & Francis, Boca Raton (FL).

Shemy, N. S. (2021), The impact of digital storytelling on motivation and achievement in teaching scientific concepts for pre-school students. European Journal of Education Studies, v. 7, n. 12, http://dx.doi.org/10.46827/ejes.v7i12.3627.

Shin, D., (2017), The role of affordance in the experience of virtual reality learning: Technological and affective affordances in virtual reality, Telematics and Informatics, vol. 34, n. 8, pp. 1826-1836, https://doi.org/10.1016/j.tele.2017.05.013.

Skulmowski, A. & Rey G., (2018), Embodied learning: introducing a taxonomy based on bodily engagement and task integration, Cognitive Research: Principles and Implications, vol. 3, n. 6, https://doi.org/10.1186/s41235-018-0092-9.

Stagnetto, J.M., Rouby, C. & Bensafi M., (2006), Contextual cues during olfactory learning improve memory for smells in children, European Review of Applied Psychology, vol. 56, n. 4, pp. 253-259, https://doi.org/10.1016/j.erap.2005.09.012.

Tisza, G. & Markopoulos, P., (2021), FunQ: Measuring the fun experience of a learning activity with adolescents, Current Psychology, vol. 42, pp. 1936-1956, https://doi.org/10.1007/s12144-021-01484-2.

Zhao, J. & Guo, J., (2023), The temporal mechanism of contextual emotions’ effects on novel abstract and concrete word learning, Neuroscience Letters, vol. 805, p. 137227, https://doi.org/10.1016/j.neulet.2023.137227.




DOI: https://doi.org/10.32043/gsd.v7i2.890

Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Giornale Italiano di Educazione alla Salute, Sport e Didattica Inclusiva

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Italian Journal of Health Education, Sports and Inclusive Didactics 
ISSN printed: 2532-3296