Neuroscience and perception: multisensoriality and multimodality

• Grant number: 14/26334-5
• Support Opportunities: Scholarships abroad - Research
• Start date: May 01, 2015
• End date: September 30, 2015
• Field of knowledge: Linguistics, Literature and Arts - Arts
• Principal Investigator: Rosangela da Silva Leote
• Grantee: Rosangela da Silva Leote
• Host Investigator: Aderito Fernandes Marcos
• Host Institution: Instituto de Artes (IA). Universidade Estadual Paulista (UNESP). Campus de São Paulo. São Paulo , SP, Brazil
• Institution abroad: Universidade Aberta (UAb), Portugal

Abstract

This research is focusing to understand the perception in the poetics on multisensorialidade and multimodality. Based on neuroscience, we seek to understand in an objectively and testable way, the processes by which the perception is transformed by its relation to the environment. In addition, looking for how the multimodality of stimuli can result on multisensorialidade. We had been studying this issue on immersive and interactive art installations with public without special needs. During this, we conclude that the comparison of the modes of perception between people with disabilities and others, without these difficulties, might point to a better understanding of perception as a whole. Even to find new conceptual bases, to produce and to create art, especially those using biosensors and haptic interfaces. We perceive that the cognitive events, operates by very similar ways, but with its own characteristics. Therefore, looking for the similarities, we can find models of stimuli, departing from artworks, which can result in other artworks or different kinds of fruition. As the perception is well-known issue on Art theories, giving us the wrong interpretation that there is no more to say about that. Anyway, there is too much lacks, in these theories, on respect to the mental processes operating on the perception phenomena. We choose to find some possible answers to these lacks from neuroscience. In this paper, we are basing on the Vilayanur S. Ramachandran and António Damásio's concepts to focus the "perceptive processes" - as we are naming - considering the multisensoriality that occur in the relationship between the perceivers and the artworks that have multimodals stimuli.Keywords: art and neuroscience, interactor, multimodality, multisensoriality, procedural art (AU)