︎

This thesis research focuses on creating audio-visual web interaction inspired by the synesthetic experience. It explores the role of metaphor as a conversational tool and approach in the multimodal digital space. This project’s outcome is a web application Can You Hear Your Drawing? that enables an empathic dialogue between people who experience audio-visual synesthesia and those who are eager to learn about it. This app aims to allow synesthetes to explain their audiovisual perceptions to a non-synesthete user and expand the non-synesthetes’ understanding of audio-visual compositions. With this tool, users can map their audio and visual senses’ associations by documenting and sharing them in the digital environment. Each user has a chance to create their library of audiovisual pieces and share their perceptions with others.
Can You Hear Your Drawing?
         web app, 2021

︎canyouhearyourdrawing.app
Web Design & Development, User Research, User Experience, Creative Coding, Mutimodality

Web Development in ReactJS: Sergey Prokopyev
Sound Design: Jack Wictor




       ︎PLEASE SEE THE WEBSITE AND PLAY WITH THE APP ︎CANYOUHEARYOURDRAWING.APP       ︎PLEASE SEE THE WEBSITE AND PLAY WITH THE APP ︎CANYOUHEARYOURDRAWING.APP