OCR: Soundscape Design through Text
Abstract
This work explores the relationship between text and sound through the sonification of letters and words using technologies such as Optical Character Recognition (OCR) and MIDI notation. By designing experimental instruments, texts were transformed into sound compositions, creating a soundscape that challenges traditional linguistic conventions. The work was presented in two different instances, demonstrating its versatility for applying the process to various texts. Inspired by Avraamov’s demands for creating instruments with social significance, the piece generates a real-time sensory experience where writing and sound coexist. Additionally, the notions of performance and performativity are explored, allowing the analysis of both the technical process and the unique nature of each presentation. This research-creation project contributes to new ways of experiencing written language, resignifying its content and expanding the possibilities of sound art through technology.
KEYWORDS: Sonification, Text, LiveCoding, OCR, Performance.
Downloads
References
Bal, M. (2016). Lexicón para el Análisis Cultural (1st ed.). Akal.
Cage, J. (2005). El futuro de la música. Silencio. Árdora.
Casati, R., y Dokic, J. (1994). La philosophie du son.
Celedón Bórquez, G. (2023). Filosofía y experimentación sonora (1st ed.). Ediciones Metales Pesados.
Fink, T., y Akdag Salah, A. A. (2023). Extending the Visual Arts Experience: Sonifying Paintings with AI (pp. 100–116). https://doi.org/10.1007/978-3-031-29956-8_7
González-Castañeda, E. F., Torres-García, A. A., Reyes-García, C. A., y Villaseñor-Pineda, L. (2017). Sonification and textification: Proposing methods for classifying unspoken words from EEG signals. Biomedical Signal Processing and Control, 37, 82–91. https://doi.org/10.1016/j.bspc.2016.10.012
Hyde, J. (2020). The new analogue. Media archaeology as creative practice in 21st-century audiovisual art. In A. Knight-Hill (Ed.), Sound and Image: Aesthetics and Practices (1st ed., pp. 188–205). Routledge.
Kane, J. (2012). Manual de Tipografía (2nd ed.). Gustavo Gili.
Lupton, E. (2015) Tipografía en Pantalla: Una Guía Para Diseñadores, Editores, Tipógrafos, Blogueros y Estudiantes. (1st ed). Gustavo Gili.
Mata, V. (2018) Plague, Copie, Manipule, Robe, Reescriba este Libro. (2023). Kikuyo Editorial.
Schafer, R. M. (2013). El paisaje sonoro y la afinación del mundo (V. G. Cazorla, Trans.; 1st ed.). Intermedio.
Sloterdijk, P. (2020). El Imperativo Estético. Akal.
Tay, N. W., Liu, F., Wang, C., Zhang, H., Zhang, P., & Chen, Y. Z. (2021). Protein music of enhanced musicality by music style guided exploration of diverse amino acid properties. Heliyon, 7(9), e07933. https://doi.org/10.1016/j.heliyon.2021.e07933
Temple, M. D. (2020). Real-time audio and visual display of the Coronavirus genome. BMC Bioinformatics, 21(1), 431. https://doi.org/10.1186/s12859-020-03760-7
Temple, M. D. (2024, June 24). DNA SONIFICATION USING 8-CHANNEL AUDIO FOR DATA ANALYSES AND MUSIC COMPOSITION. The 29th International Conference on Auditory Display (ICAD 2024).
Zielinski, S. (2019). Variations on Media Thinking. University of Minnesota Press.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
