Music, humans, and machines: initial reflections for the development of research with collaboration between composers and artificial intelligence in the creative process of Brazilian music

Authors

DOI:

https://doi.org/10.5965/2525530410012025e0104

Keywords:

music generation, human-machine collaboration, Artificial Intelligence in music, creative process, Brazilian music

Abstract

In the 1950s, Americans Hiller and Isaacson pioneered computer-generated music: “Iliac Suit”. Despite advancements in artificial intelligence (AI) systems, current music generation through machines still employs the paradigm established by Hiller and Isaacson (STEELS, 2021). Concurrently, emergent research on human-machine co-creation is reshaping the creative industries, enabling computers to contribute to music, art, and cultural production in ways that were previously unimaginable. Computers now create (make) music, art, and culture with potential for consumption (COMITÊ GESTOR DA INTERNET NO BRASIL, 2022). These transformations may alter music in epistemological and even ontological terms, restructuring the role of the composer. Computer science researchers and those from other technology fields have sought foundations in the humanities, particularly in art-based research, to underpin their studies (CARAMIAUX; DONNARUMMA, 2021). In this regard, there is an urgent need for research stemming from the academic field of music to establish a balanced dialogue with the field of computer science and other technologies. It is worth noting that in a context where music generation and AI projects are funded by professional software-producing companies, with economic investment driven by “usability” (RUTZ, 2021), it is arduous for the music field to conduct practical research on collaborative music generation between humans and machines since most current systems are not available for free experimentation. Therefore, this work aims to discuss the possibilities and challenges faced by researchers in the music field to conduct practical research on human-machine collaboration for music generation. This discussion has proven to be crucial from the challenges found in investigating whether collaborations between composers and AI music generation systems can preserve Brazilian cultural elements in musical outputs. Moreover it is vital as it addresses both the methodological barriers and the broader implications of integrating AI with cultural and creative expressions. The research aims not only to assess the feasibility of such collaborations but also to explore their potential to expand creative and cultural boundaries.  

Downloads

Download data is not yet available.

Author Biographies

Ivan Simurra, Universidade Estadual de Campinas (UNICAMP)

Composer and researcher, he performs electronic manipulations in Pop Music (DJ). He holds a PhD, Master's and Bachelor's degree in Musical Composition from the Institute of Arts - IA/UNICAMP. He won awards for his compositions during the Biennial of Contemporary Brazilian Music-FUNARTE and at the III International Musical Composition Competition, in Tomsk/Russia. His works are performed in Brazil, Argentina, Chile, the United States, Israel and Russia. He was an Adjunct Professor at the Federal University of Acre (CELA/UFAC) from 2019 to 2024. He is currently an emergency professor at the Institute of Arts at Unicamp.

Marília Santos, Universidade Federal da Paraíba

PhD candidate and Master in Music from the Federal University of Paraíba (UFPB). Graduated in Music from the Federal University of Pernambuco (UFPE) and in Literature from the Faculty of Philosophy, Sciences, and Letters of Caruaru (FAFICA). She has experience in Higher Education, Basic Education, in Specialized Music Schools, and in the Third Sector, where she volunteered for nearly a decade. Her research mainly focuses on Brazilian music. She also dedicates herself to the study of traditional and popular cultural and musical expressions. Her academic work extends to countries in both the Americas and Europe. In 2021, part of her research was cited in the Bulletin of the International Council for Traditional Music. In 2024, she directed three short films: “Respostas da Amada”, “Paisagem de Verão” and “A Banda de Pífanos de Santa Luzia”.

References

AVDEEFF, Melissa. Artificial intelligence e popular music: SKYGGE, Flow Machines, and Audio Uncanny Valley. Arts, v. 8, n. 130, p. 1-13, 2019. https://doi.org/10.3390/arts8040130

BLACKING, John. Música, cultura e experiência. Cadernos de Campo, v. 16, n. 16, p. 201-218, 2007. https://doi.org/10.11606/issn.2316-9133.v16i16p201-218

BRIDGET, Baird; BLEVINS, Donald; ZAHLER, Noel. Artificial intelligence and music: implementing an interactive computer performer. Computer Music Journal, v. 17, n. 2, p. 73-79, 1993. https://www.jstor.org/stable/3680871

BRIOT, Jean-Pierre; HADJERES, Gaëtan; and PACHET, François-David. Deep learning techniques for music generation. Vol. 1. Heidelberg: Springer, 2020.

BROOK, Taylor. Music, art, machine learning, and Standardization. Leonardo, v. 56, n. 1, p. 81-86, 2023. https://doi.org/10.1162/leon_a_02135

CAI, Lin; CAI, Qi. Music creation and emotional recognition using neural network analysis. Journal of Ambient Intelligence and Humanized Computing, p. 1-10, 2019.

CARAMIAUX, Baptiste; DONNARUMMA, Marco. Artificial Intelligence in Music and Performance Art-Research Inquiry. In: MIRANDA, Eduardo Reck (ed.). Handbook of artificial intelligence for music: foundations, advanced approaches, and developments for creativity. Springer: Switzerland, 2021, p. 75-96.

CHEN, Yanxu; HUANG, Linshu; and GOU, Tian. Applications and Advances of Artificial Intelligence in Music Generation: A Review. arXiv preprint arXiv:2409.03715 (2024).

COMITÊ GESTOR DA INTERNET NO BRASIL (ed.). Inteligência artificial e cultura: perspectivas para a diversidade na era digital. E-book. Multiple Collaborators. Núcleo de Informação e Coordenação do Ponto BR. São Paulo: Comitê Gestor da Internet no Brasil, 2022. https://www.cgi.br/publicacao/inteligencia-artificial-e-cultura-perspectivas-para-a-diversidade-cultural-na-era-digital/

DAVIS, Nicholas. Human-computer: blending human and computational creativity. AIIDE Workshop Technical Report WS, p. 9-12, 2013. https://doi.org/10.1609/aiide.v9i6.12603

DAVIS, Nicholas et al. An Enactive Model of Creativity for Computational Collaboration and Co-creation. In: ZAGALO, N.; BRANCO, P. (ed.). Creativity in the Digital Age. Londres: Springer-Verlag, 2015, p. 109-133.

DASH, Adyasha, and AGRES, Kathleen. AI-based affective music generation systems: A review of methods and challenges. ACM Computing Surveys 56, no. 11 (2024): 1-34.

DE MARCHI, Leonardo. Indústria fonográfica e a nova produção independente: o futuro da música brasileira? Comunicação, Mídia e Consumo, v. 3, n. 7, p. 167-182, 2006. https://doi.org/10.18568/cmc.v3i7.76

DHARIWAL, Prafulla; JUN, Heewoo; PAYNE, Christine; KIM, Jong Wook; RADFORD, Alec; and SUTSKEVER, Ilya. Jukebox: A generative model for music. arXiv preprint arXiv:2005.00341 (2020).

GAO Q, AN H. Technology-neutral Illusion: The Ethical and Social Challenges in the Age of Artificial Intelligence. Sociology, Philosophy and Psychology. 2024 Jul 9;1(2):33-40.

GETSCHKO, Demi. Apresentação. In Comitê Gestor da Internet no Brasil (org.). Inteligência artificial e cultura: perspectivas para a diversidade na era digital. Livro Digital. Vários Colaboradores. Núcleo de Informação e Coordenação do Ponto BR. São Paulo: Comitê Gestor da Internet no Brasil, 2022. p. 14-17.

GIOTI, Artemi-Maria. Artificial intelligence for music composition. In: MIRANDA, Eduardo Reck (ed.). Handbook of artificial intelligence for music: foundations, advanced approaches, and developments for creativity. Springer: Switzerland, 2021, p. 53-73.

HAFSTEIN, V. Celebrando as diferenças, reforçando a conformidade. In: SANDRONI, C.; SALLES, S. G. (Ed.). Patrimônio cultural em discussão: Novos desafios teórico-metodológicos, p. 17-39. Recife: Ed. Universitária da UFPE, 2013.

DACK, J. Diffusion as performance. In, G. Lasker, J. Lily, and J. Rhodes, eds., Systems Research in the Arts, Volume III: Music, Environmental Design & the Choreography of Space, Vol. 3 (1), pp. 81–88. 2001.

KALIDEEN, M. R., and YAĞLI, C. Machine Learning-based Recommendation Systems: Issues, Challenges, and Solutions. 2025.

KAYAK, A. B.; FADYUSHIN, Sergey. G.; VERESHCHAGINA, E. A. Analytical framework of the convergent approach to the creation of musical systems based on artificial intelligence. International Multi-Conference on Industrial Engineering and Modern Technologies (FarEastCon). IEEE, 2020. p. 1-4. 2020. 10.1109/FarEastCon50210.2020.9271097

KOFLER, Ingrid; EL MOUSSAOUI, Mustapha; and JAMET, Romuald. AI’s influence on the Creative and Cultural Industries. Im@ go: A Journal of the Social Imaginary 24 (2024): 291-312.

KUMAR, Sameer., & KUMAR, Suman. AI Generated Music. International Journal of Research in Science & Engineering, v. 4, n. 1, 2024. https://doi.org/10.55529/ijrise.41.10.12

LIMON, Jaime Diaz. Daddy’s car: la inteligência artificial como herramienta facilitadora de derechos de autor. Revista La Propriedad Inmaterial, n. 22, p. 83-100, 2016. https://ssrn.com/abstract=2900283

MA, Yinghao; ØLAND, Anders; RAGNI, Anton; SETTE, Bleiz MacSen Del; SAITIS, Charalampos; DONAHUE, Chris; LIN, Chenghua. Foundation models for music: A survey. arXiv preprint arXiv 2408.14340 (2024).

MEEHAN, James R. An artificial intelligence approach to tonal music theory. Computer Music Journal, v. 4, n. 2, p. 60-65, 1980. https://doi.org/10.2307/3680083

MERRIAM, Alan. P. The anthropology of music. Illinois: Northwestern University Press, 1964.

MERRIAM, Alan. Definitions of Comparative Musicology and Ethnomusicology: an historical–theoretical perspective. Ethnomusicology, v. 21, n. 2, p. 189-204, 1977.

MIRANDA, Eduardo Reck. Preface. In: MIRANDA, Eduardo Reck (ed.). Handbook of artificial intelligence for music: foundations, advanced approaches, and developments for creativity. Springer: Switzerland, 2021, p. XIX-XXI.

MITU, N. E., & MITU, G. T. (2024). The Hidden Cost of AI: Carbon Footprint and Mitigation Strategies. Available at SSRN 5036344.

MOURA, Francisco Tigre; CASTRUCCI, Chiara; HINDLEY, Clare. Artificial intelligence creates art? An experimental investigation of value and creativity perceptions. Journal of Creative Behavior, v. 57, n. 4, p. 534-549, 2023. https://doi.org/10.1002/jocb.600

NICHOLLS, Steven; CUNNINGHAM, Stuart; PICKING, Richard. Collaborative artificial intelligence in music production. Proceedings of the Audio Mostly 2018 on Sound in Immersion and Emotion. p. 1-4. 2018. 10.1109/FarEastCon50210.2020.9271097

PATIL, Sailee et. al. A systematic survey of approaches used in computer music generation. Journal of Innovations in Data Science and Big Data Management, v. 2, n. 1, p. 6-23, 2023.

ROADS, C. Artificial intelligence and music. Computer Music Journal, v. 4, n. 2, p. 13 25, 1980. https://www.jstor.org/stable/3680079

RUTZ, Hanns Holger. Human–Machine Simultaneity in the Compositional Process. In: MIRANDA, Eduardo Reck (ed.). Handbook of artificial intelligence for music: foundations, advanced approaches, and developments for creativity. Springer: Switzerland, 2021, p. 21-51.

SANDRONI, Carlos. Feitiço Decente: transformações do samba no Rio de Janeiro (1917-1933). Rio de Janeiro: UFRJ Editora: Zahar, 2008.

SANDRONI, Carlos. Notas sobre etnografia em Mário de Andrade. Estudos Avançados, v. 36, n. 104, p. 205-223, 2022. https://doi.org/10.1590/s0103-4014.2022.36104.010

SILVA, Fernando Fernandes da. Mário e o patrimônio: um anteprojeto ainda atual. Revista do Patrimônio Histórico e Artístico Nacional, n. 30, p. 129-138, 2002.

STEELS, Luc. Foreword: From Audio Signals to Musical Meaning. In: MIRANDA, Eduardo Reck (ed.). Handbook of artificial intelligence for music: foundations, advanced approaches, and developments for creativity. Springer: Switzerland, 2021, p. V-XVIII.

STERNE, Jonathan; RAZLOGOVA, Elena. Tuning sound for infrastructures: artificial intelligence, automation, and the cultural politics of audio mastering. Cultural Studies, v. 35, n. 4-5, p. 750-770, 2021. https://doi.org/10.1080/09502386.2021.1895247

STOKES, Martin (ed.). Ethnicity, identity and music: the musical construction of place. Oxford and New York: Berg, 1997a.

STOKES, M. Place, exchange and meaning: black sea musicians in the west of Ireland. In: STOKES, M. (org.). Ethnicity, identity and music: the musical construction of place. Oxford, New York: Berg, 1997b. p. 97-115.

STOLYAROV, Gennady. Empowering musical creation through machines, algorithms, and artificial intelligence. INSAM Journal of Contemporary Music, Art and Technology, n. 2, p. 81-99, 2019.

TABAK, Cihan. Intelligent music applications: innovative solutions for musicians and listeners. Uluslararası Anadolu Sosyal Bilimler Dergisi, v. 7, n. 3, p. 752-773.2 2023

ZHOU, Xuan et al. Analysis of Evaluation in Artificial Intelligence Music. Journal of Artificial Intelligence Practice, v. 6, n. 8, p. 6-11, 2023.

Published

2025-08-05

How to Cite

SIMURRA, Ivan Eiji Yamauchi; SANTOS, Marília. Music, humans, and machines: initial reflections for the development of research with collaboration between composers and artificial intelligence in the creative process of Brazilian music. Orfeu, Florianópolis, v. 10, n. 1, p. e0104, 2025. DOI: 10.5965/2525530410012025e0104. Disponível em: https://revistas.udesc.br/index.php/orfeu/article/view/26882. Acesso em: 19 sep. 2025.