Artificial Intelligence Music Creation with Neural Networks
by Sid Singh
Artificial Intelligence (AI) music creation is using generative artificial intelligence to produce music, often that aims to resemble human-made music. [1]
To replicate human-created music compositions, a deep learning model is used. Deep learning models, a type of artificial neural network, are representations of the human brain that perform tasks such as classification and representation, such as finding a common note or pattern in music. [2] The models use training data, such as human-made music, as well as hidden ("deep") layers to train a randomized input into the desired output -- artificially created music that resembles a human creation. The use and popularity of music created by generative AI has skyrocketed in recent years [3], with its reception being a mixed bag of critics and believers. [4]
History of AI Music
Artists and engineers have aimed to transcribe and recreate music since the 19th century, when music rolls were introduced commercially. Music rolls, typically made for reproducing piano, are sheets of paper with holes that model the notes and rhythm of music [5]. When these sheets are moved over a tracker bar, the instrument can recreate the piece without a human player.
The modern-day, digital version of a music roll is a Musical Instrument Digital Interface (MIDI) file, which was introduced in the late 20th century by Dave Smith [6]. Now, MIDI files are often the input for deep learning models to learn music. Before MIDI, though, AI music had already begun being generated; in 1957, composers Lejaren Hiller and Leonard Isaacson created The Illiac Suite, the first known computer-composed piece of music. [7] Since then, the scope and capability of Artificial music has greatly expanded. Recent projects such as Google's Magenta Project [8] and OpenAI's MuseNet [9] allow users to give the computer certain requirements, such as instruments and lyrics to include, to create unique artificial arrangements. Artificial "deepfakes" of popular artists are another recent development of the AI music realm; the song "Heart on My Sleeve", which imitates the voices of popular artists Drake and The Weeknd, gained over 15 million views on social media platform, TikTok, and over 600,000 streams on popular streaming platform Spotify. [10]
