Blob Opera is a machine learning experiment by David Li in collaboration with Google Arts and Culture. This experiment pays tribute to and explores the original musical instrument: the voice. Play four opera voices in real time. No singing skills required! We developed a machine learning model trained on the voices of four opera singers in order to create an engaging experiment for everyone, regardless of musical skills. Tenor, Christian Joel, bass Frederick Tong, mezzo-soprano Joanna Gamble and soprano Olivia Doutney recorded 16 hours of singing. In the experiment you don’t hear their voices, but the machine learning model’s understanding of what opera singing sounds like, based on what it learnt from them.
*How it works:*
Drag the blobs up and down to change pitch. Or forwards and backwards for different vowel sounds. Another machine learning model lets the blobs respond to and harmonise your input in real time.