Feigning Humanity: Virtual Instruments, Simulation and Performativity

Authors

  • Eve Klein University of Queensland IASPM ANZ

Keywords:

Virtual Instruments, Simulation, Performativity, virtual orchestras, Musical Expressivity, Synthesisers

Abstract

This article is concerned with the ways virtual instruments simulate acoustic human performance. In particular, it examines two case studies—virtual orchestras and virtual singers—to consider how their design and implementation seek to express human music performance by adopting the micro and macro sonic variations of timing, pitch, dynamics, articulation, and ambience, and other limitations imposed by the physical relationship between the player and the instrument. By feigning the acoustic markers of expressive human musical performance, virtual instrument designers and composer-users encourage the listener to produce, in themselves, the experience of hearing an orchestra or singer. Users also contribute to the recontextualisation of human performance by feeding back into the cultures and development cycles of virtual instrument software, where sonic gestures are recurrently refreshed. The construction of virtual instruments as devices of musical expressivity is, therefore an evolving, mutually constructed, and performative endeavour.

Author Biography

Eve Klein, University of Queensland IASPM ANZ

Convenor, Bachelor of Arts Popular Music Major Lecturer in Music Technology and Popular Music

References

Bibliography

Ah-Software. 2016. Hiyama Kiyoteru. http://www.ah-soft.com/vocaloid/kiyoteru/natural.html; Accessed: 10 April 2016.

Arturia. 2016. V Collection 4. https://www.arturia.com/products/analog-classics/v-collection/overview; Accessed: 30 March 2016.

Baudrillard, J. 1994. Simulacra and Simulation. Ann Arbour, MI: The University of Michigan Press.

Bell, S.A. 2016. The dB in the .db: Vocaloid Software as Posthuman Instrument. Popular Music and Society 39(2): 222-240.

DOI: 10.1080/03007766.2015.1049041.

Bennett, S. 2009. Computer Orchestration: Tips and Tricks. Norfolk: PC Publishing.

Brown, A. 2015. Music Technology and Education: Amplifying Musicality. London: Routledge.

Butler, J. 2014. Gender Trouble: Feminism and the Subversion of Identity. London: Routledge.

Chanan, M. 1995. Repeated Takes: A Short History of Recording and Its Effects on Music. London: Verso.

Clarke, E. –

Expression in Performance: Generativity, Perception and Semiosis. In J. Rink Ed. The Practice of Performance Studies in Musical Interpretation. Cambridge: Cambridge University Press.

The Semiotics of Expression in Musical Performance. Contemporary Music Review 17(2): 87-102.

Crypton Future Media. 2016. Who is Hatsune Miku? http://www.crypton.co.jp/miku_eng; Accessed: 7 April 2016.

Davies, S. 2011. Musical Understandings and Other Essays on the Philosophy of Music. Oxford: Oxford University Press.

East West. –

Symphonic Choirs User Manual. Hollywood, CA: East West Sounds Inc.

Hollywood Solo Instruments User Manual. Hollywood: East West Sounds Inc.

a. East West/ Quantum Leap Hollywood Solo Instruments. http://www.soundsonline.com/hollywood-solo-series; Accessed: 28 March 2016.

b. East West/ Quantum Leap Hollywood Orchestra. http://www.soundsonline.com/Hollywood-Orchestra; Accessed: 28 March 2016.

c. East West/ Quantum Leap Symphonic Orchestra. http://www.soundsonline.com/Symphonic-Orchestra; Accessed: 28 March 2016.

d. Home. http://www.soundsonline.com/; Accessed: 28 March 2016.

Eidsheim, N. 2009. Synthesizing Race: Towards an Analysis of the Performativity of Vocal Timbre. TRANS: Transcultural Music Review 13. http://www.sibetrans.com/trans/articulo/57/synthesizing-race-towards-an-analysis-of-the-performativity-of-vocal-timbre; Accessed: 7 April 2016.

Evans, A. 2005. Sound Ideas: Music, Machines, and Experience. Minneapolis, MN: University of Minnesota Press.

Fanloid. 2016. List: Official Vocaloid Characters. https://en.wikipedia.org/wiki/List_of_Vocaloid_products; Accessed: 10 April 2016.

Frith, S. 1996. Performing Rites: Evaluating Popular Music. Oxford: Oxford University Press.

Garritan. 2016. Garritan Instant Orchestra Sound Library. http://www.garritan.com/products/instant-orchestra/; Accessed: 30 March 2016.

Gilreath, P. 2004. The Guide to MIDI Orchestration. Marietta, GA: MusicWorks Atlanta. Third edition.

Godlovitch, S. 1998. Musical Performance: A Philosophical Study. London: Routledge.

IK Multimedia. 2016. Miroslav Philharmonik 2. http://www.ikmultimedia.com/products/philharmonik2/; Accessed: 20 March 2016.

Izhaki, R. 2009. Mixing Audio: Concepts, Practices, Tools. Oxford: Focal Press.

iZotope. 2016. Iris 2. https://www.izotope.com/iris; Accessed: 30 March 2016.

Katz, M. 2004. Capturing Sound: How Technology Has Changed Music. Berkeley, CA: University of California Press.

Kendall, R.A., and Carterette, E.C. 1990. The Communication of Musical Expression. Music Perception 8(2): 129-164.

Klein, E. –

Is Classical Music “Boring”? A Discussion of Fidelity, Virtuosity and Performance in Classical Music Recording. In J. O’Regan and T. Wren Eds. Communities, Places, Ecologies: Proceedings of the 2013 IASPM-ANZ Conference, Brisbane, Australia, 24-26 November 2013: 112-125.

a. Opera Composition and Performance Utilising Computer-based Recording Technologies and Virtual Instruments. In T. Gifford Eds. Proceedings of Createworld 2015. CreateWorld 2015, A Digital Arts Conference, Brisbane, Australia, 12-13 February 2015: 10-17.

b. Performing Nostalgia On Record: How Virtual Orchestras and YouTube Ensembles Have Problematised Classical Music. Journal on the Art of Record Production 9. http://goo.gl/EOQm3O; Accessed: 27 August 2016.

Kopiez, R., Wolf, A., Platz, F., and Mons, J. 2016. Replacing the Orchestra? The Discernibility of Sample Library and Live Orchestra Sounds. PLoS ONE 11(7): e0158324. DOI 10.1371/journal.pone.0158324; Accessed: 29 December 2016

Juslin, P.N. 2000. Cue Utilization in Communication of Emotion in Music Performance: Relating Performance to Perception. Journal of Experimental Psychology: Human Perception and Performance 26(6): 1797-1813.

Lindström, E., Juslin, P.N., Bresin, R. and Williamon, A. 2003. “Expressivity Comes from Within Your Soul”: A Questionnaire Study of Music Students’ Perspectives on Expressivity. Research Studies in Music Education 20(1): 23-47.

Local 802. 2003. Local 802 News – Publications & Press Releases. http://www.local802afm.org/publication_entry.cfm?xEntry=3954395; Accessed: September 2011.

Morgan, C. –

Screen-music Orchestration Quantified: Preliminary Results of a Study on the Use of Virtual Instruments. Music and the Moving Image Conference, New York University, Steinhardt, May 2014. https://www.academia.edu/7926743/MAMI_Presentation_-_Craig_Morgan_20140509; Accessed: 3 April 2016.

Virtual Instruments and the Future of Australian Film Music Composition. National Conference of the Musicological Society of Australia 2015. University of Sydney, July 2015. https://www.academia.edu/16493620/Virtual_Instruments_and_the_future_of_Australian_film_music_composition: Accessed: 5 April 2016.

The Use of Virtual Instruments by Australian Screen Composers. Sidney: University of Sydney. http://goo.gl/SS9Oai; Accessed: 27 August 2016. PhD Thesis.

Native Instruments. 2016. Rounds. https://www.native-instruments.com/en/products/komplete/synths/rounds/; Accessed: 25 March 2016.

Palmer, C. 1989. Mapping Musical Thought to Musical Performance. Journal of Experimental Psychology: Human Perception and Performance 15(12): 331-346.

Pätynen, J. and Lokki, T. 2016. Concert Halls with Strong and Lateral Sound Increase the Emotional Impact of Orchestra Music. The Journal of the Acoustical Society of America 139(3): 1214-1224. DOI: 10.1121/1.4944038.

Pejrolo, A. 2011. Creative Sequencing Techniques for Music Production. Oxford: Elsevier. Second edition.

Pejrolo, A. and DeRosa, R. 2007. Acoustic and MIDI Orchestration for the Contemporary Composer. London: Focal Press.

Player, T. 2014. Real Orchestra Vs. Synth Mockup – Part 1/6. http://audiocookbook.org/real-orchestra-vs-synth-mockup-part-16/#more-11013; Accessed: 27 August 2016.

Sh-henian. 2016. Luo. http://www.sh-henian.com/idols/lty; Accessed: 10 April 2016.

Spectrasonics. 2016. Omnisphere 2. https://www.spectrasonics.net/products/omnisphere/; Accessed: 10 April 2016.

Spitfire Audio. 2016. Albion One: Epic Composer Tools.

http://www.spitfireaudio.com/shop/ranges/albion/albion-one/; Accessed: 1 April 2016.

Sundberg, J., Filipa M.B. and Himonides, E. 2012. Intonation and Expressivity: A Single Case Study of Classical Western Singing. Journal of Voice 27(3): 391.e1-391.e8.

Symes, C. 2004. Setting the Record Straight: A Material History of Classical Recording. Middletown, CT: Wesleyan University Press.

Talk Classical. 2011. Sound Synthesizers – Future of Classical Music? http://www.talkclassical.com/13084-sound-synthesizers-future-classical.html; Accessed: 27 August 2011.

UVI. 2016. Orchestral Suite. http://www.uvi.net/en/orchestral-composer/orchestral-suite.html; Accessed: 14 March 2016.

Vienna Symphonic Library –

Vienna Instruments Pro User Manual 2.5. Vienna: Vienna Symphonic Library.

a. Company. https://vsl.co.at/en/Company; Accessed: 26 March 2016.

b. Products. https://vsl.co.at/en/Products; Accessed: 26 March 2016.

c. Vienna Instruments Pro. https://vsl.co.at/en/Vienna_Software_Package/Vienna_Instruments_PRO#!Product_Info; Accessed: 26 March 2016.

d. Vienna MIR Room Pack Bundle. https://vsl.co.at/en/Vienna_Software_Package/Vienna_MIR_RoomPack_Bundle; Accessed: 2 April 2016.

e. Vienna Solo Voices. https://www.vsl.co.at/en/Voices_Complete/Vienna_Solo_Voices; Accessed: 12 April 2016.

f. Vienna Super Package. https://vsl.co.at/en/Instruments/Super_Package; Accessed: 12 April 2016.

Vocaloidotaku. 2016. Songs & PVs & MMDs. http://www.vocaloidotaku.net/index.php?/forum/11-songs-pvs-mmds/; Accessed: 1 September 2016.

Vocaloid Wikia. 2014. Robotic or not Robotic, that's the Question...

http://vocaloid.wikia.com/wiki/Thread:73705; Accessed: 1 September 2016.

Walden, J. –

a. Vocaloid Leon & Lola. Sound on Sound. March 2004. http://www.soundonsound.com/sos/mar04/articles/vocaloidlandl.htm; Accessed: 7 April 2014.

b. Vocaloid Miriam. Sound on Sound, December 2004. http://www.soundonsound.com/sos/dec04/articles/miriam.htm; Accessed: 7 April 2014.

Wikipedia. 2016. List of Vocaloid Products. https://en.wikipedia.org/wiki/List_of_Vocaloid_products; Accessed: 10 April 2016.

Woody, R.H.

The Relationship Between Explicit Planning and Expressive Performance of Dynamic Variations in an Aural Modeling Task. Journal of Research in Music Education 47(4): 331-342.

Learning Expressivity in Music Performance: An Exploratory Study. Research Studies in Music Education 14(1): 14-23.

Yamaha –

Vocaloid 4 Editor User Manual. USA: Yamaha.

Vocaloid. http://www.vocaloid.com/us/; Accessed: 6 April 2016.

Videography

Hatsune Miku. 2016. Blue Star feat. Hatsune Miku. https://www.youtube.com/watch?v=H_6I_LLheAY; Accessed: 1 September 2016.

Ikinamo. 2009. Yamaha Vocaloid Robot Singing Using Speech Synthesis Software. https://www.youtube.com/watch?v=mfxkhzGqZIs; Accessed: 1 September 2016.

Downloads

Additional Files

Published

31-12-2016