Livingstone, Steven

Steven Livingstone

Start Year: 2016

Computer Science and Information Systems
Office: 320a South Hall
Phone: 715-425-3991

Email: steven.livingstone@uwrf.edu

Education:

Ph.D. in Computer Science, September 2008. The University of Queensland. Thesis: Changing musical emotions through score and performance with a computational rule system.

Advisors: Dr Ralf Muhlberger, Dr Andrew R. Brown.

B.Inf.Tech first class honours in Information Technology, December 2003. The University of Queensland. Thesis: Service Discovery in Pervasive Systems. Advisor: Dr Jadwiga Indulska.

B.S. in Physics, December 2000. The University of Queensland.

Courses Taught:

Programming I

Introduction to Data Science

Research Interests:

My research explores the use of affective technology to facilitate human-computer interaction. By combining computational methods with experimental psychology, I seek to develop affective technologies that can recognize, interpret, predict, and express emotion. I am also interested in

the application of affective technology in the rehabilitation of facial and vocal deficits in neurodegenerative disorders such as Parkinson's disease.

Publications:

Peer-Reviewed Journal Publications

1. Livingstone, S. R., Vezer, E., McGarry, L. M., Lang, A. E., & Russo, F. A. (2016). Deficits in the mimicry of facial expressions in Parkinson's Disease. Frontiers in Psychology, 7. http://dx.doi.org/10.3389/fpsyg.2016.00780

2. Livingstone, S. R., & Palmer, C. (2016). Head movements encode emotions during speech and song. Emotion, 16, 365-380. http://dx.doi.org/10.1037/emo0000106. Profiled in The Atlantic and NBC Today. http://dx.doi.org/10.18061/emr.v8i2.3931

3. Livingstone, S. R., Thompson, W. F., Wanderley, M. M., & Palmer, C. (2015). Common cues to emotion in the dynamic facial expressions of speech and song. The Quarterly Journal of Experimental Psychology, 68, 952-970. http://dx.doi.org/10.1080/17470218.2014.971034

4. Livingstone, S. R., Choi, D., & Russo, F. A. (2014). The influence of vocal training and acting experience on measures of voice quality and emotional genuineness in male singers. Frontiers in Cognitive Science, 5. http://dx.doi.org/10.3389/fpsyg.2014.00156

5. Livingstone, S. R. (2013). The kinematics of musical expression in the spatiotemporal dimension. Empirical Musicology Review, 7, 124-127. http://dx.doi.org/10.18061/emr.v8i2.3931

6. Chan, L. P., Livingstone, S. R., & Russo, F. A. (2013). Facial mimicry in response to song. Music Perception, 30, 361-367. http://dx.doi.org/10.1525/mp.2013.30.4.361

7. Livingstone, S. R., Palmer, C., & Schubert, E. (2012). Emotional response to musical repetition. Emotion, 12, 552-567. Http://dx.doi.org/10.1037/a0023747

8. Livingstone, S. R., Muhlberger, R., Brown, A. R., & Thompson, W.F. (2010). Changing musical emotion: A computational rule system for modifying score and performance. Computer Music Journal, 34, 41-64. Http://dx.doi.org/10.1162/comj.2010.34.1.41

9. Thompson, W.F., Russo, F.A., & Livingstone, S. R. (2010). Facial expressions of singers influence perceived pitch relations. Psychonomic Bulletin & Review, 17, 317-322. Http://dx.doi.org/10.3758/PBR.17.3.317

10. Livingstone, S.R., Thompson, W.F., & Russo, F.A. (2009). Facial expressions and emotional singing: A study of perception and production with motion capture and electromyography. Music Perception, 26, 475-488. http://dx.doi.org/10.1525/mp.2009.26.5.475

11. Livingstone, S. R. & Thompson, W. F. (2009). The emergence of music from the Theory of Mind. Musicae Scientiae, Special Issue 2009/10 "Music and Evolution", 83-115. http://dx.doi.org/10.1177/1029864909013002061

12. Livingstone, S. R., Muhlberger, R., Brown, A. R., Loch, A. (2007). Controlling Musical Emotionality: An Affective Computational Architecture for Influencing Musical Emotion. Digital Creativity, 18, 43-54. http://dx.doi.org/10.1080/14626260701253606

13. Livingstone, S. R. & Thompson, W. F. (2006). Multimodal affective interaction: A comment on musical origins. Music Perception, 24, 89-94. Http://dx.doi.org/10.1525/mp.2006.24.1.89

Peer-Reviewed Conference Proceedings Publications

1. Zhao, S., Rudzicz, F., Carvalho, L. G., Márquez-Chin, C., & Livingstone, S. R. (2014). Automatic detection of expressed emotion in Parkinson's Disease. Proceedings of the 2014 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP).

2. Livingstone, S. R., Peck, K., & Russo, F. A. (2013). Acoustic differences in the speaking and singing voice. The Journal of the Acoustical Society of America, 133, 3591-3595.

3. Livingstone, S. R., Palmer, C., Wanderley, M. M., Thompson, W. F., & Lissemore, J. (2011). Facial expressions in vocal performance. In A.Williamon, D. Edwards, & L. Bartel (Eds.), Proceedings of the Third International Symposium on Performance Science (pp. 545–550). Utrecht: European Association of Conservatoires (AEC).

4. Livingstone, S. R., Palmer, C., Thompson, W. F., & Wanderley, M. (2010). Facial expressions in speech and singing. In M. M. Wanderley, J. Wild, & S. X. Wei (Eds.), Proceedings of the Third International Conference on Music and Gesture (pp. 9-10). Montreal: Schulich School of Music.

5. Livingstone, S. R., Schubert, E., Loehr, J. D., & Palmer, C. (2009). Emotional arousal and the automatic detection of musical phrase boundaries. In A.Williamon, S. Pretty, & R. Buck (Eds.), Proceedings of the Second International Symposium on Performance Science (pp. 445–450). Utrecht: European Association of Conservatoires (AEC).

6. Livingstone, S. R., & Brown, A. R. (2005). Dynamic response: Real-time adaptation for music emotion. Proceedings of the Second Australasian conference on Interactive Entertainment (pp. 105–111). Sydney: Creativity and Cognition Studios Press.

7. Livingstone, S. R., Brown, A. R., & Muhlberger, R. (2005). Influencing the Perceived Emotions of Music with Intent. In T. Innocent (Ed.), Proceedings of the Third International Conference on Generative Systems in the Electronic Arts (pp. 119-128). Victoria: Centre for Electronic Media Art.

8. Livingstone, S. R., Muhlberger, R., & Brown, A. R. (2005). Playing with Affect: Music Performance with Awareness of Score and Audience. In T. Opie and A. R. Brown (Eds.), Proceedings of the Australasian Computer Music Conference (pp. 89-95). Brisbane: ACMA.

9. Henricksen, K., Livingstone, S. R., & Indulska, J. (2004). Towards a hybrid approach to context modelling, reasoning and interoperation. Proceedings of the First International Workshop on Advanced Context Modelling, Reasoning and Management, (pp. 54–61). Nottingham: England.

Book Chapters

1. Livingstone, S. R. (2014). Facial expressions. In William F. Thompson & Geoffrey Golson (Eds.). Music in the social and behavioural sciences. Thousand Oaks, CA: Sage Publications.

2. Livingstone, S. R., & Thompson, W. F. (2009). L'apparition de la musique de la théorie d'esprit. In Marc Richelle & Xavier Seron (Eds.). Musique et Evolution. Belgium: Pierre MARDAGA Press.

Invited Papers

1. Livingstone, S. R., Peck, K., & Russo, F. A. (2013). The language of emotion: Acoustic differences in the speaking and singing voice. Invited lay-language paper for Press Room of the 165th Meeting of the Acoustical Society of America.

Conference and Workshop Paper Presentations

1. Oudyk, K., Livingstone, S. R., & Rensink-Hoff, R. (2016). Experience-related differences in conducting gestures. Paper presented at 1st annual retreat for McMaster Institute for Music and the Mind (MIMM), Hamilton, ON, Canada.

2. Russo, F. A., & Livingstone, S. R. (2015). The Ryerson Audio-Visual Database of Emotional Speech and Song. Paper presented at the Acoustics Week in Canada (AWC15), Halifax, NS.

3. Livingstone, S. R., McGarry, L., Stinson, L. & Russo, F, A. (2014). Preliminary report on a novel singing therapy to support emotional communication in Parkinson's Disease. Paper presented at the Third International Conference for the International Association for Music and Medicine (IAMM), Toronto, ON.

4. Vezer, E., Livingstone, S. R., McGarry, L., & Russo, F, A. (2014). Deficits in spontaneous facial mimicry in patients with Parkinson's disease. Paper presented at the 24th Annual Meeting of the Canadian Society for Brain, Behaviour and Cognitive Science (CSBBCS), Toronto, ON.

5. Livingstone, S. R., McGarry, L., van Lieshout, P., Lang, A. E., & Russo, F, A. (2013). A novel singing therapy for rehabilitating facial and vocal expressive deficits in Parkinson's disease. Paper presented at the Toronto Rehabilitation Institute 9th Annual Research Day, Toronto, ON. – Recipient of TRI best presentation award

6. Russo, F. A., & Livingstone, S. R. (2013). Invited presentation. A novel singing therapy to improve the communication of facial and vocal emotion deficits in Parkinson's disease. Paper presented at Music and Neurological Rehabilitation Symposium, Toronto, ON.

7. Livingstone, S. R. & Russo, F, A. (2013). Emotional meaning across cultures. Paper presented at the 5th Annual Meeting of Advancing Interdisciplinary Research in Singing (AIRS), Toronto, ON.

8. Livingstone, S. R. (2013). Invited presentation. A beginner's guide to pitch analysis in Praat. Paper presented at the 5th Annual Meeting of Advancing Interdisciplinary Research in Singing (AIRS), Toronto, ON.

9. Livingstone, S. R., Peck, K., & Russo, F, A. (2013). RAVDESS: The Ryerson audio-visual database of emotional speech and song. Paper presented at the Society for Music Perception and Cognition conference, Toronto, ON.

10. McGarry, L., Livingstone, S. R., Russo, F. A. (2013). Imitation training to enhance emotion perception skills. Paper presented at the Society for Music Perception and Cognition conference, Toronto, ON.

11. Livingstone, S. R., Peck, K., & Russo, F, A. (2012). RAVDESS: The Ryerson audio-visual database of emotional speech and song. Paper presented at the 8th Toronto Rehab annual research day. Toronto, ON.

12. Livingstone, S. R. (2012). Invited presentation. Changing musical emotion with a computational rule system. Paper presented at the Second Annual seminar on Cognitively Based Music Informatics Research (CogMIR), Toronto, ON.

13. Livingstone, S. R. (2012). Invited presentation. A beginner's guide to Praat Scripting. Paper presented at the 4th Annual Meeting of Advancing Interdisciplinary Research in Singing (AIRS), Charlottetown, PEI.

14. Russo, F. A., & Livingstone, S. R. (2012). A novel singing therapy to improve communication of facial and vocal emotion in Parkinson's Disease. Paper presented at the 4th Annual Meeting of Advancing Interdisciplinary Research in Singing (AIRS), Charlottetown, PEI.

15. Livingstone, S. R., Peck, K., & Russo, F. A. (2012). Introducing RAVDESS: The Ryerson Audio-Visual Database of Emotional Speech and Song. Paper presented at the 4th Annual Meeting of Advancing Interdisciplinary Research in Singing (AIRS), Charlottetown, PEI.

16. Livingstone, S. R., Peck, K., & Russo, F. A. (2012). RAVDESS: The Ryerson Audio-Visual Database of Emotional Speech and Song. Paper presented at the 22nd Annual Meeting of the Canadian Society for Brain, Behaviour and Cognitive Science (CSBBCS), Kingston, ON.

17. Livingstone, S. R., Palmer, C., Wanderley, M., & Thompson, W. F. (2011). Production and perception of facial expressions during vocal performance. Paper presented at the Society for Music Perception and Cognition conference, Rochester, NY.

18. Livingstone, S. R., Palmer, C., Wanderley, M., & Thompson, W. F. (2010). Facial expressions in song and speech. Paper presented at the 9th Annual Auditory Perception, Cognition and Action Meeting, St Louis, MO.

19. Livingstone, S. R., Schubert, E., Loehr, J. D., & Palmer, C. (2010). Effects of repetition and phrase structure on emotional arousal. Paper presented at the 11th International Conference on Music Perception and Cognition, Seattle, WA.

20. Livingstone, S. R., Loehr, J. D., Palmer, C., & Schubert, E. (2009). Emotional arousal corresponds with musical phrase structure. BRAMS Annual Scientific Day, Montreal, Canada.

21. Livingstone, S. R., Thompson, W.F., Chan, L., & Russo, F.A. (2009). Facial expressions in emotional song. Paper presented at the Society for Music Perception and Cognition conference, Indianapolis, IN.

22. Livingstone, S. R. (2009). Changing musical emotion. Workshop on Expressive Performance, Montreal, Canada.

23. Livingstone, S. R. (2009). Changing musical emotion through score and performance with a computational rule system. Second Music Perception and Cognition Student Colloquium, Montreal, Canada.

24. Livingstone, S. R., Thompson, W.F., & Russo, F.A. (2009). Facial expressions in emotional singing. Workshop on Music, Motion and Emotion, Montreal, Canada.

25. Thompson, W. F., Livingstone, S. R., Palmer, C. (2008). Using motion capture to investigate vocal emotional communication, Leipzig, Germany.

26. Livingstone, S. R., Muhlberger, R., Brown, A. R. (2006). Influencing perceived musical emotions: The importance of performative and structural aspects in a rule system. Music as Human Communication: An HCSNet Workshop on the Science of Music Perception, Performance and Cognition.

27. Livingstone, S. R., Muhlberger, R., Brown, A. R. (2006). Music, speech and a Theory of Mind: Investigations with a computational model of musical emotions. HCSNet Workshop on Human and Machine Speech.

28. Livingstone, S. R., Muhlberger, R., Brown, A. R. (2006). The music-emotion lifecycle. HCSNet Workshop on Perception and Action.

Poster Presentations

1. Livingstone, S. R., Vezer, E., McGarry, L. M., Lang, A. E., & Russo, F. A. (2015). Deficits in the automatic mimicry of facial expressions in Parkinson's disease. Poster presented at the 11th Annual NeuroMusic conference. Hamilton, ON.

2. Livingstone, S. R., McGarry, L., van Lieshout, P., Lang, A. E., & Russo, F, A. (2014). Invited poster. A novel singing therapy for rehabilitating facial and vocal expressive deficits in Parkinson's disease. Poster presented at the Innovations Gallery, TRI. Toronto, ON.

3. Livingstone, S. R., McGarry, L., van Lieshout, P., Lang, A. E., & Russo, F, A. (2013). A novel singing therapy for rehabilitating facial and vocal expressive deficits in Parkinson's disease. Poster presented at the Toronto Rehabilitation Institute 9th Annual Research Day, Toronto, ON.

4. Livingstone, S. R., Peck, K., & Russo, F, A. (2012). RAVDESS: The Ryerson audio-visual database of emotional speech and song. Poster presented at the 8th Toronto Rehab annual research day. Toronto, ON.

5. Livingstone, S. R., Palmer, C., Wanderley, M., & Thompson, W. F. (2011). Rapid identification of emotional expression in faces. Poster session presented at Psychonomics, Seattle, WA.

6. Livingstone, S. R., Palmer, C., Wanderley, M., & Thompson, W. F. (2011). The temporal coordination of facial motion and vocal affect. Poster session presented at the 10th Annual Auditory Perception, Cognition and Action Meeting, Seattle, WA.

7. Livingstone, S. R. (2008). Changing musical emotion with a computational rule system. Poster session presented at Workshop on Music and Machine Learning, Montreal, QC.

Grants

1. Parkinson Canada Livingstone (FA Russo, PI). "A novel singing therapy to improve communication of facial and vocal emotion", 2012 – 2013 ($44,956).

2. Graduate School Research Travel Grant (PI), 2006, ($3,500).

Scholarships and Awards

1. Best presentation award, Toronto Rehabilitation Institute, 9th annual research day, 2013.

2. Postdoctoral Scholarship, SSHRC-AIRS fellowship, 2011 – 2012 ($40,000).

3. Postdoctoral Scholarship, NSERC-Create Auditory Cognitive Neuroscience, 2009 – 2010 ($44,000).

4. ITEE Research Scholarship, The University of Queensland, 2004 – 2007 ($54,000)

5. DSTC Industry Award, Outstanding Honours Thesis, 2003 ($500).

6. Dean's Commendation (x4), The University of Queensland, 2000 - 2003.

Complete CV