publications

V. Ramanarayanan, A. Lammert, H. Rowe, T. F. Quatieri and J. R. Green (2021, accepted). Speech as a Biomarker: Opportunities, Interpretability, and Challenges, Perspectives of the ASHA Special Interest Groups.

M. Neumann, O. Roesler, J. Liscombe, H. Kothare, D. Suendermann-Oeft, J. D. Berry, E. Fraenkel, R. Norel, A. Anvar, I. Navar, A. V. Sherman, J. R. Green and V. Ramanarayanan (2021). Multimodal dialog based speech and facial biomarkers capture differential disease progression rates for ALS remote patient monitoring, in proceedings of: The 32nd International Symposium on Amyotrophic Lateral Sclerosis and Motor Neuron Disease, Virtual, December 2021.

H. Kothare, M. Neumann, O. Roesler, J. Liscombe, D. Pautler, D. Suendermann-Oeft, C. Yavorsky, A. Khan, JP Lindenmayer and V. Ramanarayanan (2021). Multimodal conversational technology for remote assessment of symptom severity in people with schizophrenia, in proceedings of: Society for Neuroscience (SfN) Annual Meeting, Chicago, IL, November 2021.

J. Liscombe, H. Kothare, D. Habberstad, A. Cornish, O. Roesler, M. Neumann, D. Pautler, D. Suendermann-Oeft and V. Ramanarayanan (2021). Voice Activity Detection in Dialog Agents for Dysarthric Speakers, in proceedings of: International Workshop on Spoken Dialog Systems (IWSDS 2021), Singapore, November 2021.

A. Exner, V. Ramanarayanan, D. Pautler, H. Kothare, S. Snyder, and J. Huber (2021). Development of a Telehealth Platform for the Assessment of Motor Speech Disorders, in proceedings of: ASHA 2021 Convention, Washington DC, November 2021.

A. Khan, JP Lindenmayer, S. Bashir, S. Prokop, B. Insel, B. Fitapelli, K. Bodicherla, M. Parak, B. Parker, C. Yavorsky, H. Kothare, D. Pautler, D. Suendermann-Oeft and V. Ramanarayanan (2021). Multimodal AI of Facial and Acoustic Biomarkers of Negative Symptoms in Schizophrenia, in proceedings of: International Society for CNS Clinical Trials and Methodology (ISCTM 2021) Autumn Conference, Lisbon, Portugal, September 2021.

V. Ramanarayanan, A. Exner, D. Pautler, S. Snyder, W. Burke, H. Kothare, J. Liscombe, D. Suendermann-Oeft, A. Lambert, R. Kohlmeier, and J. Huber (2021). Multimodal Conversational AI for Remote Patient Monitoring and Analysis of Parkinson's Disease, in proceedings of: 25th International Congress of Parkinson's Disease and Movement Disorders (MDS 2021), Virtual, September 2021.

M. Neumann, O. Roesler, J. Liscombe, H. Kothare, D. Suendermann-Oeft, D. Pautler, I. Navar, A. Anvar, J. Kumm, R. Norel, E. Fraenkel, A. Sherman, J. Berry, G. Pattee, J. Wang, J. Green, V. Ramanarayanan (2021). Investigating the Utility of Multimodal Conversational Technology and Audiovisual Analytic Measures for the Assessment and Monitoring of Amyotrophic Lateral Sclerosis at Scale, in proceedings of: 22nd Annual Conference of the International Speech Communication Association (Interspeech 2021), Brno, Czech Republic, August - September 2021.

H. Kothare, V. Ramanarayanan, O. Roesler, M. Neumann, J. Liscombe, W. Burke, A. Cornish, D. Habberstad, A. Sakallah, S. Markuson, S. Kansara, A. Faerman, Y. Bensidi-Slimane, L. Fry, S. Portera, D. Suendermann-Oeft, D. Pautler, C. Demopoulos (2021). Investigating the Interplay Between Affective, Phonatory and Motoric Subsystems in Autism Spectrum Disorder Using a Multimodal Dialogue Agent, in proceedings of: 22nd Annual Conference of the International Speech Communication Association (Interspeech 2021), Brno, Czech Republic, August - September 2021. (Also presented at the 2021 National Autism Conference, Penn State University, PA , August 2021).

D. Schnelle-Walka and D. Dahl (2021). Intelligent Personal Assistant Architecture, Version 1.2, Draft Report of the Voice Interaction Community Group of the World Wide Web Consortium, July 2021.

JP. Lindenmayer and A. Khan, in collaboration with D. Suendermann-Oeft, D. Pautler, V. Ramanarayanan, S. Bashir, M. Parak, S. Ahmad, S. Prokop, T. Abad, S. Sevy, and C. Yavorsky (2021). Multimodal AI of Facial and Acoustic Biomarkers of Negative Symptoms, in proceedings of: 17th Annual Scientific Meeting of the International Society for CNS Clinical Trials and Methodology (ISCTM 2021), April 2021.

A. Anvar, D. Suendermann-Oeft, D. Pautler, V. Ramanarayanan, J. Kumm, J. Berry, R. Norel, E. Fraenkel, and I. Navar (2021). Towards A Large-Scale Audio-Visual Corpus for Research on Amyotrophic Lateral Sclerosis , in proceedings of: 73th Annual Meeting of the American Academy of Neurology (AAN 2021), Virtual, April 2021.

H. Kothare and V. Ramanarayanan (2020). Remote Monitoring of Respiratory Function Using a Cloud-Based Multimodal Dialogue System, 12th International Seminar on Speech Production (ISSP 2020), Providence, Rhode Island, USA, December 2020.

V. Ramanarayanan, O. Roesler, M. Neumann, D. Pautler, D. Habberstad, A. Cornish, H. Kothare, V. Murali, J. Liscombe, D. Schnelle-Walka, P. Lange, and D. Suendermann-Oeft (2020). Toward Remote Patient Monitoring of Speech, Video, Cognitive and Respiratory Biomarkers Using Multimodal Dialog Technology, in proceedings of: 21st Annual Conference of the International Speech Communication Association (Interspeech 2020), Shanghai, China, October 2020.

M. Neumann, O. Roesler, D. Suendermann-Oeft, and V. Ramanarayanan (2020). On the Utility of Audiovisual Dialog Technologies and Signal Analytics for Real-time Remote Monitoring of Depression Biomarkers, in proceedings of: 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020) Workshop on NLP for Medical Conversations, Seattle, USA, July 2020.

M. Eskenazi and T. Zhao, with contributions from P. Balakrishnan, J. Bigham, C. Busso, J. Callan, V. Chen, B. DiEugenio, M. Gasic, J. Gustafsson, J. Hirschberg, R. Hwa, A. Kerne, T. Korelsky, D. Litman, S. Mehri, R. Moore, L.P. Morency, M. Ostendorf, A. Raux, V. Reiser, W. Shen, A. Stent, D. Suendermann-Oeft, D. Traum, S. Ultes, C. Voss, and M. Walker (2020). Toward User-Oriented Agents: Research Directions and Challenges, NSF Future Directions Workshop Report, National Science Foundation, Pittsburgh, USA, May 2020.

D. Schnella-Walka (2020). The standardization of intelligent personal assistants, Speech Technology Magazine, February 21, 2020.

V. Ramanarayanan, D. Suendermann-Oeft, D. Pautler, O. Roesler, J. Liscombe, M. Neumann, D. Habberstad, and A. Cornish (2020). Leveraging Multimodal Dialog Technologies & AI/ML for Patient Health Diagnosis, Monitoring, and Intervention, in proceedings of: Motor Speech Conference, Santa Barbara, USA, February 2020.

D. Suendermann-Oeft, A. Robinson, A. Cornish, D. Habberstad, D. Pautler, D. Schnelle-Walka, F. Haller, J. Liscombe, M. Neumann, M. Merrill, O. Roesler, and R. Geffarth (2019). NEMSI: A Multimodal Dialog System for Screening of Neurological or Mental Conditions, in proceedings of: ACM International Conference on Intelligent Virtual Agents (IVA 2019), Paris, France, July 2019.

O. Roesler and D. Suendermann-Oeft (2019). Towards Visual Behavior Detection in Human-Machine Conversations, in proceedings of: International Conference on Activity and Behavior Computing (ABC 2019), Spokane, USA, April 2019.