Modality Platform

MODALITY PLATFORM  |  INTERSPEECH 2023


When Words Speak Just as Loudly as Actions: Virtual Agent Based Remote Health Assessment Integrating What Patients Say with What They Do


V. Ramanarayanan, D. Pautler, L. Arbatti, A. Hosamath, M. Neumann, H. Kothare, O. Roesler, J. Liscombe, A. Cornish, D. Habberstad, V. Richter, D. Fox, D. Suendermann-Oeft and I. Shoulson

MCI / MODALITY PLATFORM  | International Workshop on Spoken Dialog Systems 2023


Towards Integrating Eye-Gaze Tracking Into A Multimodal Dialog Agent For Remote Patient Assessment


D. Tisdale, J. Liscombe, D. Pautler and V. Ramanarayanan

R&D / MODALITY PLATFORM  | International Workshop on Spoken Dialog Systems 2023


Pathology-Specific Settings For Voice Activity Detection in a Multimodal Dialog Agent For Digital Health Monitoring 


J. Liscombe, H. Kothare, M. Neumann, D. Pautler, and V. Ramanarayanan

DEPRESSION / MODALITY PLATFORM  | International Workshop on Spoken Dialog Systems 2023


Impact of Synthetic Voice and Avatar Animation on The Usability of a Dialogue Agent for Digital Health Monitoring


H. Kothare, D. Habberstad, M. Neumann, S. White, D. Pautler and V. Ramanarayanan

PARKINSON'S DISEASE / MODALITY PLATFORM  | International Conference on Multimodal Interaction (ICMI) 2022


Exploring Facial Metric Normalization For Within- and Between-Subject Comparisons in a Multimodal Health Monitoring Agent


O. Roesler, H. Kothare, W. Burke, M. Neumann, J. Liscombe, A. Cornish, D. Habberstad, D. Pautler, D. Suendermann-Oeft and V. Ramanarayanan

MODALITY PLATFORM  |  International Workshop on Spoken Dialog Systems (IWSDS) 2021


Voice Activity Detection in Dialog Agents for Dysarthric Speakers


J. Liscombe, H. Kothare, M. Neumann, A. Ocampo, O. Roesler, D. Habberstad, A. Cornish, D. Pautler, D. Suendermann-Oeft and V. Ramanarayanan

R&D / MODALITY PLATFORM  |  12th International Seminar on Speech Production (ISSP) 2020


Remote Monitoring of Respiratory Function Using a Cloud-Based Multimodal Dialogue System


H. Kothare and V. Ramanarayanan

R&D / MODALITY PLATFORM  |  21st Annual Conference of the International Speech Communication Association (Interspeech) 2020


Toward Remote Patient Monitoring of Speech, Video, Cognitive and Respiratory Biomarkers Using Multimodal Dialog Technology


V. Ramanarayanan, O. Roesler, M. Neumann, D. Pautler, D. Habberstad, A. Cornish, H. Kothare, V. Murali, J. Liscombe, D. Schnelle-Walka, P. Lange, and D. Suendermann-Oeft

SYSTEM  |  Draft Report of the Voice Interaction Community Group of the World Wide Web Consortium 2021


Intelligent Personal Assistant Architecture, Version 1.2


D. Schnelle-Walka and D. Dahl

SYSTEM  |  NSF Future Directions Workshop Report, National Science Foundation 2020


Toward User-Oriented Agents: Research Directions and Challenges


M. Eskenazi and T. Zhao, with contributions from P. Balakrishnan, J. Bigham, C. Busso, J. Callan, V. Chen, B. DiEugenio, M. Gasic, J. Gustafsson, J. Hirschberg, R. Hwa, A. Kerne, T. Korelsky, D. Litman, S. Mehri, R. Moore, L.P. Morency, M. Ostendorf, A. Raux, V. Reiser, W. Shen, A. Stent, D. Suendermann-Oeft, D. Traum, S. Ultes, C. Voss, and M. Walker

SYSTEM  |  Speech Technology Magazine 2020


The standardization of intelligent personal assistants


D. Schnella-Walka

SYSTEM  |  ACM International Conference on Intelligent Virtual Agents (IVA) 2019


NEMSI: A Multimodal Dialog System for Screening of Neurological or Mental Conditions


D. Suendermann-Oeft, A. Robinson, A. Cornish, D. Habberstad, D. Pautler, D. Schnelle-Walka, F. Haller, J. Liscombe, M. Neumann, M. Merrill, O. Roesler, and R. Geffarth

SYSTEM  |  International Conference on Activity and Behavior Computing (ABC) 2019


Towards Visual Behavior Detection in Human-Machine Conversations


O. Roesler and D. Suendermann-Oeft