Modality Platform

MODALITY PLATFORM / PARKINSON'S DISEASE / HUNTINGTON DISEASE  |  38th Annual AAAI Conference on Artificial Intelligence (8th International Workshop On Health Intelligence) 2024

On The Feasibility of Multimodal Dialog Based Remote Balance Assessment

N. Sukhdev, O. Roesler, M. Neumann, M. Bartlett, D. Habberstad and V. Ramanarayanan

MODALITY PLATFORM / PARKINSON'S DISEASE / HUNTINGTON DISEASE  |  Motor Speech Conference 2024

Multimodal Dialog Based Remote Assessment of Balance in Parkinson’s Disease and Other Movement Disorders

N. Sukhdev, O. Roesler, M. Neumann, S. Desai, I. Shoulson and V. Ramanarayanan

MODALITY PLATFORM  |  INTERSPEECH 2023

When Words Speak Just as Loudly as Actions: Virtual Agent Based Remote Health Assessment Integrating What Patients Say with What They Do

V. Ramanarayanan, D. Pautler, L. Arbatti, A. Hosamath, M. Neumann, H. Kothare, O. Roesler, J. Liscombe, A. Cornish, D. Habberstad, V. Richter, D. Fox, D. Suendermann-Oeft and I. Shoulson

MODALITY PLATFORM / PARKINSON'S DISEASE  |  arXiv 2023 

What Do Patients Say About Their Disease Symptoms? Deep Multilabel Text Classification With Human-in-the-Loop Curation for Automatic Labeling of Patient Self Reports of Problems. 

L. Arbatti, A. Hosamath, V. Ramanarayanan, and I. Shoulson 

MCI / MODALITY PLATFORM  | International Workshop on Spoken Dialog Systems 2023

Towards Integrating Eye-Gaze Tracking Into A Multimodal Dialog Agent For Remote Patient Assessment

D. Tisdale, J. Liscombe, D. Pautler and V. Ramanarayanan

R&D / MODALITY PLATFORM  | International Workshop on Spoken Dialog Systems 2023

Pathology-Specific Settings For Voice Activity Detection in a Multimodal Dialog Agent For Digital Health Monitoring 

J. Liscombe, H. Kothare, M. Neumann, D. Pautler, and V. Ramanarayanan

DEPRESSION / MODALITY PLATFORM  | International Workshop on Spoken Dialog Systems 2023

Impact of Synthetic Voice and Avatar Animation on The Usability of a Dialogue Agent for Digital Health Monitoring

H. Kothare, D. Habberstad, M. Neumann, S. White, D. Pautler and V. Ramanarayanan

PARKINSON'S DISEASE / MODALITY PLATFORM  | International Conference on Multimodal Interaction (ICMI) 2022

Exploring Facial Metric Normalization For Within- and Between-Subject Comparisons in a Multimodal Health Monitoring Agent

O. Roesler, H. Kothare, W. Burke, M. Neumann, J. Liscombe, A. Cornish, D. Habberstad, D. Pautler, D. Suendermann-Oeft and V. Ramanarayanan

MODALITY PLATFORM  |  International Workshop on Spoken Dialog Systems (IWSDS) 2021

Voice Activity Detection in Dialog Agents for Dysarthric Speakers

J. Liscombe, H. Kothare, M. Neumann, A. Ocampo, O. Roesler, D. Habberstad, A. Cornish, D. Pautler, D. Suendermann-Oeft and V. Ramanarayanan

R&D / MODALITY PLATFORM  |  12th International Seminar on Speech Production (ISSP) 2020

Remote Monitoring of Respiratory Function Using a Cloud-Based Multimodal Dialogue System

H. Kothare and V. Ramanarayanan

R&D / MODALITY PLATFORM  |  21st Annual Conference of the International Speech Communication Association (Interspeech) 2020

Toward Remote Patient Monitoring of Speech, Video, Cognitive and Respiratory Biomarkers Using Multimodal Dialog Technology

V. Ramanarayanan, O. Roesler, M. Neumann, D. Pautler, D. Habberstad, A. Cornish, H. Kothare, V. Murali, J. Liscombe, D. Schnelle-Walka, P. Lange, and D. Suendermann-Oeft

SYSTEM  |  Draft Report of the Voice Interaction Community Group of the World Wide Web Consortium 2021

Intelligent Personal Assistant Architecture, Version 1.2

D. Schnelle-Walka and D. Dahl

SYSTEM  |  NSF Future Directions Workshop Report, National Science Foundation 2020

Toward User-Oriented Agents: Research Directions and Challenges

M. Eskenazi and T. Zhao, with contributions from P. Balakrishnan, J. Bigham, C. Busso, J. Callan, V. Chen, B. DiEugenio, M. Gasic, J. Gustafsson, J. Hirschberg, R. Hwa, A. Kerne, T. Korelsky, D. Litman, S. Mehri, R. Moore, L.P. Morency, M. Ostendorf, A. Raux, V. Reiser, W. Shen, A. Stent, D. Suendermann-Oeft, D. Traum, S. Ultes, C. Voss, and M. Walker

SYSTEM  |  Speech Technology Magazine 2020

The standardization of intelligent personal assistants

D. Schnella-Walka

SYSTEM  |  ACM International Conference on Intelligent Virtual Agents (IVA) 2019

NEMSI: A Multimodal Dialog System for Screening of Neurological or Mental Conditions

D. Suendermann-Oeft, A. Robinson, A. Cornish, D. Habberstad, D. Pautler, D. Schnelle-Walka, F. Haller, J. Liscombe, M. Neumann, M. Merrill, O. Roesler, and R. Geffarth

SYSTEM  |  International Conference on Activity and Behavior Computing (ABC) 2019

Towards Visual Behavior Detection in Human-Machine Conversations

O. Roesler and D. Suendermann-Oeft