VocSyl: Real-Time Multisyllabic Speech Visualization

VocSyl is a real-time audio visualization system for use within a clinical speech-therapy setting. To teach multisyllabic speech production, we visualize changes in syllables, timing (speed), tone (pitch) and emphasis (volume).
Joshua Hailpern

ACES: Aphasia Emulation Software

We introduce a novel system and model, called Aphasia Characteristics Emulation Software (ACES), that enables users to experience the speech-distorting effects of aphasia. This model adheres to the wealth of literature in language distortions resulting from aphasia.
Joshua Hailpern

YouPivot: finding your digital car keys

Have you ever thought, "Where is that PDF or Website I was looking at the other day? I don't remember it's name, but I was listening to AC/DC while I was reading it." Until YouPivot, you cannot search your computer this way. YouPivot is a new search technique, grounded in cognitive psychology, that lets you search on contextual cues!
Joshua Hailpern

The Clotho Project: Predicting Application Utility

When using the computer, each user has some notion that "these applications are important" at a given point in time. Existing techniques fail to identify at least 57% of these applications. Our work directly associates measurable computer interaction (CPU consumption, window area, etc.) with the user’s perceived application utility/importance without identifying task.
Joshua Hailpern

Understanding Deja Reviewers

People who review products on the web invest considerable time in what they write. So why would someone write a review that restates earlier ones? This work is a mixed-method study of deja reviewers, latecomers who echo what other people said.
Eric Gilbert

Photo Khipu

Photo Khipu provides a "metaphotograph" of digital photo collections by visualizing album, date, and social information. This work serves as an evocative display for the home.
Kora Bongen

Predicting Tie Strength

Social media treats all users the same: trusted friend or total stranger. In reality, relationships fall everywhere along this spectrum. Our work bridges this gap between theory and practice by building a model that maps social media data to tie strength.
Eric Gilbert

Conversation Clusters

Conversation Clusters demonstrates means to capture topics from live conversation. Combined with human input, this technique creates a bridge between human understanding and computational techinques of modeling language.
Tony Bergstrom

VoiceSpace

Visualizing audio content from remote conversations can be used as an artifact of the conversation. VoiceSpace explores user reactions to visualizing audio for archival and memory.
Pooja Mathur

A3: A Coding Guideline for HCI+Autism Research using Video Annotation.

A3 (pronounced A-Cubed) or Annotation for ASD Analysis, define and operationalize a set of dependent variables which are ideal for the examination and evaluation (through Video Annotation) of the behavior of subjects with ASD who interact with technology.
Joshua Hailpern

Visual Remote Conversations

The number of face to face conversations is consistently decreasing as new technologies increasingly available. We attempt to add back some of the nonverbal information lost with the addition of visual cues.
Pooja Mathur, Tony Bergstrom

Spoken Impact Project: Audio and Visual Feedback for Children with Autistic Spectrum Disorder.

We explore how audio and visual feedback can encourage speech and vocalization in children with Autistic Spectrum Disorder (ASD).
Joshua Hailpern

Designing a Better Energy Consumption Indicator

Rethinking how we can visualize energy consumption to homeowners using multiple levels of disaggregated goal-based feedback, including real-time, historical, and community comparisons
Erik Hinterbichler

The Network in the Garden: Social Media in Rural Life

Empirical analysis of behavioral differences between over 3,000 rural and urban social media users.
Eric Gilbert

VCode and VData

VCode and VData are two new free tools to facilitate annotation and agreement calculations for Video. They are optimized for the annotation workflow, thus helping to provide accuracy and reliability.
Joshua Hailpern & Joey Hagedorn

Conversation Votes

Conversation Votes allows non-speaking participants an opportunity to augment and annotate a social mirror of conversation. This table visualization gives a voice to quiet comments.
Tony Bergstrom

Isochords

Isochords is a visualization of music focused upon the consonat intervals. Visually, it emphasizes chord structures and modulation to aid the understanding of chord quality, chord progressions, modulations, etc.
Tony Bergstrom

Ginger

Ginger extended the forms of Chit Chat Club to explore abstracted visual interaction to communicate social cues. Ginger provides a physical avatar to allowing people to interact in mixed virtual and physical environments.
Tony Bergstrom and Matthew Yapchaian

Conversation Clock

Conversation Clock seeks to augment developing dialog by displaying a representation of conversation to all present. The table demonstrates turn-taking, domination, interruption and activity throughout a conversation.
Tony Bergstrom

Portal Frame

Portal Frame provides a low maintanence means to foster social bonds. Based upon context aware devices, Portal Frame creates a constantly updating image indicative of the user's activity.
Tony Bergstrom

TextTone

A versatile and flexible way of expressing tone and emotion in online chat.
Ankur Kalra