Neural Networks Model Audience Reactions to Movies

Yisong Yue, Assistant Professor of Computing and Mathematical Sciences, and colleagues have created a new deep-learning software capable of assessing complex audience reactions to movies using the viewer's facial expressions. "Understanding human behavior is fundamental to developing AI [artificial intelligence] systems that exhibit greater behavioral and social intelligence. For example, developing AI systems to assist in monitoring and caring for the elderly relies on being able to pick up cues from their body language. After all, people don't always explicitly say that they are unhappy or have some problem," Professor Yue says. [Caltech story]