A recent study published in the journal Brain Research provides evidence that people recognize facial expressions faster and more accurately when viewing the entire face rather than just the eyes. The research suggests that while the eyes hold important social cues, the human brain relies heavily on the surrounding facial context to process and evaluate emotions efficiently.
In daily life, people rely heavily on nonverbal communication to understand the emotional states of those around them. The eye region tends to be a primary focus during these routine social interactions. Visual changes like furrowed eyebrows, wide-open eyelids, or small creases at the corners of the eyes communicate rich emotional information.
When people look at faces, they typically use configural processing. This concept refers to the brain’s ability to take in the whole face at once, understanding how all the different features relate to one another in a unified layout. When visual information is limited, the brain is forced to rely on featural processing, which involves analyzing individual parts like the eyes or nose separately.
Katherine A. Billetdeaux, a doctoral student in developmental psychology and social behavioral neuroscience at Penn State University, initiated this research while studying at the College of Wooster. She wanted to understand exactly how much weight the human brain gives to the eyes compared to the rest of the face.
“The idea stemmed from my experience during the COVID-19 pandemic, when all of my face-to-face interactions involved wearing a face mask,” Billetdeaux said. “I noticed how much harder it was to read certain facial expressions when the lower half of someone’s face was covered, which made communication feel less clear.”
“I also found myself wondering how people who don’t typically make eye contact would have navigated masked faces. That got me thinking about what facial information we actually rely on to recognize emotions and inspired me to investigate it more systematically.”
Billetdeaux noted that the project began as her undergraduate independent study thesis. “Getting to work through every stage of the research process firsthand, from design to data collection to analysis, gave me a much deeper understanding of what scientific inquiry actually looks like in practice,” she said.
“Not many undergraduates get the opportunity to see a project through to publication, and I am fortunate to be able to share my work with a larger audience,” Billetdeaux said. “More than anything, it confirmed that research is what I want to do, and it’s a big part of what motivated me to pursue a Ph.D. and continue this work.”
To explore these visual mechanisms, the researchers designed an experiment to test how taking away specific visual information changes expression recognition. They wanted to observe what happens in the brain when the eyes are slightly obscured compared to when the rest of the face is completely hidden. The primary goal was to track both behavioral accuracy and the underlying brain waves that occur during these specific visual tasks.
The authors recruited 40 undergraduate students for the experiment. The sample included 10 men, 29 women, and one non-binary individual. The participants had an average age of 19.4 years and were compensated with course credit for their time.
Each participant sat in front of a computer monitor to view a series of 480 photographs of faces. These photographs featured 30 different models expressing four specific emotions, which were anger, fear, happiness, and sadness. The researchers aligned the images precisely so the eyes and nose appeared in the same spot on the screen, minimizing sudden eye movements.
The scientists manipulated the digital images to create four distinct viewing conditions. In the first condition, the entire face was visible and completely unaltered. In the second condition, the entire face was visible, but the eyes were diminished using a white rectangle with 20 percent transparency to blur the finer details.
In the third condition, the researchers showed only the intact eyes while hiding the rest of the face behind a solid white mask with zero percent transparency. Finally, the fourth condition showed only the eyes, but those isolated eyes were also obscured by the semi-transparent blur, creating a sliding scale of visual degradation.
Participants were instructed to identify the emotion shown on the screen as quickly as possible by pressing specific buttons on a computer keyboard. Before the main experiment, participants completed practice runs to learn which fingers corresponded to which emotion buttons. During the actual test, each face remained on the screen until the participant made their choice.
As the participants completed the recognition task, the researchers recorded their brain activity using an electroencephalogram. This specialized machine uses non-invasive sensors placed on the scalp to measure tiny electrical signals produced by the brain. The scientists specifically looked at event-related potentials, which are distinct spikes or dips in brain electrical activity that happen in response to a specific visual event.
They measured an early brain wave known as the N170. This specific electrical signal occurs roughly 170 milliseconds after a person sees a face. The size and speed of this wave reflect the brain’s initial structural processing of the visual image.
The researchers also measured two later brain waves, known as the P300 and the late positive potential. These electrical signals typically occur between 250 and 800 milliseconds after seeing an image. They indicate higher-level brain processes, such as paying close attention, evaluating the meaning of the image, and processing emotional importance.
The behavioral results demonstrated that participants were most accurate and had the fastest reaction times when they could see the entire face. Taking away the context of the face caused participants to make significantly more mistakes and take longer to answer. Similarly, diminishing the details of the eyes led to slower and less accurate responses compared to when the eyes were fully visible.
“The key takeaway is that both the eye region and the surrounding face are important for how we process facial expressions; but the eyes play an especially critical role when we’re experiencing internal responses to the emotion we’re seeing,” Billetdeaux said. “We also found that different types of expressions aren’t all processed the same way, so the picture is more nuanced than a simple ‘eyes matter most’ conclusion.”
The recorded brain waves supported these behavioral observations. When participants viewed a full face, the early structural brain wave was smaller and occurred faster. This provides evidence that the brain exerts less effort to process an emotion when all facial features are present together.
When participants saw only the eyes without the surrounding face, this early brain wave grew larger and slower. This suggests that the brain works much harder to structure and understand a face when the overall configuration is missing. Interestingly, blurring the eyes only disrupted this early processing step when the rest of the face was hidden.
“The most surprising finding was that diminishing the eye region affected different stages of brain processing depending on whether the rest of the face was visible,” Billetdeaux told PsyPost. “In other words, the brain doesn’t process emotional information from the eyes in isolation: the surrounding facial context actually changes how that information is handled. That kind of interaction between facial features wasn’t something we fully anticipated.”
The later brain waves told a slightly different story regarding how the brain evaluates the emotional meaning of a face. These later electrical signals were larger when the eyes were blurred, but only when the rest of the face was visible. This suggests that once the brain completes its initial structural scan, it specifically looks to the details of the eyes to fully evaluate the emotion.
The authors also found that different emotions rely on different facial features. Anger was recognized easily regardless of whether the whole face was shown or just the eyes. This suggests that angry expressions are highly concentrated in the eye region and require less surrounding context.
Fearful faces proved to be the most difficult to recognize when the surrounding facial context was hidden. When participants viewed only the eyes of a fearful face, their brain activity spiked significantly, indicating a very high level of cognitive effort. This tends to suggest that a wide-open mouth or other lower facial features might be necessary to easily recognize fear.
Happiness was identified much faster and more accurately when the entire face was visible. Because happy expressions usually feature a prominent smile, the mouth seems to provide the strongest signal for this particular emotion. Sadness was processed relatively easily compared to fear, providing evidence that sad expressions are strongly communicated through the eyes.
While the study offers detailed insights into social perception, there are a few limitations to consider. The technique used to obscure the eyes altered the contrast and transparency of the image rather than precisely filtering out specific visual frequencies. This makes it difficult to separate exactly which visual properties caused the observed changes in brain activity.
“One technical caveat worth noting is that we can’t say with certainty why diminishing the eyes had the effects it did,” Billetdeaux said. “The manipulation altered the contrast and opacity, which resembles lowering spatial frequency but isn’t the same thing.”
In visual science, spatial frequency refers to the level of sharp detail present in an image. “Spatial frequency and contrast/opacity are distinct visual properties, and the brain may process them differently,” Billetdeaux added. “Investating the exact mechanism would require systematically comparing different ways of obscuring the eye region.”
The study also did not measure the emotional intensity or arousal levels of the photographs. It is possible that some faces evoked stronger general excitement or alertness than others, which might have influenced the brain wave recordings. Future research might benefit from scaling the intensity of the emotions to see how arousal interacts with facial recognition.
Another limitation relates to the experimental setup, which required participants to explicitly focus on identifying emotions. These findings might not apply to everyday situations where people process facial expressions naturally and without direct instruction. Future studies could explore how the brain reacts to these facial cues when the person is distracted or focused on a different task.
Billetdeaux hopes to expand on these findings using functional magnetic resonance imaging, or fMRI, which tracks blood flow to reveal active areas of the brain. “One major next step is to use fMRI, which would tell us where in the brain this processing is happening,” Billetdeaux said. “This would complement the when that our current ERP method revealed.”
“I’m also interested in exploring how these processes work in clinical populations with difficulties in social communication, such as autistic individuals,” Billetdeaux said. “Ultimately, I hope this research can help inform intervention strategies to improve social communication for everyone, not just those with a formal diagnosis.”
The study, “Are the eyes the window to the soul? The importance of the eyes in facial expression recognition,” was authored by Katherine A. Billetdeaux and Grit Herzmann.
Leave a comment
You must be logged in to post a comment.