Brain Relies on Face Recognition Systems to Perceive Faces

People suffering from hemi-prosopometamophosia see distortions to the same half of a person's face regardless of how the face is viewed. The results demonstrate that the human visual system standardizes all the faces it perceives using the same process so they can be better compared to faces seen before. The new study is published in Current Biology.

Imagine if every time you looked at a face, one side of the face always appeared distorted as if it were melting, resembling a painting by Salvador Dal�. This is the case for people who have a rare condition known as hemi-prosopometamophosia (hemi-PMO), which makes looking at faces discomforting.

‘On seeing a face, the brain adjusts the representation of that face so it gets matched to faces stored in memory, just like computer face recognition systems. Aligning the perceived face with those in memory, helps to determine whether the face has been seen before.’

"Every time we see a face, the brain adjusts our representation of that face so its size, viewpoint, and orientation is matched to faces stored in memory, just like computer face recognition systems such as those used by Facebook and Google," explains co-author Brad Duchaine, a professor of psychological and brain sciences and the principal investigator of the Social Perception Lab at Dartmouth College. "By aligning the perceived face with faces stored in memory, it's much easier for us to determine whether the face is one we've seen before," he added.

Hemi-PMO is a rare disorder that may occur after brain damage. When a person with this condition looks at a face, facial features on one side of the face appear distorted. The existence of hemi-PMO suggests the two halves of the face are processed separately. The condition usually dissipates over time, which makes it difficult to study. As a result, little is known about the condition or what it reveals about how human face processing normally works.

The current study focused on a right-handed man in his early sixties ("Patient A.D.") with hemi-PMO whose symptoms have persisted for years. Like many with this condition, his distortions were caused by damage to a fiber bundle called the splenium that connects visual areas in the left hemisphere and right hemisphere of his brain.

Five years ago while A.D. was watching television, he noticed that the right halves of people's faces looked like they had melted. Yet, the left sides of their faces looked normal. He looked in the mirror at his own face and noticed that the right side of his reflection was also distorted. In contrast, A.D. sees no distortions in other body parts or objects.

The study involved two experiments. In the first, A.D. was presented with images of human faces and non-face images such as objects, houses and cars, and asked to report on distortions. For 17 of the 20 faces, he saw distortions. The distortions were always on the right side of the face and facial features usually appeared to drooped. For example, in one of the faces, A.D. reported that the right eye looked a lot bigger than the left eye while the right eyebrow, right side of the nose, and right side of the lips all hung down unnaturally.

Two of the face photographs that did not elicit a distortion showed right profile views in which the right side of the face was not visible. Consistent with his daily experiences, A.D. did not see distortions in any of the non-face images. These results show that his condition affects brain processes specialized for faces.

For the second part of the study, A.D. reported on distortions that he saw in 15 different faces that were presented in a variety of ways: in the left and right visual field, at different in-depth rotations, and at four picture plane rotations-- 0 degrees or upright, 90 degrees, 180 degrees or upside down, and 270 degrees.

Regardless of how the faces were presented, A.D. continued to report that the distortions affected the same facial features. For example, even when a face was presented upside down, A.D. still saw the facial features distorted on the right side of the face even though the distortion now appeared on the left-hand side of the stimulus (the red-shaded region in the faces in the reproduction of Figure 4E below).

The consistency of the location of A.D.'s distortion demonstrates that faces, regardless of viewpoint or orientation, are aligned to the same template similar to what computer face recognition systems do. In A.D.'s case, the output from that process is disrupted as it is passed from one brain hemisphere to the other due to his splenium lesion.

Source: Eurekalert