Chapter 6: Attention and Visual Perception        

In this chapter, we will consider the relationship between attention and visual perception. To begin, let's explore Visual Search Tasks, which are commonly used in the study of attention and perception and serve as an apt introduction to the way attention operates in complex visual environments.

Visual Search Tasks: Seeking a Needle in the Haystack

Imagine you're at a bustling carnival, trying to find your friend in a lively crowd. The scenario might remind you of playing "Where's Waldo?" as a child, where the goal is to spot Waldo, a distinctive character, hidden amidst a sea of people dressed in various colors and patterns. If Waldo were the only person in the crowd wearing a red and white striped shirt while everyone else sported solid black attire, finding him would be relatively effortless. This scenario exemplifies the essence of a visual search task.

Visual Search refers to our innate ability to locate a specific target item within a visual field containing numerous distractors. Whether it's finding a friend at a carnival or identifying a familiar face in a crowded room, visual search tasks are an integral part of our everyday lives.

In the example of locating your friend, the red and white striped shirt becomes the "feature" that distinguishes your friend from the rest of the crowd, who are all wearing black. This type of search, known as a feature search, is characterized by the presence of a single distinctive feature (color, shape, or orientation) that sets the target apart from the distractors. Our visual system can efficiently detect this unique feature, guiding our attention to the target.

However, not all visual searches are as straightforward as spotting Waldo's distinct shirt. In more complex scenarios, we may need to perform what's called a conjunction search, where we're looking for a combination of features. For instance, finding your friend in a crowd where everyone has varying clothing colors and patterns becomes a more challenging task, akin to searching for a particular item in a cluttered scene.

In a conjunction search, our attention must bind together multiple features (e.g., color and shape) to identify the target accurately. This process demands more cognitive effort and time compared to a feature search (Treisman & Gelade, 1980).

Figure 6.1

In visual search tasks people search for a target embedded in distractors

"Infield @ the Kentucky Derby" by MCHart is licensed under CC BY 2.0

Anne Treisman's Feature Integration Theory: The Glue of Visual Perception

Anne Treisman's theory posits that our attention plays a crucial role in binding visual features together (Treisman & Gelade, 1980). Imagine you're searching for a yellow tennis ball in a pile of green tennis balls. In this scenario, the yellow color serves as the distinctive feature of your target. If there is only one yellow item then this feature guides your attention, allowing you to pick it out effortlessly.

Feature Integration Theory suggests that when we search for a target defined by a single feature (like color), our attention efficiently detects that feature when none of the distractors share this visual feature. Here the time to find the target will not increase as the number of distractors increases. However, when the target is not unique on any single visual feature then we're dealing with a conjunction search where we must combine multiple features (e.g., color and shape). This would happen if you were searching for one yellow tennis ball in a pile of yellow lemons and green tennis balls. In this situation our attention becomes the "glue" that binds features (color and shape) together. Since feature binding takes time to complete reaction times to find the target will linearly increase as the number of distractors in the display increases (Treisman & Gelade, 1980).  This can be seen in the Figure below (see Figure 6.2).

Figure 6.2

Examples of feature search and conjunction search tasks. In a feature search (left), participants search for a red X among black X distractors. Because the target differs from all distractors by a single feature (color), reaction time remains relatively constant as the number of distractors increases. In a conjunction search (right), participants search for a red X among red Os and black Xs. Because the target is defined by the conjunction of color and shape, reaction time increases approximately linearly with the number of distractors. The graph illustrates the characteristic flat search slope for feature search and the positive search slope for conjunction search.

"Feature and Conjunction Search" by Kahan, T.A. is licensed under CC BY-NC-SA 4.0

More recent research has expanded on Feature Integration Theory by proposing that visual search is guided by both the physical characteristics of objects (bottom-up processing) and our goals or expectations (top-down processing). Jeremy Wolfe's Guided Search model suggests that attention is directed toward locations in the visual field that are most likely to contain the target, making many conjunction searches more efficient than originally predicted by Feature Integration Theory (Wolfe, 1994).

Inattentional Blindness: The Gorilla in the Midst

Now that we've explored how attention plays a vital role in visual search tasks, let's look into another intriguing phenomenon called Inattentional Blindness. Inattentional blindness is the failure to consciously notice an unexpected object or event that is plainly visible because attention is focused on another task or aspect of the environment (Mack & Rock, 1998). This phenomenon highlights the idea that attention is crucial for perception.

One of the earliest demonstrations of inattentional blindness was conducted by psychologists Arien Mack and Irvin Rock (1998). Participants were instructed to focus on judging which arm of a briefly presented cross was longer (horizontal or vertical) while ignoring everything else on the screen. The cross was shown rapidly and was followed by a visual masking pattern of noise. On a critical trial, an unexpected object, such as a small square or another geometric shape, appeared near the cross. Even though the unexpected object was clearly visible, many participants failed to report seeing it because their attention was devoted to the primary task. Mack and Rock coined the term inattentional blindness to describe this remarkable failure to notice an unexpected object that is in plain sight when attention is engaged elsewhere. Their work demonstrated that simply looking at something does not guarantee that we consciously perceive it.

This effect can also happen in the real world. Imagine you're watching one team closely in a basketball game (perhaps a team wearing white shirts). As you focus intently on the game, you may fail to notice a person in a gorilla suit casually strolling through the basketball court, right in the middle of the action. This startling oversight is a classic example of inattentional blindness (Simons & Chabris, 1999).

More recent research has examined whether highly familiar objects are more likely to overcome inattentional blindness. For example, Yifan Ding and colleagues investigated whether people would be more likely to notice the flag of their own country when it unexpectedly appeared in the background of a study similar to Mack and Rock (Ding et al., 2024). Participants from different countries viewed displays in which either their own national flag or a foreign flag appeared as an unexpected object. Surprisingly, participants were no more likely to notice their own country's flag than a less familiar foreign flag. Similar results were found using familiar and unfamiliar company logos. These findings suggest that objects with personal meaning or familiarity may not reliably overcome inattentional blindness. When our attention is engaged elsewhere, familiarity alone does not appear to be enough to bring an unexpected object into conscious awareness.

Although inattentional blindness demonstrates that people are often unaware of unattended objects, this does not necessarily mean that unattended information receives no processing. Cathleen Moore and Howard Egeth tested this question by asking participants to perform a line-length judgment task similar to other studies in this area. However, while participants focused on deciding which of two lines was longer, the background contained a pattern of dots that, if perceptually organized, created illusions (e.g., the Ponzo illusion). Afterward, participants were generally unable to report the organization of the background pattern, indicating that they had not consciously perceived it. Nevertheless, the background illusion systematically biased their judgments of line length. In other words, even though participants were unaware of the background, their perception of the foreground lines was influenced by it. These findings suggest that some aspects of unattended visual information, such as perceptual grouping, can occur outside of conscious awareness and still influence perception (Moore & Egeth, 1997). The results provide evidence that inattentional blindness does not imply a complete absence of visual processing, but rather a lack of conscious awareness of that processing.

Inattentional blindness occurs when we are so absorbed in one task or aspect of our visual environment that we completely miss something unexpected and unrelated that is plainly visible. The gorilla in the basketball scenario exemplifies how we can be blind to information that doesn't align with our current focus.

Change Blindness: Failing to Detect Changes in the Environment

Continuing our exploration of attention's impact on perception, let's discuss another intriguing phenomenon known as change blindness. Change blindness refers to our surprising inability to detect changes in the visual environment, even when those changes are large or occur directly in front of us (Rensink, O'Regan, & Clark, 1997; Simons & Levin, 1997). This phenomenon demonstrates that our perception of the world is not a complete picture. Instead, our awareness appears to be somewhat limited.

It is important to distinguish change blindness from simply having poor eyesight. People experiencing change blindness can see the objects in the scene perfectly well. The problem is not seeing the objects themselves—it is noticing that something has changed. Change blindness therefore reflects a limitation in attention and visual awareness rather than a limitation in vision.

One of the earliest demonstrations of change blindness was conducted by vision researcher John Grimes in the mid-1990s. Using an eye-tracking system, Grimes programmed changes to occur while participants made saccades (Grimes, 1996). Saccades are rapid eye movements that we make when shifting our gaze from one object to another. In one memorable demonstration, participants viewed a picture of a cowboy, and while they made a saccade, the cowboy's head was replaced with a different one. Although this change was obvious to anyone watching the display from across the room, participants frequently failed to notice it because the change occurred during their own eye movement. Since the brain briefly suppresses visual processing during a saccade, the visual system did not register the change. Grimes's work provided some of the first compelling evidence that our perception of the visual world is less complete than it feels and that a dramatic change can go unnoticed if this occurs at the right moment. Grimes's experiments were important because they challenged the common intuition that we perceive every detail of the visual world continuously. Instead, they suggested that our perception is constructed from brief snapshots of visual information gathered between eye movements. Although our experience feels seamless, there are brief moments during which visual information is simply not available to consciousness.

To understand why this happens, it is important to know what a saccade is. A saccade is a rapid, ballistic movement of the eyes that occurs when we shift our gaze from one location to another, such as when reading from one word to the next or looking from one object to another. During a saccade, the brain briefly suppresses visual processing, a phenomenon known as saccadic suppression (Volkmann, 1986). As a result, we do not consciously perceive the blur created by our moving eyes. You can experience this yourself by looking into a mirror and trying to watch your own eyes move if you shift the focus rapidly from one eye to the other. Although another person can easily see your eyes moving, you cannot see your own eyes in motion because your brain suppresses visual input during the saccade (Note: This demonstration does not work using your selfie-mode in your phone's camera because there is a slight delay between your movements and the image displayed on the screen. To observe the effect accurately, use a real mirror instead.) If a change occurs in the environment during a saccade, you are surprisingly unlikely to notice it, resulting in change blindness.

Researchers later developed an even simpler method for studying change blindness called the flicker paradigm, which does not require an eye-tracking system. In this method, two nearly identical images alternate back and forth, with a brief blank screen inserted between them (Rensink et al., 1997). One image contains a small change—for example, a building may be missing a window or a car may change color. The brief blank screen eliminates the visual motion signal that would normally draw attention to the change (this is very much like a spot the difference game that might appear in a magazine or newspaper; see Figure 6.3). The flicker paradigm demonstrated that change blindness is not limited to changes that occur during eye movements. Instead, it showed that people rely heavily on visual transients (like motion, onsets, or offsets) to detect differences in a scene. When those signals are removed, our ability to notice changes is dramatically reduced. The flicker paradigm quickly became one of the most widely used laboratory methods for studying change blindness because it is simple to administer and produces highly reliable results. It also allows researchers to systematically manipulate the size, location, and importance of changes to better understand the conditions under which people detect (or fail to detect) changes in a scene.

A classic real-world demonstration of change blindness was conducted by Daniel J. Simons and Daniel T. Levin (1998). Imagine that you are walking across a college campus when a stranger approaches and asks for directions. As you are talking, several people carrying a large door walk between you and the stranger, briefly blocking your view. While the door passes between the two of you, the original stranger is secretly replaced by one of the people who had been carrying the door. Once the door has passed, you continue the conversation with someone else. Most people believe they would immediately notice such a dramatic change, especially because they were paying attention to the person asking for directions. However, Simons and Levin found that many participants failed to detect the substitution. The finding that people are often “blind” to their own propensity for change blindness is called change blindness blindness (Levin et al., 2000).

Figure 6.3

Example of the flicker paradigm used to study change blindness. Image A and Image B are identical except for a single small change. During the experiment, the images alternate repeatedly with a brief blank screen inserted between them. People often have difficulty detecting the change in experiments of this sort, illustrating the phenomenon of change blindness.

"Flicker Task” by Kahan, T.A. is licensed under CC BY-NC-SA 4.0

These studies illustrate an important point about attention and perception. Although attention helps us process information that is relevant to our current goals, it does not guarantee that we will notice every change in our surroundings. Our visual system creates the impression that we perceive the world in rich detail at all times, but in reality, our awareness is limited by both where our attention is directed and when visual information is available for processing. As a result, even large and obvious changes can go unnoticed when they occur during moments when visual information is briefly unavailable, such as during a saccade, or when our attention is focused elsewhere.

The Attentional Blink: Blink and You'll Miss It

Our journey through attention and visual perception would be incomplete without discussing the Attentional Blink, an intriguing cognitive phenomenon that provides insights into how quickly we can allocate our attention to rapidly presented information (Raymond et al., 1992).

Imagine you're watching a rapid sequence of images, and your task is to identify specific targets within this sequence. For instance, you're asked to find a fruit (an apple or a banana) and then a timepiece (either a digital or an analog watch). These targets appear in quick succession.

What researchers have discovered is that after successfully identifying the first target (T1) (e.g., the apple), there's a notable tendency to miss the second target (T2) (e.g., the digital watch) if it follows closely behind. This phenomenon is termed the "attentional blink." However, when T2 is presented immediately after T1 accuracy is often quite high (known as "Lag 1 sparing") (Visser et al., 1999). Two theories have been proposed to explain lag 1 sparing and the attentional blink results.

In the attentional gate theory attention is viewed as a gate that lets T1 pass through. When T1 enters through the gate we close the gate to process the item. If T2 is shown immediately after T1 it gets through our attentional gate and is processed along with T1. However, if T2 appears at a slight delay it is blocked from entry and T2 stimuli are missed until the gate reopens (Chun & Potter, 1995).

The temporary loss of control theory proposes that attention is allocated to the target category but when we encounter a distractor the system's control over its attentional focus is momentarily weakened (Di Lollo et al., 2005). This disruption in attentional focus disrupts processing and T2 may be missed until our focus on the task is restored.

These two explanations make different predictions of what will happen when people are presented with more than two targets. For example, if people are looking for letters and are shown the following sequences: 14589R7J04723 vs. 14589RAJ04723 (these items would be shown one at a time: 1 followed by 4, followed by 5, followed by 8, etc.) performance at recognizing the "J" should differ depending on whether a letter had preceded this (second example where A is presented before the J) or whether a number had preceded this (first example where 7 is presented before the J). The gate theory predicts no difference between these examples since the J follows the R by the same duration. The results show that performance is worse when a distractor (7) precedes T2 as predicted by the temporary loss of control theory (i.e., accuracy at identifying the “J” is worse in the first example where it follows a 7 than the second example where it follows a A) (Di Lollo et al., 2005).

The attentional blink highlights the limitations of our attentional capacity when it comes to rapidly processing and identifying multiple targets in a short timeframe. It reveals that there is a brief period during which our attention seems to be momentarily "blinded" or unavailable for processing subsequent information.

Cultural Differences in Attention and Perception

Research by Richard Nisbett and colleagues has shown that East Asian participants tend to have a more holistic cognitive style, while Westerners lean toward an analytic style(Nisbett et al., 2001). These cognitive differences manifest in how individuals process visual scenes. Western participants typically focus on prominent objects, while East Asian participants pay more attention to the background context and relationships between objects and the background (Masuda & Nisbett, 2001). These differences have been observed in various experiments, such as describing vignettes and change blindness tasks where Westerners were better able to detect changes to focal objects than contextual objects but the opposite was true for East Asian participants (Masuda & Nisbett, 2006). Nisbett suggests that East Asian participants may have broader attentional foci and excel in encoding spatial relationships and detecting changes in contextual aspects of scenes, while Western participants may excel when finding changes in focal objects.

Conclusion

In conclusion, this chapter shows how attention shapes our perception, enabling us to excel in visual search tasks, yet also revealing the limitations of our awareness in phenomena like inattentional blindness, change blindness, and the attentional blink. Anne Treisman's Feature Integration Theory has provided us with a valuable framework for understanding how our attention binds together the rich tapestry of visual features that surround us. As we navigate our complex visual world, it becomes increasingly clear that attention is not merely a passive spotlight; it is an active mechanism that integrates visual information, blocks distraction, and may have temporal limitations.

References

Chun, M. M., & Potter, M. C. (1995). A two-stage model for multiple target detection in rapid serial visual presentation. Journal of Experimental Psychology: Human Perception and Performance, 21(1), 109–127. https://doi.org/10.1037/0096-1523.21.1.109

Di Lollo, V., Kawahara, J., Ghorashi, S. M. S., & Enns, J. T. (2005). The attentional blink: Resource depletion or temporary loss of control? Psychological Research, 69(3), 191–200. https://doi.org/10.1007/s00426-004-0173-x

Ding, Y., Simons, D. J., Hults, C. M., & Raja, R. (2024). Are familiar objects more likely to be noticed in an inattentional blindness task? Journal of Cognition, 7(1): 28, 1–15. https://doi.org/10.5334/joc.352

Grimes, J. (1996). On the failure to detect changes in scenes across saccades. In K. Akins (Ed.), Perception (pp. 89–110). Oxford University Press.

Levin, D. T., Momen, N., Drivdahl, S. B., & Simons, D. J. (2000). Change blindness blindness: The metacognitive error of overestimating change-detection ability. Visual Cognition, 7(1–3), 397–412. https://doi.org/10.1080/135062800394865

Mack, A., & Rock, I. (1998). Inattentional blindness. MIT Press.

Masuda, T., & Nisbett, R. E. (2001). Attending holistically versus analytically: Comparing the context sensitivity of Japanese and Americans. Journal of Personality and Social Psychology, 81(5), 922–934. https://doi.org/10.1037/0022-3514.81.5.922

Masuda, T., & Nisbett, R. E. (2006). Culture and change blindness. Cognitive Science, 30(2), 381–399. https://doi.org/10.1207%2Fs15516709cog0000_63

Moore, C. M., & Egeth, H. (1997). Perception without attention: Evidence of grouping under conditions of inattention. Journal of Experimental Psychology: Human Perception and Performance, 23(2), 339–352. https://doi.org/10.1037/0096-1523.23.2.339

Nisbett, R. E., Peng, K., Choi, I., & Norenzayan, A. (2001). Culture and systems of thought: Holistic versus analytic cognition. Psychological Review, 108(2), 291–310. https://doi.org/10.1037/0033-295X.108.2.291

Raymond, J. E., Shapiro, K. L., & Arnell, K. M. (1992). Temporary suppression of visual processing in an RSVP task: An attentional blink? Journal of Experimental Psychology: Human Perception and Performance, 18(3), 849–860. https://doi.org/10.1037/0096-1523.18.3.849

Rensink, R. A., O'Regan, J. K., & Clark, J. J. (1997). To see or not to see: The need for attention to perceive changes in scenes. Psychological Science, 8(5), 368–373. https://doi.org/10.1111/j.1467-9280.1997.tb00427.x

Simons, D. J., & Chabris, C. F. (1999). Gorillas in our midst: Sustained inattentional blindness for dynamic events. Perception, 28(9), 1059–1074. https://doi.org/10.1068/p281059

Simons, D. J., & Levin, D. T. (1997). Change blindness. Trends in Cognitive Sciences, 1(7), 261–267. https://doi.org/10.1016/S1364-6613(97)01080-2

Simons, D. J., & Levin, D. T. (1998). Failure to detect changes to people during a real-world interaction. Psychonomic Bulletin & Review, 5(4), 644–649. https://doi.org/10.3758/BF03208840

Treisman, A., & Gelade, G. (1980). A feature-integration theory of attention. Cognitive Psychology, 12(1), 97–136. https://doi.org/10.1016/0010-0285(80)90005-5

Visser, T. A. W., Bischof, W. F., & Di Lollo, V. (1999). Attentional switching in spatial and nonspatial domains: Evidence from the attentional blink. Psychological Bulletin, 125(4), 458–469. https://doi.org/10.1037/0033-2909.125.4.458

Volkmann, F. C. (1986). Human visual suppression. Vision Research, 26(9), 1401–1416. https://doi.org/10.1016/0042-6989(86)90164-1

Wolfe, J. M. (1994). Guided Search 2.0: A revised model of visual search. Psychonomic Bulletin & Review, 1(2), 202–238. https://doi.org/10.3758/BF03200774