Skip to main content

Why FBI and CIA didn't connect the dots

By Bruce Schneier, Special to CNN
May 2, 2013 -- Updated 1437 GMT (2237 HKT)
Police say the dead suspect, <a href='http://www.cnn.com/2013/04/21/us/tamerlan-tsarnaev-timeline/index.html'>Tamerlan Tsarnaev</a>, is the man the FBI identified as Suspect 1. He was killed during the shootout with police in Watertown, Massachusetts, on April 19, 2013. He is pictured here at the 2010 New England Golden Gloves. Police say the dead suspect, Tamerlan Tsarnaev, is the man the FBI identified as Suspect 1. He was killed during the shootout with police in Watertown, Massachusetts, on April 19, 2013. He is pictured here at the 2010 New England Golden Gloves.
HIDE CAPTION
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
Suspects tied to Boston bombings
<<
<
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
>
>>
STORY HIGHLIGHTS
  • FBI, CIA criticized for not keeping better track of Tamerlan Tsarnaev before attack
  • Bruce Schneier: Connecting the dots seems easy in hindsight, but in real life, it's not
  • He says there are an enormous number of potential bad guys
  • Schneier: If a terrorist plot succeeds, it doesn't mean law enforcement systems failed

Editor's note: Bruce Schneier is a security technologist and author of "Liars and Outliers: Enabling the Trust Society Needs to Survive."

(CNN) -- The FBI and the CIA are being criticized for not keeping better track of Tamerlan Tsarnaev in the months before the Boston Marathon bombings. How could they have ignored such a dangerous person? How do we reform the intelligence community to ensure this kind of failure doesn't happen again?

It's an old song by now, one we heard after the 9/11 attacks in 2001 and after the Underwear Bomber's failed attack in 2009. The problem is that connecting the dots is a bad metaphor, and focusing on it makes us more likely to implement useless reforms.

Connecting the dots in a coloring book is easy and fun. They're right there on the page, and they're all numbered. All you have to do is move your pencil from one dot to the next, and when you're done, you've drawn a sailboat. Or a tiger. It's so simple that 5-year-olds can do it.

Bruce Schneier
Bruce Schneier

But in real life, the dots can only be numbered after the fact. With the benefit of hindsight, it's easy to draw lines from a Russian request for information to a foreign visit to some other piece of information that might have been collected.

Opinion: Agencies often miss warning signs of attacks

In hindsight, we know who the bad guys are. Before the fact, there are an enormous number of potential bad guys.

How many? We don't know. But we know that the no-fly list had 21,000 people on it last year. The Terrorist Identities Datamart Environment, also known as the watch list, has 700,000 names on it.

We have no idea how many potential "dots" the FBI, CIA, NSA and other agencies collect, but it's easily in the millions. It's easy to work backwards through the data and see all the obvious warning signs. But before a terrorist attack, when there are millions of dots -- some important but the vast majority unimportant -- uncovering plots is a lot harder.

Rather than thinking of intelligence as a simple connect-the-dots picture, think of it as a million unnumbered pictures superimposed on top of each other. Or a random-dot stereogram. Is it a sailboat, a puppy, two guys with pressure-cooker bombs or just an unintelligible mess of dots? You try to figure it out.

It's not a matter of not enough data, either.

Piling more data onto the mix makes it harder, not easier. The best way to think of it is a needle-in-a-haystack problem; the last thing you want to do is increase the amount of hay you have to search through.

The television show "Person of Interest" is fiction, not fact.

There's a name for this sort of logical fallacy: hindsight bias.

First explained by psychologists Daniel Kahneman and Amos Tversky, it's surprisingly common. Since what actually happened is so obvious once it happens, we overestimate how obvious it was before it happened.

We actually misremember what we once thought, believing that we knew all along that what happened would happen. It's a surprisingly strong tendency, one that has been observed in countless laboratory experiments and real-world examples of behavior. And it's what all the post-Boston-Marathon bombing dot-connectors are doing.

Before we start blaming agencies for failing to stop the Boston bombers, and before we push "intelligence reforms" that will shred civil liberties without making us any safer, we need to stop seeing the past as a bunch of obvious dots that need connecting.

Kahneman, a Nobel prize winner, wisely noted: "Actions that seemed prudent in foresight can look irresponsibly negligent in hindsight." Kahneman calls it "the illusion of understanding," explaining that the past is only so understandable because we have cast it as simple inevitable stories and leave out the rest.

Nassim Taleb, an expert on risk engineering, calls this tendency the "narrative fallacy." We humans are natural storytellers, and the world of stories is much more tidy, predictable and coherent than the real world.

Millions of people behave strangely enough to warrant the FBI's notice, and almost all of them are harmless. It is simply not possible to find every plot beforehand, especially when the perpetrators act alone and on impulse.

We have to accept that there always will be a risk of terrorism, and that when the occasional plot succeeds, it's not necessarily because our law enforcement systems have failed.

Follow @CNNOpinion on Twitter.

Join us at Facebook/CNNOpinion.

The opinions expressed in this commentary are solely those of Bruce Schneier.

ADVERTISEMENT
Part of complete coverage on
July 24, 2014 -- Updated 1349 GMT (2149 HKT)
Patrick Cronin and Kelley Sayler say the world is seeing nonstate groups such as Ukraine's rebels wielding more power to do harm than ever before
July 23, 2014 -- Updated 2205 GMT (0605 HKT)
Ukraine ambassador Olexander Motsyk places blame for the MH17 tragedy squarely at the door of Russia
July 24, 2014 -- Updated 1142 GMT (1942 HKT)
Mark Kramer says Russia and its proxies have a history of shooting down civilian aircraft, often with few repercussions
July 24, 2014 -- Updated 1701 GMT (0101 HKT)
Les Abend says, with rockets flying over Tel Aviv and missiles shooting down MH17 over Ukraine, a commercial pilot's pre-flight checklist just got much more complicated
July 24, 2014 -- Updated 1317 GMT (2117 HKT)
Mark Kramer says Russia and its proxies have a history of shooting down civilian aircraft, often with few repercussions
July 24, 2014 -- Updated 1637 GMT (0037 HKT)
Gerard Jacobs says grieving families and nations need the comfort of traditional rituals to honor the remains of loved ones, particularly in a mass disaster
July 24, 2014 -- Updated 1413 GMT (2213 HKT)
The idea is difficult to stomach, but John Sutter writes that eating dog is morally equivalent to eating pig, another intelligent animal. If Americans oppose it, they should question their own eating habits as well.
July 23, 2014 -- Updated 1630 GMT (0030 HKT)
Bill van Esveld says under the laws of war, civilians who do not join in the fight are always to be protected. An International Criminal Court could rule on whether Israeli airstrikes and Hamas rocketing are war crimes.
July 23, 2014 -- Updated 1205 GMT (2005 HKT)
LZ Granderson says Ronald Reagan went horseback riding and took a vacation after the Korean Air Crash of 1983. So why does the GOP keep airbrushing history to bash Obama?
July 23, 2014 -- Updated 1338 GMT (2138 HKT)
Aaron Miller says Kerry needs the cooperation of Hamas, Israel, Egypt and others if he is to succeed in his peacemaking efforts
July 23, 2014 -- Updated 1251 GMT (2051 HKT)
Errol Louis says the tragic death of Eric Garner at the hands of the NYPD has its roots in the "broken windows" police strategy from the crime-ridden '80s.
July 23, 2014 -- Updated 1408 GMT (2208 HKT)
Gordon Brown says the kidnapped Nigerian girls have been in captivity for 100 days, but the world has not forgotten them.
July 23, 2014 -- Updated 1127 GMT (1927 HKT)
Ruben Navarrette says Texas Gov. Rick Perry is right to immediately send 1,000 National Guard troops to the U.S.-Mexico border in response to the border children crisis.
July 22, 2014 -- Updated 1356 GMT (2156 HKT)
Ukraine's president says the downing of MH17 was a terrorist act, but Richard Barrett says it would be considered terrorism only if it was intentional
July 22, 2014 -- Updated 2015 GMT (0415 HKT)
Robert McIntyre says the loophole that lets firms avoid taxes should be closed
July 22, 2014 -- Updated 1535 GMT (2335 HKT)
Jeronimo Saldana and Malik Burnett say Gov. Perry's plan to send National Guard to the border won't solve the escalating immigration problem.
July 22, 2014 -- Updated 1742 GMT (0142 HKT)
Sally Kohn: The world's fish and waters are polluted and under threat. Be very careful what fish you eat
July 22, 2014 -- Updated 1242 GMT (2042 HKT)
Les Abend says threat information that pilots respond to is only as good as the intelligence from air traffic controllers. And none of it is a match for a radar-guided missile
July 21, 2014 -- Updated 1235 GMT (2035 HKT)
Frida Ghitis: Anger over MH17 is growing against pro-Russia separatists. It's time for the Dutch government to lead, she writes
July 21, 2014 -- Updated 1227 GMT (2027 HKT)
Julian Zelizer says President Obama called inequality the "defining challenge" of our time but hasn't followed through.
July 21, 2014 -- Updated 1157 GMT (1957 HKT)
Gene Seymour says the 'Rockford Files' actor worked the persona of the principled coward, charming audiences on big and small screen for generations
July 21, 2014 -- Updated 1417 GMT (2217 HKT)
Daniel Treisman says that when the Russian leader tied his fate to the Ukraine separatists, he set the stage for his current risky predicament
July 18, 2014 -- Updated 1642 GMT (0042 HKT)
Andrew Kuchins says urgent diplomacy -- not sanctions -- is needed to de-escalate the conflict in Ukraine that helped lead to the downing of an airliner there.
July 19, 2014 -- Updated 0150 GMT (0950 HKT)
Jim Hall and Peter Goelz say there should be an immediate and thorough investigation into what happened to MH17.
July 18, 2014 -- Updated 1507 GMT (2307 HKT)
Pilot Bill Palmer says main defense commercial jets have against missiles is to avoid flying over conflict areas.
July 20, 2014 -- Updated 1755 GMT (0155 HKT)
Valerie Jarrett says that working women should not be discriminated against because they are pregnant.
July 21, 2014 -- Updated 1953 GMT (0353 HKT)
David Wheeler says the next time you get a difficult customer representative, think about recording the call.
July 18, 2014 -- Updated 1933 GMT (0333 HKT)
Newt Gingrich says the more dangerous the world becomes the more Obama hides in a fantasy world.
July 18, 2014 -- Updated 1011 GMT (1811 HKT)
Michael Desch: It's hard to see why anyone, including Russia and its local allies, would have intentionally targeted the Malaysian Airlines flight
July 17, 2014 -- Updated 1914 GMT (0314 HKT)
LZ Granderson says we must remember our visceral horror at the news of children killed in an airstrike on a Gaza beach next time our politicians talk of war
July 17, 2014 -- Updated 1206 GMT (2006 HKT)
Sally Kohn says now the House GOP wants to sue Obama for not implementing a law fast enough, a law they voted down 50 times, all reason has left the room.
July 17, 2014 -- Updated 1214 GMT (2014 HKT)
A street sign for Wall Street
Sens. Elizabeth Warren, John McCain and others want to scale back the "too big to fail" banks that put us at risk of another financial collapse.
July 17, 2014 -- Updated 2016 GMT (0416 HKT)
Newt Gingrich writes an open letter to Robert McDonald, the nominee to head the Veterans Administration.
July 18, 2014 -- Updated 1601 GMT (0001 HKT)
Paul Begala says Dick Cheney has caused an inordinate amount of damage yet continues in a relentless effort to revise the history of his failures.
July 18, 2014 -- Updated 1404 GMT (2204 HKT)
Kids who takes cell phones to bed are not sleeping, says Mel Robbins. Make them park their phones with the parents at night.
July 24, 2014 -- Updated 1625 GMT (0025 HKT)
Buzz Aldrin looked at planet Earth as he stood on talcum-like lunar dust 45 years ago. He thinks the next frontier should be Mars.
July 16, 2014 -- Updated 1804 GMT (0204 HKT)
Mark Zeller never thought my Afghan translator would save his life by killing two Taliban fighters who were about to kill him. The Taliban retaliated by placing him on the top of its kill list.
July 17, 2014 -- Updated 1518 GMT (2318 HKT)
Jeff Yang says an all-white cast of Asian characters in cartoonish costumes is racially offensive.
July 17, 2014 -- Updated 0124 GMT (0924 HKT)
Gary Ginsberg says the late John F. Kennedy Jr.'s reaction to an event in 1995 summed up his character
July 16, 2014 -- Updated 1641 GMT (0041 HKT)
Meg Urry says most falling space debris lands on the planet harmlessly and with no witnesses.
ADVERTISEMENT