In the second half of the twentieth century, technocrats gained a powerful new weapon to deploy on the information battlefield: the digital computer. In automating the core bureaucratic function of data processing, computers vastly expanded the information that authorities could collect, store, and analyze. A new philosophy of social engineering emerged, reflecting a belief that even the most complex problems can best be solved by getting the right data into the hands of the right experts equipped with the right computers. Information makes everything transparent — and tractable.
The philosophy was given its first test on an actual battlefield: Vietnam. Early in the conflict, Robert McNamara, President Kennedy’s Harvard-educated defense secretary, recruited a team of “whiz kids” from universities and think tanks to plot war strategy. Working in Washington and in “combat development and test centers” in Southeast Asia, the team conducted extensive behavioral research aimed at developing communication programs to gain the support of local villagers. At the same time, it worked on incorporating computer technologies into weaponry. American planes were soon dropping thousands of motion, sound, and chemical sensors into enemy territory to create an “electronic fence” to track troop movements and guide bombing raids. “I see battlefields that are under 24-hour real- or near-real-time surveillance,” said Army Chief of Staff William Westmoreland in 1969. “I see battlefields on which we can destroy anything we can locate through instant communications.”
But even as he spoke those words, the United States was in retreat, defeated by guerilla fighters armed with little more than guns and walkie-talkies. The Pentagon’s high-tech strategy failed spectacularly. It neither changed the minds of the Vietnamese population nor provided a military advantage. But rather than triggering an honest assessment of the flaws of large-scale data mining, the fiasco had the opposite effect. The problem wasn’t that computer-based decisionmaking had limits, the technocrats concluded. The problem was that the computers weren’t supplied with enough data.
This conclusion would, as Siegel shows with example after example, turn into a perverse tenet of the information age: Every failure of automated data processing becomes an excuse to collect even more data.
It’s worth remembering here something that that same Robert McNamara said in a memo to LBJ on May 19th, 1967: “There may be a limit beyond which many Americans and much of the world will not permit the United States to go. The picture of the world’s greatest superpower killing or seriously injuring 1,000 non-combatants a week, while trying to pound a tiny, backward nation into submission on an issue whose merits are hotly disputed, is not a pretty one.”
Carr continues:
After the 9/11 attacks, the perversity came into high relief. America’s spy agencies, having failed to anticipate and prevent a terrorist plot on U.S. soil, were rewarded with vast new powers to gather information indiscriminately, on American citizens as well as foreign actors.
In addition to the sweeping Patriot Act, passed by a panicked Congress a month after the attacks, the administration of George W. Bush launched a raft of clandestine surveillance and propaganda programs, with names like Total Information Awareness and The Office of Strategic Influence. Flouting the Privacy Act of 1974, which had imposed tight controls on the federal government’s ability to collect personal data on citizens, intelligence agents began downloading Americans’ phone records, text messages, credit card transactions, library records, medical charts, and, as Siegel puts it, “anything else that could be fed into the maw of the super-surveillance machine.”
He closes the review of Siegel’s book with this:
Originally promoted as a medium of reason and objectivity, the Internet has revealed itself in the social media era to operate under a definition of truth so flexible it would make a postmodernist blush. The huckster, not the technocrat, is its true master.
