Thursday, November 01, 2007

Synthesizing the wisdom of experts

Julie Rehmeyer at Mathtrek talks of the work ofBruce Bueno de Mesquita :
"The New York University political science professor has developed a computerized game theory model that predicts the future of many business and political negotiations and also figures out ways to influence the outcome. Two independent evaluations, one by academics and one by the U.S. Central Intelligence Agency, have both shown that about 90 percent of his predictions have been accurate. Most recently, he has used his mathematical tools to offer approaches for handling the growing nuclear crisis with Iran.

Bueno de Mesquita provides the computer tools, but he relies on political or business experts to identify specific issues, their possible outcomes, and the key players. He asks experts narrow, carefully delineated questions about which outcome each player would prefer, how important the issue is to each player, and how much influence each player can exert. But he does not ask about the history of the conflict, the cultural norms of the area, or what the experts think will happen.

With careful interviewing, Bueno de Mesquita finds that he can get experts to agree on what information the model needs as input, even when the experts disagree sharply on expected outcomes. Once, after generating a report for the CIA using information from the agency's experts, he had his students assemble the same information from news reports. "Over 90 percent of them came up with the same results as I got [when I was] locked in a lead-lined vault at the CIA headquarters," Bueno de Mesquita says. "It's basic information that experts agree on and that you can even find in The Economist." "

She also refers to Mesquita & Roundell, a company he founded that uses his model to advise businesses and governments and this article , according to which they advised Union Carbide.

No comments: