June 4, 2003
More NY Times funny business?
Today's Times has an article under this headline: World's View of U.S. Sours After Iraq War, Poll Finds. Yet how reliable is this poll? At first glance, it looks reasonably thorough:
In a survey conducted since the end of hostilities in Iraq, the Pew Research Center for the People and the Press has released new data as part of an ambitious project to assess changes in global attitudes. The nonpartisan center surveyed 38,000 people in 44 nations during the summer and fall of 2002, and followed up with interviews of 16,000 people in 20 nations and in the areas administered by the Palestinian Authority after the end of the war.This is the article's third paragraph, following up on the opening summary of the poll's most newsworthy findings (although the UN's dismal approval ratings somehow got buried down in paragraph 13). Yet in the very last of the article's 19 paragraphs, we read this:
The survey, called "Views of a Changing World," was released today by Madeleine K. Albright, the former secretary of state who is chairwoman of the global project. The latest survey was conducted with about 500 to 1,000 adults in 20 countries and the area administered by the Palestinian Authority. The polling was done by telephone and face-to-face interviews in late April and May. In most countries, the survey involved national population samples, but others were done only in urban areas. The margin of sampling error ranges from plus or minus three percentage points to four percentage points.What do they mean, "500 to 1,000"? Don't they know how many were polled? And even if it was 1,000, that comes out to an average of under 50 persons per country. I'm no statistician, but I'll bet the proverbial dollars to doughnuts that you can't get accuracy of under 4% from a national survey of 50 individuals, even in a small country (though I also suspect "margin of sample error" means something rather narrower, despite how the expression is used without explanation in the article)
UPDATE: Mea culpa -- as a good scholar I should have first gone back to the original source, which is available here. And sure enough, it was a total of 16,000 individuals polled -- but I stand by my criticism of the Times, which should have stated, "The latest survey was conducted with about 500 to 1,000 adults in each of 20 countries. . . . "
Sloppy writing is sloppy reporting.
Posted by David on June 4, 2003 3:53 PM
Is it possible they meant that 500 to 1000 people were interviewed in each country, not 500 to 1000 total?
Posted by: Dana on June 4, 2003 6:47 PM
That is certainly possible, but it is not what was written. The wording of the article was unambiguous: "The latest survey was conducted with about 500 to 1,000 adults in 20 countries. . . ."
Not: "The latest survey was conducted with about 500 to 1,000 adults in each of 20 countries. . . ."
In any case, there is some bad writing going on here.
Posted by: David on June 4, 2003 9:09 PM
I wonder who financed this group and the study?. most groups like this have a couple of main backers who effect all it does.
Posted by: Gunner on June 4, 2003 9:32 PM
Actually, the press blew it (surprise!) again.
*Anti-Americanism is way up. Or it's declining.* "... the full report (see table on page 29) shows that in all cases where a direct comparison is possible, the people view the U.S. *more* favourably now than three months ago."
*The Report*
from comments -
---
Most of these [news reports] say that support for the U.S. in the Muslim world is declining. Pretty irresponsible when: (a) in *all* countries for which there is information, the U.S. is viewed more favourably now than in March (i.e. all indications are that the trend is *up*, not *down*); and (b) in the *one* Muslim country for which there is information, the U.S. is again viewed more favourably now than in March. Certainly any reports of a decline in Muslim countries should be balanced squarely against the information that in many non-Muslim countries, support is increasing.
--- Michael
Posted by: John Anderson on June 5, 2003 2:35 AM