|
Posted
July 18, 2000
Learning
from Citizens
NEWS
ORGANIZATIONS HAVE LONG USED
public opinion polling to gauge whos ahead in a campaign.
The polls are popular with readers and viewers, who are intrigued
by what other people think. And polls are popular with journalists
they offer hard numbers that reporters are comfortable using.
Although political
candidates have been using polling for years to
determine
the mood of voters, newsrooms were slow to follow. Only recently
have newsrooms begun to use surveys extensively to determine which
issues matter most to citizens, and to use that information to shape
campaign coverage.
A poll, if
properly drawn and conducted, can provide an accurate indication
of where the public stands on specific issues at any given time.
That information then can be used as a starting point for editors
and reporters in thinking through issues-based campaign coverage.
Other approaches
give you more depth of understanding as you seek to learn from citizens.
Focus groups and even extended interviews can provide a window into
the concerns and the thinking of citizens in your community, which
will inform and enrich your reporting.
Issues
Polls
Many newsrooms
now use polling to find out what people care about most. Citizens
are asked to rate the importance of specific issues or to identify
(in open-ended questions) the biggest problems facing the city,
state, or nation. Sometimes people are asked to choose between competing
issues or values, for example, whether available tax dollars should
be spent on education or to build more prisons.
Why Conduct
Issues Polls?
Editors and
news directors not only want to know the half-dozen or so most important
issues, they want to know what the citizens priorities are.
If possible, they also want to know about deeply held concerns of
small groups within the population. All this requires more questions
and takes more time, making this kind of survey more difficult to
complete and thus more expensive than a horse-race kind of
poll.
What the issues
poll provides in return is substantive data on how citizens weigh
the various issues. While the poll still captures public opinion
at a point in time, the findings are less volatile because they
measure concerns and underlying attitudes, which are more stable
than political opinion.
News organizations
that have done follow-up surveys find people remain concerned about
the same issues during the course of the campaign, although the
rankings may shift, and their thinking about solutions may change
as a result of candidate and citizen discussion.
And new issues
can surface. Editors guiding issues-based coverage need to remain
flexible to breaking issues.
How to
Conduct Issues Polls
- Whom
to survey. Most news organizations doing issues polling seek
to develop information on how citizens feel, so they survey the
entire voting age population that can be reached by phone.
If the survey
is limited to voters, or Republican voters, or some other subset,
the questionnaire should be written to immediately screen out
unwanted respondents. This is easily done but the cost of the
"field work" will increase because the screening process
means more calls have to be made to achieve the desired sample.
- Sample
size. The size of the sample can vary, from a low of 400 to
a high of 2,000, depending on the sophistication of the information
sought and the funds available.
A sample
of 400 will provide good, basic information about the population
as a whole, with a sampling error of plus or minus 5 percent.
But if subgroups are going to be compared information cross-tabulated
by political affiliation, gender, race and ethnicity, economic
class, education level, for instance then a larger sample
is needed.
What does
not matter, because of the laws of probability, is the size of
the population being surveyed. The accuracy of a sample of 400
does not change whether the "universe" polled is a single
community or an entire state.
- Types
of questions. Most surveys combine several different types
of questions to gain both a breadth and depth of understanding.
Ranking
known issues. This is the most frequently used technique for
determining what matters most to people, and how they would rank
their concerns. Respondents are presented with a predetermined
list of 10 to 15 issues and asked to rank them on a scale that
does not include a middle ground. A common question would ask
if a particular issue is "very important," "fairly
important," "somewhat important," or "not
important."
A weakness
of this approach is that some issues that do matter to people may
not surface because they were not included on the pre-set list.
Making
a choice. This approach asks respondents to select from a list
of choices. For example: "In your opinion, which of the following
issues should be the next governors top priority?" This
kind of question can be used only if the list is short three
or four options at most which means it cannot include a wide
range of options.
Open ended.
These questions allow citizens to come up with an unprompted
answer rather than choosing from a pre-set list. An example: "What
one issue affecting [the state/the country] concerns you most?"
These kinds of questions are frequently asked at the start or the
end of a poll to identify issues that may not have surfaced in preparing
the questionnaire.
The Oregonians
1996 issues poll also gave people a chance to explain their concerns
by asking a follow-up question: What solutions would you propose?
Those answers provided a deeper understanding of what people really
meant, and offered a way to compare citizens expectations
with candidates promises.
The North
Carolina "Your Voice, Your Vote" surveys in 1996 and 1998
started off with open-ended questions, then asked respondents to
rank a list of issues. There were some small differences in the
ranking of the issues within each set of responses, but being able
to consider both helped the editors select the issues to focus on
in their coverage.
A drawback
of the open-ended approach is that it takes more time, both in asking
the questions and analyzing the answers, and therefore drives up
the cost of the poll. It is not a cost-effective way to develop
a range of concerns.
Cost of
Issues Polls
As a rule
of thumb, it will cost $30 per interview to hire a professional
polling firm. That means a 400 interview sample will cost about
$12,000. But, in fact, costs can vary widely based on a number of
factors.
- The
length and complexity of the questionnaire. The more information
sought, and the more complex the questions, the longer it takes
to complete an interview. It also means some people will hang
up on the interviewers, forcing them to start over with someone
else. That takes more time. And time costs money. Polling firms
will also charge for the added time it takes to develop the more
sophisticated questionnaire.
- The
size of the sample. The extra hours needed for the survey-taker
to complete the additional interviews in a larger sample is a
direct added cost.
- Screening
for subgroups. It takes more time to fine-tune a sample for
sub-categories, such as political party if polling is being done
for a primary, or among only registered voters; or to make sure
there is a representative number of minorities, who can be hard
to reach by telephone. Again, this costs more.
- Who
does the survey. An established polling firm will almost certainly
cost more. And its important to know who the firms
clients are before signing on. Still, a firm that has done work
in the political arena can help devise a very effective issues
survey.
- Some
ways to save. Some newsrooms have developed sufficient in-house
expertise to manage their own polling, using reporters who have
studied survey research to draft questionnaires and write the
computer programs to analyze the data. Phone numbers for random
sampling can be purchased from a number of firms. And its
also possible to contract for just the fieldwork the actual
telephoning. This could bring outside costs to under $10 per interview.
Some newsrooms
also have partnered with area universities in polling projects,
with faculty helping to draw the questionnaires and samples and
students doing field work. The market research department at an
individual news organization may be able to help find ways to cut
costs such as getting a better price by using a firm with
which it regularly does business.
Focus Groups
Focus groups
are nothing more than conversations with people
focused, directed,
but still conversations. Where polls provide a shallow look at the
opinions of the broad population, focus groups provide a deep look
at how a slice of the population thinks about an issue. They can
be used to provide information at several different times during
your campaign coverage.
Why Use
Focus Groups?
- Pre-poll.
Focus groups can be used to test how people feel about local,
state, or national problems before drawing the questionnaire for
a poll. The discussions can bring to the surface issues that havent
been on the political horizon. They will often highlight competing
desires lower taxes and better education that need
to be tested in the questionnaire. The discussions can suggest
ways to ask, or not to ask, questions, and flag words to avoid
because they have one meaning in the political realm, another
to citizens.
- Post-poll.
Focus groups are sometimes convened to follow up on the issues
and discuss them in more detail, to get at why people feel as
they do. They can be used to let citizens discuss, even deliberate
on, issues on which there is a deep split within the community,
or to try reconciling competing positions. Often, these have been
used to gather material for issues stories or video for special
TV reports.
How to
Convene a Focus Group
- Getting
started. Its not a magical process, but there can be
problems in getting started. The logistics of bringing a group
of people together, arranging a meeting place, and so on, are
foreign to many news people. In Boston, for example, attendance
at one of the sessions was so low it failed to be representative
of anything. Some newsrooms have found that professional help
is valuable. There may also be someone elsewhere in the news organization
with experience in convening a group.
- Whom
to include. Focus groups should involve between eight and
12 people, enough to provide for a varied discussion but not so
many that some people dont get a chance to participate fully.
Groups should comprise a reasonable cross section of the community
mixing age, gender, race, and demographic diversity
or they should be specifically targeted. If the plan is to conduct
a number of focus-group conversations, a technique called "cluster
sampling" can be used. In this case, each group is selected
precisely because it represents a different element of a diverse
community.
-- Reprinted
from the Poynter Election
Handbook: A Guide to Campaign Coverage.

|