A community survey is worth running when its answers could inform a real decision and existing evidence cannot answer the question. To get results that can responsibly describe the community, first define who the survey is about, choose a recruitment method that can reach them, and report the limits of what the responses show.
Start with the decision, not the questionnaire
Write down the local decision or action the findings could inform. Then identify what is already known, what remains uncertain, and whether a survey can fill that gap. A survey is designed to gather structured information across a group; it is not a substitute for conversation when the issue requires depth, explanation, or dialogue. AAPOR’s best-practice guidance recommends planning the research before collecting responses.
Define the geography or community boundary, the population the findings should describe, and who is eligible to participate. Decide whether you need reliable results for particular subgroups, such as residents of different neighborhoods. If subgroup comparisons matter, account for that in the design rather than assuming enough responses will arrive by chance.
Choose who to invite—and be clear about what the results can represent
A sampling frame is the list or contact mechanism used to reach potential respondents. A geographic address list can support a mail survey; telephone numbers can support a phone survey; panel membership can support a panel survey. Whatever the frame, ask who it leaves out. Missing addresses, inaccessible contact details, language barriers, or limited internet access can keep some people in the target population from taking part.
#1 Best Overall
| Approach | What it can support | Important trade-off |
|---|---|---|
| Probability sample | Random selection from a frame covering all or nearly all of the target population can better support estimates about that population. | Finding or building a suitable frame and conducting probability-based fieldwork may require more effort and resources. AAPOR notes the growing use of nonprobability and online surveys alongside the cost of probability-based work. |
| Opt-in panel, social-media post, or open survey link | Can collect feedback from people willing and able to respond through those channels. | Respondents self-select, so results should not be presented as though random selection occurred. Be transparent about recruitment and limit conclusions accordingly. |
| Personal networks | Can help gather perspectives from people already connected to the organizers. | Those networks may not cover the wider community; their responses cannot automatically stand in for residents who were not reached. |
A high response count does not, by itself, fix selection problems or show that people who did not respond would have answered similarly. AAPOR’s guidance on sampling and recruitment and Pew Research Center’s survey methodology both support treating the recruitment design as part of the evidence, not a minor administrative detail.
Write questions that measure what you mean
Question wording shapes the answers a survey records. Use familiar, direct language; ask one thing at a time; and avoid suggesting that one response is preferred. Do not assume facts that have not been established. Where it helps prevent priming, ask broad questions before more specific ones.
- For fixed-choice questions, make answer options non-overlapping and broad enough to cover reasonable responses.
- Include options such as “don’t know” or “does not apply” when they are meaningful for the question.
- Consider an open-response item if planners may have missed relevant answers; allow for the extra work needed to interpret or code those responses.
- Keep question order and context in mind: earlier questions can affect how people answer later ones.
Before launch, test the questionnaire and the systems used to collect responses with people and conditions similar to those expected in the real survey. U.S. Census Bureau Statistical Quality Standard B1 calls for testing and verifying methods and systems, monitoring data collection, and taking corrective action when problems arise.
Select a collection mode that fits the people and the questions
Online, mail, phone, and in-person surveys each create different access, burden, privacy, and operational considerations. No mode is best for every population or task. Choose based on who needs to be reached, the sensitivity of the questions, available staff and resources, language access, accessibility, and how much effort respondents must spend.
Do these 3 things before closing this tab:
1Fix the driver behind crashes, sound loss and screen glitches2Clear out junk files and repair common Windows errors3Scan for outdated or missing drivers - takes under a minuteRank #3
- Used Book in Good Condition
| Mode | Questions to consider |
|---|---|
| Online | Can the intended population access the survey and use it comfortably? Will an online-only approach miss people? |
| Can the address frame reach the target population? Are paper response and return instructions clear and accessible? | |
| Phone | Can the contact list reach the people you intend to represent? Are the call schedule, language support, and interview burden appropriate? |
| In person | Can staff reach participants safely and consistently? Is the setting suitable for privacy and the questions being asked? |
Plan how people will be contacted, whether and when reminders or follow-up will be used, what counts as a complete or usable response, and how responses will be handled securely. Train staff where relevant, monitor fieldwork for emerging problems, and document the procedures. Census Standard B1 offers useful principles for protecting restricted information, balancing quality with respondent burden, testing systems, monitoring collection, and recording methods. Specific legal obligations depend on the project’s jurisdiction, funder, and data.
Interpret response rates and survey quality carefully
A response rate is one indicator of survey quality, not a verdict on whether the results represent the population. Its meaning depends on the numerator, denominator, and definitions used. The Census Bureau’s response-rate guidance, for example, defines a unit response rate as responding units divided by eligible units plus units of unknown eligibility. It also distinguishes dispositions such as refusals, language barriers, and insufficient data, which can help explain the rate.
Rank #4
- Used Book in Good Condition
Survey error can arise in several ways. Pew’s total survey error framework identifies coverage error, sampling error, nonresponse error, measurement error, and processing or adjustment error. Explain which are relevant to your project. For an opt-in or other nonprobability sample, report how people were recruited and do not present a conventional margin of sampling error as if random selection had taken place.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Analyze and publish results with enough context to assess them
Describe who responded and how responses were cleaned, weighted, or otherwise adjusted. Give the denominator for each percentage and explain how missing answers were handled. Distinguish descriptive findings—what respondents said—from claims about causes, which a survey alone may not establish. If you compare subgroups, explain the limits and uncertainty of those comparisons.
Free tools Windows power users keep installed
One-click scans. No signup required.
A useful public account should include the target population, sampling frame and recruitment method, collection mode and dates, exact question wording, response definitions, any weighting or other adjustments, and material limitations. Publishing the questionnaire or exact wording and response options lets readers see what was actually asked; Pew’s survey reports provide topline questionnaires as an example of this practice.
For repeat surveys, protect the basis for comparison
A repeated “pulse” survey can show how responses change over time only if the measurements are comparable. Keep wording, framing, and methodology as consistent as practical. AAPOR notes that a change in question wording, preceding-question context, or survey mode can affect responses and may resemble a change in opinion. If a change is necessary, document it and qualify direct comparisons.
The Census Bureau’s ACS methodology resources include a December 2024 design and methodology report, questionnaire archives, content-change processes, and quality measures. They illustrate why documentation of instruments and methods matters for understanding changes across survey periods.
Quick Recap
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.
What’s actually slowing this PC down?
Pick the symptom - the matching free tool is one click away.
