733:
the responder greater flexibility, but they are also very difficult to record and score, requiring extensive coding. Contrastingly, closed questions can be scored and coded more easily, but they diminish expressivity and spontaneity of the responder. Some problems with the wording of questions are obvious and may be intentional, particularly in psuedopolls, whose sponsors are seeking specific results. Wording problems can arise on routine topics in legtimate surveyss If question wording can affect measurement of relatively objective matters, such as a person's age, the number of children in a family, or the frequency of news watching, then how much might wording affect more subjective phenomena?
249:
758:
537:
arrow), and graphics (e.g. text boxes). In translated questionnaires, the design elements also take into account the writing practice (e.g. Spanish words are lengthier and require more space on the page or on the computer screen) and text orientation (e.g. Arabic is read from right to left) to prevent data missingness.
510:
the target audience and subject matter. The wording should be kept simple, without technical or specialized vocabulary. Ambiguous words, equivocal sentence structures and negatives may cause misunderstanding, possibly invalidating questionnaire results. Double negatives should be reworded as positives.
490:, index, or typology – will determine what can be concluded from the data. A yes/no question will only reveal how many of the sample group answered yes or no, lacking the resolution to determine an average response. The nature of the expected responses should be defined and retained for interpretation.
66:
What is often referred to as "adequate questionnaire construction" is critical to the success of a survey. Inappropriate questions, incorrect ordering of questions, incorrect scaling, or a bad questionnaire format can make the survey results valueless, as they may not accurately reflect the views and
520:
Questions and prepared responses (for multiple-choice) should be neutral as to intended outcome. A biased question or questionnaire encourages respondents to answer one way rather than another. Even questions without bias may leave respondents with expectations. The order or grouping of questions is
509:
Topics should fit the respondents' frame of reference, as their background may affect their interpretation of the questions. Respondents should have enough information or expertise to answer the questions truthfully. Writing style should be conversational, yet concise and accurate and appropriate to
532:
Many people will not answer personal or intimate questions. For this reason, questions about age, income, marital status, etc. are generally placed at the end of the survey. This way, even if the respondent refuses to answer these questions, he/she will have already answered the research questions.
818:
Questions should flow logically, from the general to the specific, from least to most sensitive, from factual and behavioral matters to attitudes and opinions. When semi-automated, they should flow from unaided to aided questions. The researcher should ensure that the answer to a question is not
732:
There are two different types of questions that survey researchers use when writing a questionnaire: free-response questions and closed questions. Free-response questions are open-ended, whereas closed questions are usually multiple-choice. Free-response questions are beneficial because they allow
554:
There are a number of channels, or modes, that can be used to administer a questionnaire. Each has strengths and weaknesses, and therefore a researcher will generally need to tailor their questionnaire to the modes they will be using. For example, a questionnaire designed to be filled-out on paper
475:
The research objective(s) and frame-of-reference should be defined beforehand, including the questionnaire's context of time, budget, manpower, intrusion and privacy. The types of questions (e.g.: closed, multiple-choice, open) should fit the data analysis techniques available and the goals of the
743:
A respondent's answer to an open-ended question can be coded into a response scale afterwards, or analysed using more qualitative methods. Two studies demonstrate both the importance of question wording and the differential impact it can have on different subsets of citizens. The first study
536:
Visual presentation of the questions on the page (or computer screen) and use of white space, colors, pictures, charts, or other graphics may affect respondent's interest – or distract from the questions. There are four primary design elements: words (meaning), numbers (sequencing), symbols (e.g.
528:
The list of prepared responses should be collectively exhaustive; one solution is to use a final write-in category for "other ________". The possible responses should also be mutually exclusive, without overlap. Respondents should not find themselves in more than one category, for example in
471:
Before constructing a questionnaire survey, it is advisable to consider how the results of the research will be used. If the results won't influence the decision-making process, budgets won't allow implementing the findings, or the cost of research outweighs its usefulness, then there is little
728:
The way that a question is phrased can have a large impact on how a research participant will answer the question. Thus, survey researchers must be conscious of their wording when writing survey questions. It is important for researchers to keep in mind that different individuals, cultures, and
670:
This method works well if the survey contains several branching questions. Help or instructions can be dynamically displayed with the question as needed, and automatic sequencing means the computer can determine the next question, rather than relying on respondents to correctly follow skip
193:
Matrix questions – Identical response categories are assigned to multiple questions. The questions are placed one under the other, forming a matrix with response categories along the top and a list of questions down the side. This is an efficient use of page space and the respondents'
431:(or behavior coding) monitors the interviewer and respondent' verbal interactions in live or recorded interviews, or from transcripts. Questions are identified as needing repair when certain behaviors are coded frequently, such as respondents asking for clarifications.
744:
examined how the use of the terms "global warming" versus "climate change" influenced
Americans' opinions about the world's changing enviroment. Another study also demostrates the importance of question wording and how it affects subsets of respondents.
650:
This method has a low ongoing-cost, and most surveys cost little for the participants and surveyors. However, initial set-up costs can be high for a customised design due to the effort required in developing the back-end system or programming the questionnaire
238:
Contingency question – A question that is answered only if the respondent gives a particular response to a previous question. This avoids asking questions of people that do not apply to them (for example, asking men if they have ever been
674:
Not all of the sample may be able to use the electronic form due to accessibility issues, software compatibility, bandwidth requirements, server load, or internet access, and therefore results may not be representative of the target
505:
for the report. Unneeded questions should be avoided, as they are an expense to the researcher and an unwelcome imposition on the respondents. All questions should contribute to the objective(s) of the research.
406:
examines the respondent's thought process as they answer the questions or afterwards. The interviewer directs the respondent to think aloud or administer verbal probes. It can also be conducted online without an
1442:
Kapousouz, Evgenia; Johnson, Timothy; Holbrook, Allyson (2020). "Seeking
Clarifications for Problematic Questions: Effects of Interview Language and Respondent Acculturation". In Sha, Mandy; Gabel, Tim (eds.).
689:
Questions can be more detailed and obtains more comprehensive information. However, respondents are often limited to their working memory: specially designed visual cues (such as prompt cards) may help in some
177:
Scaled questions – Responses are graded on a continuum (e.g.: rate the appearance of the product on a scale from 1 to 10, with 10 being the most preferred appearance). Examples of types of scales include the
540:
Questionnaires can be administered by research staff, by volunteers or self-administered by the respondents. Clear, detailed instructions are needed in either case, matching the needs of each audience
740:
and should avoid leading or loaded questions. If multiple questions are being used to measure one construct, some of the questions should be worded in the opposite direction to evade response bias.
92:
carrying out a small pretest of the questionnaire, using a small subset of target respondents. Results can inform a researcher of errors such as missing questions, or logical and procedural errors.
2284:
463:
A multiple-method approach helps to triangulate results. For example, cognitive interviews, usability testing, behavior coding, and/or vignettes can be combined for pretesting.
202:– No options or predefined categories are suggested. The respondent supplies their own answer without being constrained by a fixed set of possible responses. Examples include:
963:
Dillman, Don A., Smyth, Jolene D., Christian, Leah Melani. 2014. Internet, Phone, Mail and Mixed-Mode
Surveys: The Tailored Design Method, 4th edition. John Wiley: Hoboken, NJ
1648:
Holbrook, Allyson L.; Green, Melanie C.; Krosnick, Jon A. (2003). "Telephone versus Face-to-Face
Interviewing of National Probability Samples with Long Questionnaires".
144:
The degree of standardization varies, ranging from strictly prescribed questions with predetermined answers to open-ended questions with subjective evaluation criteria.
1772:(Eds.) (with contributions by D.J. Hand), Advising on Research Methods: A consultant's companion (pp. 183–209). Huizen, The Netherlands: Johannes van Kessel Publishing.
2345:
2304:
1190:
Presser, S.; Couper, M. P.; Lessler, J. T.; Martin, E.; Martin, J.; Rothgeb, J. M.; Singer, E. (March 2004). "Methods for
Testing and Evaluating Survey Questions".
2299:
1621:
Kreuter, F.; Presser, S.; Tourangeau, R. (December 2008). "Social
Desirability Bias in CATI, IVR, and Web Surveys: The Effects of Mode and Question Sensitivity".
41:
useful information about a given topic. When properly constructed and responsibly administered, questionnaires can provide valuable data about any given subject.
2365:
1782:
Schuldt, J. P.; Konrath, S. H.; Schwarz, N. (1 March 2011). "'Global warming' or 'climate change'?: Whether the planet is warming depends on question wording".
70:
Different methods can be useful for checking a questionnaire and making sure it is accurately capturing the intended information. Initial advice may include:
2314:
706:
Can be extremely expensive and time-consuming to train and maintain an interviewer panel. Each interview also has a cost associated with collecting the data.
591:
Mail is subject to postal delays and errors, which can be substantial when posting to remote areas, or given unpredictable events such as natural disasters.
493:
A common method is to "research backwards" in building a questionnaire by first determining the information sought (i.e., Brand A is more/less preferred by
479:
The manner (random or not) and location (sampling frame) for selecting respondents will determine whether the findings will be representative of the larger
1598:
M. Mandy, Sha; Wang, Kevin (2013). "A Comparison of
Results from a Spanish and English Mail Survey: Effects of Instruction Placement on Item Missingness".
779:
77:
using questionnaire construction guidelines to inform drafts, such as the
Tailored Design Method, or those produced by National Statistical Organisations.
1415:
529:
both the "married" category and the "single" category (in such a case there may be need for separate questions on marital status and living situation).
856:
95:
estimating the measurement quality of the questions. This can be done for instance using test-retest, quasi-simplex, or mutlitrait-multimethod models.
127:). Each item produces a value, typically a raw score, which can be aggregated across all items to generate a composite score for the measured trait.
1879:
1384:
846:
616:
2324:
851:
694:
356:
Questionnaires used to collect quantitative data usually comprise several multi-item scales, together with an introductory and concluding section.
736:
In general, the vocabulary of a question should be very simple and direct, and preferably under twenty words. Each question should be edited for
2309:
2256:
562:
Using multiple modes can improve access to the population of interest when some members have different access, or have particular preferences.
2289:
1848:
1582:
1549:
1516:
1462:
1364:
1307:
1274:
1141:
1075:
63:. They are a valuable method of collecting a wide range of information from a large number of individuals, often referred to as respondents.
1257:
Tourangeau, Roger; Maitland, Aaron; Steiger, Darby; Yan, Ting (2020). "A Framework for Making
Decisions About Question Evaluation Methods".
423:
are short descriptions of hypothetical situations that are presented to research participants to examine their survey-relevant decisions.
2429:
2355:
280:
89:. By asking a sample of potential-respondents about their interpretation of the questions and use of the questionnaire, a researcher can
635:
Are more prone to social desirability biases than other modes, so telephone interviews are generally not suitable for sensitive topics.
415:
focuses on how people interact with the survey, such as navigating the survey, entering survey responses, and finding help information.
2246:
2236:
217:– Respondents complete an incomplete sentence. For example, "The most important consideration in my decision to buy a new house is..."
1724:
1238:
1108:
805:
1323:
2406:
2396:
439:
is conducted by an individual expert or a panel of experts in questionnaire design to identify potential problems and solutions.
2401:
2072:
921:
56:
2391:
2386:
1480:
1423:
1160:
Robinson, Mark A. (May 2018). "Using multi-item psychometric scales for research and practice in human resource management".
783:
119:. These items serve as fundamental components within questionnaire and psychological tests, often tied to a specific latent
585:
517:, the researcher will not know which one the respondent is answering. Care should be taken to ask one question at a time.
1810:
2182:
1872:
1031:
Andrews, Frank M. (1984). "Construct
Validity and Error Components of Survey Measures: A Structural Modeling Approach".
306:
Usually, for clarity and efficiency, a single set of anchors is presented for multiple rating scales in a questionnaire.
98:
predicting the measurement quality of the question. This can be done using the software Survey Quality Predictor (SQP).
2444:
183:
137:
Answer format: The manner in which the respondent provides an answer, including options for multiple-choice questions.
866:
230:
822:
According to the three-stage theory (also called the sandwich theory), questions should be asked in three stages:
2378:
2319:
2147:
2000:
1925:
941:
214:
2439:
768:
603:
Limited ability to build rapport with the respondent, or to answer questions about the purpose of the research.
514:
313:
1478:
Yan, T.; Kreuter, F.; Tourangeau, R (December 2012). "Evaluating Survey Questions: A Comparison of Methods".
2152:
1995:
1889:
1865:
911:
787:
772:
487:
289:
Each response point has an accompanying verbal anchor (e.g., “strongly agree”) ascending from left to right.
272:
256:
187:
120:
584:
Low cost-per-response for small samples. Large samples can often be administered more efficiently by using
2434:
2269:
2251:
2142:
2027:
1930:
1905:
936:
549:
502:
480:
435:
1499:
Aizpurua, Eva (2020). "Pretesting Methods in Cross-Cultural Research". In Sha, Mandy; Gabel, Tim (eds.).
1347:
Martin, Elizabeth (2004). "Vignettes and Respondent Debriefing for Questionnaire Design and Evaluation".
2279:
2162:
2022:
1975:
1761:
390:
317:
268:
159:
693:
Interviewers sometimes rephrase questions during the interview, reducing the level of standardisation.
2200:
2137:
2127:
1980:
1920:
1915:
931:
456:
401:
394:
328:
86:
996:
Heise, David R. (February 1969). "Separating Reliability and Stability in Test-Retest Correlation".
647:
Usually administered via a HTML-based webpage, or other electronic channel such as a smartphone app.
233:– Respondents explain a picture or create a story about what they think is happening in the picture.
2360:
2329:
2082:
1990:
1965:
861:
199:
309:
Collectively, a statement or question with an accompanying rating scale is referred to as an item.
2177:
2092:
2067:
2039:
2012:
1947:
1013:
916:
906:
723:
452:
344:
340:
124:
81:
Empirical tests also provide insight into the quality of the questionnaire. This can be done by:
2294:
286:
Each statement or question has an accompanying set of equidistant response-points (usually 5-7).
248:
1716:
2167:
2132:
2062:
1844:
1720:
1578:
1545:
1512:
1458:
1360:
1303:
1270:
1234:
1137:
1104:
1071:
978:
418:
410:
327:
The following types of reliability and validity should be established for a multi-item scale:
2274:
2087:
1935:
1836:
1791:
1769:
1704:
1657:
1630:
1603:
1570:
1537:
1504:
1448:
1396:
1352:
1295:
1262:
1226:
1199:
1169:
1129:
1096:
1063:
1040:
1005:
366:
336:
295:
Collectively, a set of response-points and accompanying verbal anchors are referred to as a
208:
165:
2210:
2172:
2107:
2007:
1970:
1897:
1222:
522:
427:
383:
350:
171:
60:
27:
Design of a questionnaire to gather statistically useful information about a given topic
2220:
2102:
2097:
2077:
2052:
2047:
1985:
1960:
871:
581:
Usually a simple questionnaire, printed on paper to be filled-out with a pen or pencil.
264:
224:
657:
Survey participants can choose to remain anonymous, though risk being tracked through
2423:
2264:
2241:
2157:
2119:
2057:
1910:
1831:
Reynolds, Cecil R.; Altmann, Robert A.; Allen, Daniel N. (2021). "Item Development".
1705:
1541:
926:
886:
709:
Relatively few limits to the population, so long as an interviewer is granted access.
626:
375:
332:
321:
292:
Verbal anchors should be balanced to reflect equal intervals between response-points.
253:
108:
50:
34:
17:
211:– Words are presented and the respondent mentions the first word that comes to mind.
2215:
2017:
891:
832:
379:
300:
296:
179:
1765:
1508:
1453:
1091:
Osterlind, Steven J. (2002). "Definition, Purpose, and Characteristics of Items".
729:
subcultures can interpret certain words and phrases differently from one another.
600:
Allows survey participants to remain anonymous (e.g. using identical paper forms).
279:
Multiple statements or questions (minimum ≥3; usually ≥5) are presented for each
1840:
1712:
881:
876:
757:
737:
667:
Questions can be more detailed, as opposed to the limits of paper or telephones.
658:
556:
205:
Completely unstructured – For example, "What is your opinion on questionnaires?"
501:
vs. Brand C), then being certain to ask all the needed questions to obtain the
2205:
1266:
1607:
982:
445:
test the impact of the revised items by comparing it with the original items.
147:
Responses to test items serve as indicators in the realm of social sciences.
1100:
1095:. Evaluation in Education and Human Services. Vol. 47. pp. 17–57.
901:
38:
1356:
559:
may be substantial enough that they threaten the validity of the research.
1574:
1400:
1299:
1230:
1133:
1067:
594:
Surveys are limited to populations that are contactable by a mail service.
267:
research and practice, questionnaires are most frequently used to collect
1857:
1795:
1634:
1203:
622:
Opportunity to build rapport with respondents may improve response rates.
140:
Evaluation criteria: The criteria used to assess and score the response.
1385:"The Use of Vignettes in Evaluating Asian Language Questionnaire Items"
1017:
1173:
1060:
Design, Evaluation, and Analysis of Questionnaires for Survey Research
724:
Survey methodology § Guidelines for the effective wording of questions
555:
may not operate in the same way when administered by telephone. These
134:
Item stem: This represents the question, statement, or task presented.
2350:
1955:
1259:
Advances in Questionnaire Design, Development, Evaluation and Testing
1009:
1661:
1044:
320:
way, they are collectively referred to as a multi-item scale, or a
1217:
Rothgeb, Jennifer (2008). "Pilot Test". In Lavrakas, Paul (ed.).
896:
397:, and can be conducted in a laboratory setting or in the field.
162:– Respondents' answers are limited to a fixed set of responses.
1861:
654:
Questionnaires can be conducted swiftly, without postal delays.
751:
700:
Rapport with respondents is generally higher than other modes.
220:
Story completion – Respondents complete an incomplete story.
2285:
Household, Income and Labour Dynamics in Australia Survey
615:
Questionnaires can be conducted swiftly, particularly if
521:
also relevant; early questions may bias later questions.
174:– The respondent has several option from which to choose.
130:
Test items generally encompass three primary components:
1349:
Methods for Testing and Evaluating Survey Questionnaires
1058:
Saris, Willem E.; Gallhofer, Irmtraud N., eds. (2014).
335:(if the variable is expected to be stable over time),
1703:
Shaughnessy, J.; Zechmeister, E.; Jeanne, Z. (2011).
111:, an individual task or question is referred to as a
632:
Surveys are limited to populations with a telephone.
2351:
European Society for Opinion and Marketing Research
2338:
2229:
2193:
2118:
2038:
1946:
1896:
1124:Haladyna, Thomas M.; Rodriguez, Michael C. (2013).
312:When multiple items measure the same variable in a
1698:
1696:
1694:
1692:
1690:
1688:
1686:
1684:
1682:
1680:
223:Picture completion – Respondents fill-in an empty
1501:The Essential Role of Language in Survey Research
1445:The essential role of language in survey research
1416:"Methods of Behavior Coding of Survey Interviews"
1328:GESIS - Leibniz Institute for the Social Sciences
2346:American Association for Public Opinion Research
2305:National Health and Nutrition Examination Survey
703:Typically higher response-rate than other modes.
525:evoke emotional responses and may skew results.
168:– The respondent answers with a "yes" or a "no".
1565:Pan, Yuling; Sha, Mandy; Park, Hyunjoo (2019).
2300:List of household surveys in the United States
1155:
1153:
2366:World Association for Public Opinion Research
1873:
299:. One very frequently-used rating scale is a
8:
2315:Suffolk University Political Research Center
1532:Graeff, Timothy R. (2005). "Response Bias".
786:. Unsourced material may be challenged and
1880:
1866:
1858:
1567:The Sociolinguistics of Survey Translation
975:Statistical theories of mental test scores
386:for interviewers or survey respondents.
107:In the realm of psychological testing and
1452:
857:Automated computer telephone interviewing
806:Learn how and when to remove this message
353:is used in the scale development process.
847:Computer-assisted telephone interviewing
564:
486:The level of measurement – known as the
247:
2325:Quinnipiac University Polling Institute
1811:"Seven in 10 Americans Back Euthanasia"
1219:Encyclopedia of Survey Research Methods
953:
852:Computer-assisted personal interviewing
695:Computer-assisted personal interviewing
513:If a survey question actually contains
2310:New Zealand Attitudes and Values Study
2257:Comparative Study of Electoral Systems
1833:Mastering Modern Psychological Testing
1378:
1376:
625:Researchers may be mistaken for being
55:Questionnaires are frequently used in
1742:
1740:
1738:
1736:
1252:
1250:
1185:
1183:
977:. Addison-Wesley Publishing Company.
7:
1414:Ongena, Yfke; Dijkstra, Wil (2006).
1126:Developing and Validating Test Items
959:
957:
784:adding citations to reliable sources
661:, unique links and other technology.
472:purpose in conducting the research.
374:is testing and evaluating whether a
275:with the following characteristics:
2356:International Statistical Institute
1749:Polling and the Public, 9th edition
2247:American National Election Studies
2237:List of comparative social surveys
1809:McCarthy, Justin (June 18, 2014).
1534:Encyclopedia of Social Measurement
819:influenced by previous questions.
597:Reliant on high levels of literacy
378:causes problems that could affect
25:
467:Questionnaire construction issues
252:Labelled example of a multi-item
74:consulting subject-matter experts
756:
1764:(2008). Chapter 9: Surveys. In
922:Quantitative marketing research
826:screening and rapport questions
497:of the sample vs. Brand B, and
57:quantitative marketing research
1711:(9th ed.). New York, NY:
1707:Research methods in psychology
1542:10.1016/B0-12-369398-5/00037-2
1481:Journal of Official Statistics
1424:Journal of Official Statistics
67:opinions of the participants.
1:
1509:10.3768/rtipress.bk.0023.2004
1454:10.3768/rtipress.bk.0023.2004
1447:. RTI Press. pp. 23–46.
586:optical character recognition
186:, and rank-order scale. (See
155:Questions, or items, may be:
1674:Respicius, Rwehumbiza (2010)
998:American Sociological Review
2290:International Social Survey
1841:10.1007/978-3-030-59455-8_6
664:It is not labour-intensive.
184:semantic differential scale
2461:
2430:Questionnaire construction
973:Lord, Frederic M. (1968).
867:Bureau of Labor Statistics
829:product-specific questions
721:
547:
389:Pretesting methods can be
364:
231:Thematic apperception test
48:
33:refers to the design of a
31:Questionnaire construction
2374:
2320:The Phillips Academy Poll
2148:Exploratory data analysis
2001:Sample size determination
1383:Sha, Mandy (2016-08-01).
1267:10.1002/9781119263685.ch3
1162:Human Resource Management
942:Automatic Item Generation
259:as used in questionnaires
1784:Public Opinion Quarterly
1650:Public Opinion Quarterly
1623:Public Opinion Quarterly
1608:10.13094/SMIF-2013-00006
1192:Public Opinion Quarterly
1033:Public Opinion Quarterly
451:applies methods such as
443:Experimental comparisons
190:for further information)
2261:Emerson College Polling
2153:Multivariate statistics
1996:Nonprobability sampling
1290:Willis, Gordon (2005).
1101:10.1007/0-306-47535-9_2
1093:Constructing Test Items
912:Scale (social sciences)
683:Personally administered
333:test-retest reliability
121:psychological construct
2270:European Social Survey
2252:Asian Barometer Survey
2143:Descriptive statistics
2028:Cross-sequential study
1981:Simple random sampling
1357:10.1002/0471654728.ch8
1292:Cognitive Interviewing
937:Congeneric reliability
571:Benefits and cautions
550:Survey data collection
403:Cognitive interviewing
271:data using multi-item
260:
160:Closed-ended questions
87:cognitive interviewing
2280:General Social Survey
2163:Statistical inference
2023:Cross-sectional study
1575:10.4324/9780429294914
1401:10.29115/SP-2016-0013
1300:10.4135/9781412983655
1231:10.4135/9781412963947
1134:10.4324/9780203850381
1068:10.1002/9781118634646
697:may assist with this.
544:Methods of collection
453:latent class analysis
251:
18:Pretesting (research)
2201:Audience measurement
2138:Level of measurement
1971:Sampling for surveys
1835:. pp. 223–262.
1747:Asher, Herb (2017).
1536:. pp. 411–418.
1503:. pp. 129–150.
1351:. pp. 149–171.
932:Item response theory
780:improve this section
457:item response theory
449:Statistical modeling
329:internal reliability
200:Open-ended questions
2361:Pew Research Center
2330:World Values Survey
2073:Specification error
1991:Stratified sampling
862:Official statistics
515:more than one issue
215:Sentence completion
2445:Survey methodology
2168:Statistical models
2068:Non-sampling error
1966:Statistical sample
1906:Collection methods
1796:10.1093/poq/nfq073
1635:10.1093/poq/nfn063
1261:. pp. 47–73.
1204:10.1093/poq/nfh008
917:Statistical survey
907:Marketing research
835:types of questions
345:criterion validity
341:construct validity
261:
151:Types of questions
125:operationalization
2417:
2416:
2133:Contingency table
2108:Processing errors
2093:Non-response bias
2083:Measurement error
2063:Systematic errors
1850:978-3-030-59454-1
1762:Mellenbergh, G.J.
1584:978-0-429-29491-4
1551:978-0-12-369398-3
1518:978-1-934831-24-3
1464:978-1-934831-23-6
1366:978-0-471-45841-8
1309:978-0-7619-2804-1
1276:978-1-119-26362-3
1174:10.1002/hrm.21852
1143:978-1-136-96198-4
1077:978-1-118-63461-5
816:
815:
808:
748:Question sequence
715:
714:
617:computer-assisted
428:Behavioral coding
412:Usability testing
244:Multi-item scales
16:(Redirected from
2452:
2128:Categorical data
1882:
1875:
1868:
1859:
1854:
1819:
1818:
1806:
1800:
1799:
1779:
1773:
1770:G.J. Mellenbergh
1759:
1753:
1752:
1744:
1731:
1730:
1710:
1700:
1675:
1672:
1666:
1665:
1645:
1639:
1638:
1618:
1612:
1611:
1595:
1589:
1588:
1562:
1556:
1555:
1529:
1523:
1522:
1496:
1490:
1489:
1475:
1469:
1468:
1456:
1439:
1433:
1432:
1420:
1411:
1405:
1404:
1380:
1371:
1370:
1344:
1338:
1337:
1335:
1334:
1320:
1314:
1313:
1287:
1281:
1280:
1254:
1245:
1244:
1214:
1208:
1207:
1187:
1178:
1177:
1157:
1148:
1147:
1121:
1115:
1114:
1088:
1082:
1081:
1055:
1049:
1048:
1039:(2): 409–42=42.
1028:
1022:
1021:
993:
987:
986:
970:
964:
961:
811:
804:
800:
797:
791:
760:
752:
718:Question wording
565:
523:Loaded questions
367:Pilot experiment
337:content validity
209:Word association
166:Yes/no questions
21:
2460:
2459:
2455:
2454:
2453:
2451:
2450:
2449:
2440:Market research
2420:
2419:
2418:
2413:
2370:
2334:
2295:LatinobarĂłmetro
2225:
2211:Market research
2189:
2114:
2088:Response errors
2034:
2008:Research design
1976:Random sampling
1942:
1926:Semi-structured
1898:Data collection
1892:
1890:survey research
1886:
1851:
1830:
1827:
1825:Further reading
1822:
1808:
1807:
1803:
1781:
1780:
1776:
1760:
1756:
1746:
1745:
1734:
1727:
1702:
1701:
1678:
1673:
1669:
1647:
1646:
1642:
1620:
1619:
1615:
1597:
1596:
1592:
1585:
1564:
1563:
1559:
1552:
1531:
1530:
1526:
1519:
1498:
1497:
1493:
1477:
1476:
1472:
1465:
1441:
1440:
1436:
1418:
1413:
1412:
1408:
1389:Survey Practice
1382:
1381:
1374:
1367:
1346:
1345:
1341:
1332:
1330:
1322:
1321:
1317:
1310:
1289:
1288:
1284:
1277:
1256:
1255:
1248:
1241:
1223:Sage Publishing
1216:
1215:
1211:
1189:
1188:
1181:
1159:
1158:
1151:
1144:
1123:
1122:
1118:
1111:
1090:
1089:
1085:
1078:
1057:
1056:
1052:
1030:
1029:
1025:
1010:10.2307/2092790
995:
994:
990:
972:
971:
967:
962:
955:
951:
946:
842:
812:
801:
795:
792:
777:
761:
750:
726:
720:
552:
546:
469:
384:data collection
369:
363:
351:Factor analysis
283:being examined.
246:
172:Multiple choice
153:
105:
61:social research
53:
47:
28:
23:
22:
15:
12:
11:
5:
2458:
2456:
2448:
2447:
2442:
2437:
2432:
2422:
2421:
2415:
2414:
2412:
2411:
2410:
2409:
2404:
2399:
2394:
2389:
2381:
2375:
2372:
2371:
2369:
2368:
2363:
2358:
2353:
2348:
2342:
2340:
2336:
2335:
2333:
2332:
2327:
2322:
2317:
2312:
2307:
2302:
2297:
2292:
2287:
2282:
2277:
2272:
2267:
2262:
2259:
2254:
2249:
2244:
2239:
2233:
2231:
2227:
2226:
2224:
2223:
2221:Public opinion
2218:
2213:
2208:
2203:
2197:
2195:
2191:
2190:
2188:
2187:
2186:
2185:
2180:
2175:
2165:
2160:
2155:
2150:
2145:
2140:
2135:
2130:
2124:
2122:
2116:
2115:
2113:
2112:
2111:
2110:
2105:
2103:Pseudo-opinion
2100:
2098:Coverage error
2095:
2090:
2085:
2080:
2075:
2065:
2060:
2055:
2053:Standard error
2050:
2048:Sampling error
2044:
2042:
2036:
2035:
2033:
2032:
2031:
2030:
2025:
2020:
2015:
2005:
2004:
2003:
1998:
1993:
1988:
1986:Quota sampling
1983:
1978:
1968:
1963:
1961:Sampling frame
1958:
1952:
1950:
1944:
1943:
1941:
1940:
1939:
1938:
1933:
1928:
1923:
1913:
1908:
1902:
1900:
1894:
1893:
1887:
1885:
1884:
1877:
1870:
1862:
1856:
1855:
1849:
1826:
1823:
1821:
1820:
1801:
1790:(1): 115–124.
1774:
1754:
1732:
1725:
1676:
1667:
1662:10.1086/346010
1640:
1629:(5): 847–865.
1613:
1600:Survey Methods
1590:
1583:
1557:
1550:
1524:
1517:
1491:
1470:
1463:
1434:
1406:
1372:
1365:
1339:
1315:
1308:
1282:
1275:
1246:
1239:
1209:
1198:(1): 109–130.
1179:
1168:(3): 739–750.
1149:
1142:
1116:
1109:
1083:
1076:
1050:
1045:10.1086/268840
1023:
988:
965:
952:
950:
947:
945:
944:
939:
934:
929:
924:
919:
914:
909:
904:
899:
894:
889:
884:
879:
874:
872:Questionnaires
869:
864:
859:
854:
849:
843:
841:
838:
837:
836:
830:
827:
814:
813:
796:September 2016
764:
762:
755:
749:
746:
722:Main article:
719:
716:
713:
712:
711:
710:
707:
704:
701:
698:
691:
685:
679:
678:
677:
676:
672:
668:
665:
662:
655:
652:
648:
643:
639:
638:
637:
636:
633:
630:
623:
620:
611:
607:
606:
605:
604:
601:
598:
595:
592:
589:
582:
577:
573:
572:
569:
548:Main article:
545:
542:
468:
465:
461:
460:
446:
440:
432:
424:
416:
408:
362:
359:
358:
357:
354:
348:
325:
310:
307:
304:
293:
290:
287:
284:
265:social science
245:
242:
241:
240:
236:
235:
234:
228:
225:speech balloon
221:
218:
212:
206:
197:
196:
195:
191:
175:
169:
152:
149:
142:
141:
138:
135:
109:questionnaires
104:
101:
100:
99:
96:
93:
90:
79:
78:
75:
49:Main article:
46:
45:Questionnaires
43:
26:
24:
14:
13:
10:
9:
6:
4:
3:
2:
2457:
2446:
2443:
2441:
2438:
2436:
2435:Psychometrics
2433:
2431:
2428:
2427:
2425:
2408:
2405:
2403:
2400:
2398:
2395:
2393:
2390:
2388:
2385:
2384:
2382:
2380:
2377:
2376:
2373:
2367:
2364:
2362:
2359:
2357:
2354:
2352:
2349:
2347:
2344:
2343:
2341:
2337:
2331:
2328:
2326:
2323:
2321:
2318:
2316:
2313:
2311:
2308:
2306:
2303:
2301:
2298:
2296:
2293:
2291:
2288:
2286:
2283:
2281:
2278:
2276:
2273:
2271:
2268:
2266:
2265:Eurobarometer
2263:
2260:
2258:
2255:
2253:
2250:
2248:
2245:
2243:
2242:Afrobarometer
2240:
2238:
2235:
2234:
2232:
2230:Major surveys
2228:
2222:
2219:
2217:
2214:
2212:
2209:
2207:
2204:
2202:
2199:
2198:
2196:
2192:
2184:
2181:
2179:
2176:
2174:
2171:
2170:
2169:
2166:
2164:
2161:
2159:
2158:Psychometrics
2156:
2154:
2151:
2149:
2146:
2144:
2141:
2139:
2136:
2134:
2131:
2129:
2126:
2125:
2123:
2121:
2120:Data analysis
2117:
2109:
2106:
2104:
2101:
2099:
2096:
2094:
2091:
2089:
2086:
2084:
2081:
2079:
2076:
2074:
2071:
2070:
2069:
2066:
2064:
2061:
2059:
2058:Sampling bias
2056:
2054:
2051:
2049:
2046:
2045:
2043:
2041:
2040:Survey errors
2037:
2029:
2026:
2024:
2021:
2019:
2016:
2014:
2011:
2010:
2009:
2006:
2002:
1999:
1997:
1994:
1992:
1989:
1987:
1984:
1982:
1979:
1977:
1974:
1973:
1972:
1969:
1967:
1964:
1962:
1959:
1957:
1954:
1953:
1951:
1949:
1945:
1937:
1934:
1932:
1929:
1927:
1924:
1922:
1919:
1918:
1917:
1914:
1912:
1911:Questionnaire
1909:
1907:
1904:
1903:
1901:
1899:
1895:
1891:
1883:
1878:
1876:
1871:
1869:
1864:
1863:
1860:
1852:
1846:
1842:
1838:
1834:
1829:
1828:
1824:
1816:
1812:
1805:
1802:
1797:
1793:
1789:
1785:
1778:
1775:
1771:
1767:
1763:
1758:
1755:
1750:
1743:
1741:
1739:
1737:
1733:
1728:
1726:9780078035180
1722:
1718:
1714:
1709:
1708:
1699:
1697:
1695:
1693:
1691:
1689:
1687:
1685:
1683:
1681:
1677:
1671:
1668:
1663:
1659:
1656:(1): 79–125.
1655:
1651:
1644:
1641:
1636:
1632:
1628:
1624:
1617:
1614:
1609:
1605:
1601:
1594:
1591:
1586:
1580:
1576:
1572:
1568:
1561:
1558:
1553:
1547:
1543:
1539:
1535:
1528:
1525:
1520:
1514:
1510:
1506:
1502:
1495:
1492:
1488:(4): 503–529.
1487:
1483:
1482:
1474:
1471:
1466:
1460:
1455:
1450:
1446:
1438:
1435:
1431:(3): 419–451.
1430:
1426:
1425:
1417:
1410:
1407:
1402:
1398:
1394:
1390:
1386:
1379:
1377:
1373:
1368:
1362:
1358:
1354:
1350:
1343:
1340:
1329:
1325:
1324:"Web Probing"
1319:
1316:
1311:
1305:
1301:
1297:
1293:
1286:
1283:
1278:
1272:
1268:
1264:
1260:
1253:
1251:
1247:
1242:
1240:9781412918084
1236:
1232:
1228:
1224:
1220:
1213:
1210:
1205:
1201:
1197:
1193:
1186:
1184:
1180:
1175:
1171:
1167:
1163:
1156:
1154:
1150:
1145:
1139:
1135:
1131:
1127:
1120:
1117:
1112:
1110:0-7923-8077-0
1106:
1102:
1098:
1094:
1087:
1084:
1079:
1073:
1069:
1065:
1061:
1054:
1051:
1046:
1042:
1038:
1034:
1027:
1024:
1019:
1015:
1011:
1007:
1004:(1): 93–101.
1003:
999:
992:
989:
984:
980:
976:
969:
966:
960:
958:
954:
948:
943:
940:
938:
935:
933:
930:
928:
927:Item analysis
925:
923:
920:
918:
915:
913:
910:
908:
905:
903:
900:
898:
895:
893:
890:
888:
887:NIPO Software
885:
883:
880:
878:
875:
873:
870:
868:
865:
863:
860:
858:
855:
853:
850:
848:
845:
844:
839:
834:
831:
828:
825:
824:
823:
820:
810:
807:
799:
789:
785:
781:
775:
774:
770:
765:This section
763:
759:
754:
753:
747:
745:
741:
739:
734:
730:
725:
717:
708:
705:
702:
699:
696:
692:
688:
687:
686:
684:
681:
680:
673:
671:instructions.
669:
666:
663:
660:
656:
653:
649:
646:
645:
644:
641:
640:
634:
631:
628:
627:telemarketers
624:
621:
618:
614:
613:
612:
609:
608:
602:
599:
596:
593:
590:
587:
583:
580:
579:
578:
575:
574:
570:
567:
566:
563:
560:
558:
551:
543:
541:
538:
534:
530:
526:
524:
518:
516:
511:
507:
504:
500:
496:
491:
489:
484:
482:
477:
473:
466:
464:
458:
454:
450:
447:
444:
441:
438:
437:
436:Expert review
433:
430:
429:
425:
422:
421:
417:
414:
413:
409:
405:
404:
400:
399:
398:
396:
392:
387:
385:
381:
377:
376:questionnaire
373:
368:
360:
355:
352:
349:
346:
342:
338:
334:
330:
326:
323:
319:
315:
311:
308:
305:
302:
298:
294:
291:
288:
285:
282:
278:
277:
276:
274:
270:
266:
258:
255:
250:
243:
237:
232:
229:
226:
222:
219:
216:
213:
210:
207:
204:
203:
201:
198:
192:
189:
185:
181:
176:
173:
170:
167:
164:
163:
161:
158:
157:
156:
150:
148:
145:
139:
136:
133:
132:
131:
128:
126:
122:
118:
114:
110:
102:
97:
94:
91:
88:
84:
83:
82:
76:
73:
72:
71:
68:
64:
62:
58:
52:
51:Questionnaire
44:
42:
40:
39:statistically
36:
35:questionnaire
32:
19:
2339:Associations
2216:Opinion poll
2194:Applications
2018:Cohort study
1931:Unstructured
1832:
1814:
1804:
1787:
1783:
1777:
1757:
1748:
1706:
1670:
1653:
1649:
1643:
1626:
1622:
1616:
1599:
1593:
1566:
1560:
1533:
1527:
1500:
1494:
1485:
1479:
1473:
1444:
1437:
1428:
1422:
1409:
1392:
1388:
1348:
1342:
1331:. Retrieved
1327:
1318:
1291:
1285:
1258:
1218:
1212:
1195:
1191:
1165:
1161:
1125:
1119:
1092:
1086:
1059:
1053:
1036:
1032:
1026:
1001:
997:
991:
974:
968:
892:DIY research
821:
817:
802:
793:
778:Please help
766:
742:
735:
731:
727:
682:
561:
557:mode effects
553:
539:
535:
531:
527:
519:
512:
508:
498:
494:
492:
485:
478:
474:
470:
462:
448:
442:
434:
426:
419:
411:
407:interviewer.
402:
391:quantitative
388:
380:data quality
371:
370:
322:psychometric
301:Likert scale
297:rating scale
269:quantitative
262:
254:psychometric
180:Likert scale
154:
146:
143:
129:
116:
112:
106:
80:
69:
65:
54:
30:
29:
2275:Gallup Poll
2078:Frame error
2013:Panel study
1948:Methodology
1715:. pp.
1713:McGraw Hill
882:Data mining
877:Paid survey
833:demographic
738:readability
675:population.
642:Electronic
395:qualitative
85:conducting
2424:Categories
2407:Statistics
2397:Psychology
2206:Demography
2183:Structural
2178:Log-linear
1921:Structured
1395:(3): 1–8.
1333:2023-10-24
949:References
610:Telephone
481:population
372:Pretesting
365:See also:
361:Pretesting
239:pregnant).
103:Test items
37:to gather
2402:Sociology
2383:Projects
2173:Graphical
1916:Interview
1766:H.J. Adèr
983:769112327
902:Marketing
767:does not
420:Vignettes
113:test Item
2392:Politics
2387:Business
2379:Category
840:See also
476:survey.
314:reliable
281:variable
1888:Social
1018:2092790
788:removed
773:sources
659:cookies
651:itself.
576:Postal
568:Method
503:metrics
263:Within
1956:Census
1936:Couple
1847:
1815:Gallup
1768:&
1723:
1719:–175.
1581:
1548:
1515:
1461:
1363:
1306:
1273:
1237:
1140:
1107:
1074:
1016:
981:
690:cases.
343:, and
324:scale.
273:scales
1419:(PDF)
1014:JSTOR
488:scale
318:valid
257:scale
194:time.
188:scale
123:(see
1845:ISBN
1721:ISBN
1579:ISBN
1546:ISBN
1513:ISBN
1459:ISBN
1361:ISBN
1304:ISBN
1271:ISBN
1235:ISBN
1138:ISBN
1105:ISBN
1072:ISBN
979:OCLC
897:SPSS
771:any
769:cite
455:and
382:and
316:and
117:item
59:and
1837:doi
1792:doi
1717:161
1658:doi
1631:doi
1604:doi
1571:doi
1538:doi
1505:doi
1449:doi
1397:doi
1353:doi
1296:doi
1263:doi
1227:doi
1200:doi
1170:doi
1130:doi
1097:doi
1064:doi
1041:doi
1006:doi
782:by
393:or
115:or
2426::
1843:.
1813:.
1788:75
1786:.
1735:^
1679:^
1654:67
1652:.
1627:72
1625:.
1602:.
1577:.
1569:.
1544:.
1511:.
1486:28
1484:.
1457:.
1429:22
1427:.
1421:.
1391:.
1387:.
1375:^
1359:.
1326:.
1302:.
1294:.
1269:.
1249:^
1233:.
1225:.
1221:.
1196:68
1194:.
1182:^
1166:57
1164:.
1152:^
1136:.
1128:.
1103:.
1070:.
1062:.
1037:48
1035:.
1012:.
1002:34
1000:.
956:^
499:y%
495:x%
483:.
339:,
331:,
182:,
1881:e
1874:t
1867:v
1853:.
1839::
1817:.
1798:.
1794::
1751:.
1729:.
1664:.
1660::
1637:.
1633::
1610:.
1606::
1587:.
1573::
1554:.
1540::
1521:.
1507::
1467:.
1451::
1403:.
1399::
1393:9
1369:.
1355::
1336:.
1312:.
1298::
1279:.
1265::
1243:.
1229::
1206:.
1202::
1176:.
1172::
1146:.
1132::
1113:.
1099::
1080:.
1066::
1047:.
1043::
1020:.
1008::
985:.
809:)
803:(
798:)
794:(
790:.
776:.
629:.
619:.
588:.
459:.
347:.
303:.
227:.
20:)
Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.