ERIC Citations & Abstracts for Survey Construction & Research - Introductory Guides for Educational Practitioners & Novice Researchers
Instructions for ERIC Documents Access
Search Strategy:
Surveys or Questionnaires [as major ERIC Descriptors]
AND
Research Methodology or Evaluation Methods or Test Construction [ERIC Descriptors]
AND, possibly,
Student Surveys or Teacher Surveys or Community Surveys or Review Literature [ERIC Descriptors or Document Type]
ED423291 TM029098
Six Criteria for Survey Sample Design Evaluation.
Wang, Lin; Fan, Xitao
1998
13p.; Paper presented at the Annual Meeting of the American
Educational Research Association (San Diego, CA, April 13-17, 1998).
Document Type: REVIEW LITERATURE (070); PROJECT DESCRIPTION (141)
The popularity of the sample survey in educational research makes
it necessary for consumers to tell a good study from a poor one.
Several sources were identified that gave advice on how to evaluate a
sample design. The sources are either limited or too extensive to
use in a practical sense. The purpose of this paper is to recommend
six important yet practical criteria in evaluating the quality of a
sample design in survey research. The six criteria are: (1) a
clearly specified population; (2) an explicitly stated unit of
analysis; (3) a specification of determining a desired sample size;
(4) an informative description of the selection procedures; (5) a
description of the response rate and nonrespondence treatment; and
(6) demonstration of appropriate estimation procedures. For each
criterion, discussion is focused on definitions, problems that are
found in literature, and consequences of the problems. (Contains 26
references.) (Author)
Descriptors: *Criteria; *Data Collection; Educational Research;
Evaluation Methods; *Research Design; Response Rates (Questionnaires);
*Sampling; *Surveys
EJ565082 EA534636
Constructing a Fact Sheet: The First Step in Planning a Meaningful
Survey.
McNamara, James F.
International Journal of Educational Reform, v7 n2 p195-206 Apr
1998
ISSN: 1056-7879
Document Type: JOURNAL ARTICLE (080); EVALUATIVE REPORT (142)
A "fact sheet" is defined as a single two-sided sheet (or one-page
folded brochure) that briefly describes all major aspects of a
scientific survey or poll in nontechnical terms. A fact sheet can be
used to plan all phases of a survey, from clarifying purpose, to
distributing results. A fact sheet may be used as a communication
tool in each phase of survey. (13 references) (MLH)
Descriptors: *Educational Research; Elementary Secondary Education;
*Research Methodology; *Sampling; *Scientific Research; *Surveys
Identifiers: *Fact Sheets; Opinion Polls
ED405379 TM026245
Your Opinion, Please How To Build the Best Questionnaires in the
Field of Education.
Cox, James
1996
103p.
ISBN: 0-8039-6523-0
Available From: Corwin Press, Inc., A Sage Publications Company,
2455 Teller Road, Thousand Oaks, CA 91320; e-mail:
order#064;corwin.sagepub.com; fax: 805-499-0871 (paperback: ISBN-0-8039-
6523-0, $21.95; clothbound: ISBN-0-8039-6522-2, $49.95).
Document Type: BOOK (010); NON-CLASSROOM MATERIAL (055)
Target Audience: Researchers
This manual explains how to construct a questionnaire. It is
intended for the novice researcher who has little experience in
questionnaire construction. The first seven chapters discuss the
following seven stages in questionnaire development: (1) establishing
the guiding questions; (2) operationalizing and clarifying the
guiding questions; (3) writing items and formatting responses; (4)
conducting the alignment check; (5) writing directions; (6)
categorizing respondents; and (7) marketing the questionnaire.
Chapters 8 through 12 discuss the evaluation, analysis, and reporting
of questionnaire data. The discussion is accompanied by a prototype
questionnaire about the leadership of elementary school principals.
This model is developed throughout the chapters. Attached resources
A through C contain further product examples. Resource D contains a
checklist for evaluating questionnaire flaws, and Resource E contains
two additional examples to illustrate the first six stages of
questionnaire development. (Contains six figures and two tables.)(SLD)
Descriptors: Data Analysis; *Educational Research; Models;
*Opinions; Questioning Techniques; *Questionnaires; Research Design;
Researchers; Research Methodology; *Response Rates (Questionnaires);
*Test Construction; Test Items; Test Use
ED421522 TM028847
How To Report on Surveys. The Survey Kit, Volume 9.
Fink, Arlene
1995
91p.; The complete "Survey Kit" series consists of nine separate
books, see TM 028 839-847.
ISBN: 0-8039-7385-3
Available From: SAGE Publications, Inc., 2455 Teller Road, Thousand
Oaks, CA 91320; e-mail: order#064;sagepub.com ($12.95).
Document Type: BOOK (010); NON-CLASSROOM MATERIAL (055)
Target Audience: Researchers; Students
The nine-volume Survey Kit is designed to help readers prepare and
conduct surveys and become better users of survey results. All the
books in the series contain instructional objectives, exercises and
answers, examples of surveys in use, illustrations of survey
questions, guidelines for action, checklists of "dos and don'ts," and
annotated references. This volume, ninth in the series, shows
readers how to prepare more effective oral and written survey reports.
The volume includes guidelines for preparing overhead transparencies
and a step-by-step account of how to talk about a survey and the data
analysis. It also demonstrates the preparation of written reports
for technical and general audiences. The following chapters are
included: (1) "Lists, Charts, and Tables: Presenting the Survey's
Results"; (2) "Talking about the Survey"; and (3) "The Written
Report." An annotated list of six suggested readings is included.
(Contains 16 figures.) (SLD)
Descriptors: Educational Research; Evaluation Methods; Evaluation
Utilization; Guides; Questionnaires; Reliability; Research
Methodology; *Research Reports; Speech Skills; *Surveys; Tables
(Data); *Technical Writing; Validity; *Writing for Publication
Identifiers: *Oral Reports; Survey Research
ED421521 TM028846
How To Analyze Survey Data. The Survey Kit, Volume 8.
Fink, Arlene
1995
101p.; The complete "Survey Kit" series consists of nine separate
books, see TM 028 839-847.
ISBN: 0-8039-7386-1
Available From: SAGE Publications, Inc., 2455 Teller Road, Thousand
Oaks, CA 91320; e-mail: order#064;sagepub.com ($12.95).
Document Type: BOOK (010); NON-CLASSROOM MATERIAL (055)
Target Audience: Researchers; Students
The nine-volume Survey Kit is designed to help readers prepare and
All the books in the series contain instructional objectives, exercises and
answers, examples of surveys in use, illustrations of survey
questions, guidelines for action, checklists of "dos and don'ts," and
annotated references. This volume, eighth in the series, shows what
statistics can do for surveys, describes measurement scales in
detail, and demonstrates how to choose a method to analyze survey
results. While it teaches the basic vocabulary of statistics and the
principles and logic behind the selection and interpretation of
commonly used methods to analyze survey data, it does not teach the
reader to be a survey statistician. This book, however, will enable
the researcher to tell the statistical consultant what is needed and
to interpret the results. The following chapters are included: (1)
"What Statistics Do for Surveys"; (2) "Relationships or Correlation";
and (3) "Selecting Commonly Used Statistical Methods for Surveys." An
annotated list of six suggested readings and a glossary are provided.
(Contains 16 examples, 9 figures, and 2 tables.) (SLD)
Descriptors: Costs; *Data Analysis; Data Collection; Educational
Research; Evaluation Methods; Evaluation Utilization; Questionnaires;
Reliability; Research Design; *Research Methodology; *Statistics;
*Surveys; *Test Construction; Validity
Identifiers: Survey Research
ED421520 TM028845
How To Measure Survey Reliability and Validity. The Survey Kit,
Volume 7.
Litwin, Mark S.
1995
87p.; The complete "Survey Kit" series consists of nine separate
books, see TM 028 839-847.
ISBN: 0-8039-5704-1
Available From: SAGE Publications, Inc., 2455 Teller Road, Thousand
Oaks, CA 91320; e-mail: order#064;sagepub.com ($11.95).
Document Type: BOOK (010); NON-CLASSROOM MATERIAL (055)
Target Audience: Researchers; Students
The nine-volume Survey Kit is designed to help readers prepare and
All the books in the series contain instructional objectives, exercises and
answers, examples of surveys in use, illustrations of survey
questions, guidelines for action, checklists of "dos and don'ts," and
annotated references. This volume, seventh in the series, shows
readers how to assess and interpret the quality of their survey data
by examining the survey instrument thoroughly. The book explains how
to code and pilot test new and established surveys. It also covers
such issues as how to measure reliability (such as test-retest,
alternate-form, internal consistency, interobserver and intraobserver
reliability). How to measure content, criterion, and construct
validities is explained, and how to address cross-cultural issues in
survey research is described. Also described is how to scale and
score a survey. The following chapters are included: (1) "Overview
of Psychometrics"; (2) "Reliability"; (3) "Validity"; (4) "Scaling
and Scoring"; (5) "Creating and Using a Codebook"; (6) "Pilot
Testing"; and (7) "Multicultural Issues." An annotated list of five
suggested readings and a glossary are included. (Contains 32
examples.) (SLD)
Descriptors: Costs; Data Collection; Educational Research;
Evaluation Methods; Evaluation Utilization; *Measurement Techniques;
Multicultural Education; Pilot Projects; Psychometrics;
Questionnaires; *Reliability; Research Design; *Research Methodology;
Scaling; Scoring; *Surveys; *Test Construction; *Validity
Identifiers: Survey Research
ED421519 TM028844
How To Sample in Surveys. The Survey Kit, Volume 6.
Fink, Arlene
1995
73p.; The complete "Survey Kit" series consists of nine separate
books, see TM 028 839-847.
ISBN: 0-8039-5754-8
Available From: SAGE Publications, Inc., 2455 Teller Road, Thousand
Oaks, CA 91320; e-mail: order#064;sagepub.com ($11.95).
Document Type: BOOK (010); NON-CLASSROOM MATERIAL (055)
Target Audience: Researchers; Students
The nine-volume Survey Kit is designed to help readers prepare and
All the books in the series contain instructional objectives, exercises and
answers, examples of surveys in use, illustrations of survey
questions, guidelines for action, checklists of "dos and don'ts," and
annotated references. This volume, sixth in the series, shows
readers how to select and use the most appropriate sampling methods
for their surveys. It covers myriad sampling techniques such as
simple random sampling, stratified random sampling, systematic
sampling, cluster sampling, convenience sampling, snowball sampling,
quota sampling, and focus groups. The volume also describes, in
detail, the following: inclusion and exclusion criteria, the logic in
estimating sampling errors and sample size determinations, the
sources of error in sampling, and how to calculate the response rate.
The two chapters are titled: (1) "Target Populations and Samples";
and (2) "Statistics and Samples." An annotated list of 16 references
for additional reading and a glossary are provided. (Contains 19
examples and 2 figures.) (SLD)
Descriptors: Costs; *Data Collection; Educational Research; Error
of Measurement; Evaluation Methods; Evaluation Utilization; Focus
Groups; Questionnaires; Reliability; Research Design; *Research
Methodology; Response Rates (Questionnaires); Sample Size; *Sampling;
Statistical Analysis; *Surveys; *Test Construction; Validity
Identifiers: Survey Research
ED421518 TM028843
How To Design Surveys. The Survey Kit, Volume 5.
Fink, Arlene
1995
73p.; The complete "Survey Kit" series consists of nine separate
books, see TM 028 839-847.
ISBN: 0-8039-7387-X
Available From: SAGE Publications, Inc., 2455 Teller Road, Thousand
Oaks, CA 91320; e-mail: order#064;sagepub.com ($11.95).
Document Type: BOOK (010); NON-CLASSROOM MATERIAL (055)
Target Audience: Researchers; Students
The nine-volume Survey Kit is designed to help readers prepare and
All the books in the series contain instructional objectives, exercises and
answers, examples of surveys in use, illustrations of survey
questions, guidelines for action, checklists of "dos and don'ts," and
annotated references. This volume, fifth in the series, guides the
reader in selecting and using appropriate survey designs. The
following specific objectives are met in this volume: (1) describe
the major features of high-quality survey systems; (2) identify the
questions that structure survey designs; (3) distinguish between
experimental and observational designs; (4) explain the
characteristics, benefits, and concerns of designs that include
concurrent controls with and without random assignment, self- and
historical controls, and cross-sectional, cohort, and case- control
designs; (5) identify the risks to internal validity; and (7)
identify the risks to a design's external validity. The chapters are
titled "Useful Surveys" and "Classification of Designs for Surveys."
An annotated list of five additional readings is provided. (Contains
18 examples and 5 figures.) (SLD)
Descriptors: Costs; *Data Collection; *Educational Research;
Evaluation Methods; Evaluation Utilization; Experiments; Observation;
Questionnaires; *Research Design; Research Methodology; *Surveys;
*Test Construction; Validity
Identifiers: Survey Research
ED421517 TM028842
How To Conduct Interviews by Telephone and In Person. The Survey
Kit, Volume 4.
Frey, James H.; Oishi, Sabine Mertens
1995
170p.; The complete "Survey Kit" series consists of nine separate
books, see TM 028 839-847.
ISBN: 0-8039-5719-X
Available From: SAGE Publications, Inc., 2455 Teller Road, Thousand
Oaks, CA 91320; e-mail: order#064;sagepub.com ($17.95).
Document Type: BOOK (010); NON-CLASSROOM MATERIAL (055)
Target Audience: Researchers; Students
The nine-volume Survey Kit is designed to help readers prepare and
All the books in the series contain instructional objectives, exercises and
answers, examples of surveys in use, illustrations of survey
questions, guidelines for action, checklists of "dos and don'ts," and
annotated references. This volume, fourth in the series, explains
how to write interview questions with structured interviewer
instructions and how to write questions that are most effective for
telephone and in-person interviews. Designing preletters and scripts
for recall is discussed, with suggestions for organizing a flowing
interview that considers possible effects of question order. Also
described is how to design an eligibility screen and how to write a
job description for an interviewer. The volume also shows how to
develop an interviewer training manual and a training session. The
following chapters are included: (1) "Overview of Telephone and In-
Person Interviews"; (2) "Questionnaire Construction"; and (3)
"Interviewer Selection and Training." An annotated list of 15 sources
for additional reading is provided. (Contains 39 examples.) (SLD)
Descriptors: Costs; *Data Collection; *Educational Research;
Eligibility; Evaluation Methods; Evaluation Utilization; *Interviews;
*Mail Surveys; Questionnaires; Reliability; Research Design;
*Research Methodology; *Test Construction; Validity
Identifiers: *Interviewers; Survey Research
ED421516 TM028841
How To Conduct Self-Administered and Mail Surveys. The Survey Kit,
Volume 3.
Bourque, Linda B.; Fielder, Eve P.
1995
223p.; The complete "Survey Kit" series consists of nine separate
books, see TM 028 839-847.
ISBN: 0-8039-7168-0
Available From: SAGE Publications, Inc., 2455 Teller Road, Thousand
Oaks, CA 91320; e-mail: order#064;sagepub.com ($20.95).
Document Type: BOOK (010); NON-CLASSROOM MATERIAL (055)
Target Audience: Researchers; Students
The nine-volume Survey Kit is designed to help readers prepare and
All the books in the series contain instructional objectives, exercises and
answers, examples of surveys in use, illustrations of survey
questions, guidelines for action, checklists of "dos and don'ts," and
annotated references. This volume, third in the series, demonstrates
how to develop and administer self-administered and mail surveys.
Areas covered are the kinds of self-administered questionnaires, the
circumstances under which they are appropriately used, and the skills
needed to design them, estimate their costs, select appropriate
samples, and document the decisions made. Follow-up procedures for
nonrespondents are also explained. The following chapters are
included: (1) "Overview of Self-Administered Questionnaires"; (2)
"Content of the Questionnaire"; (3) "'User Friendly Questionnaires'
and Response Categories"; (4) "Format of the Questionnaire"; and (5)
"Implementation." A list of 35 annotated sources for further reading
is attached. (Contains 2 examples and 16 figures.) (SLD)
Descriptors: Costs; *Data Collection; Educational Research;
Evaluation Methods; Evaluation Utilization; *Mail Surveys;
*Questionnaires; Reliability; Research Design; *Research Methodology;
Sampling; *Test Construction; Validity
Identifiers: *Self Report Measures; Survey Research
ED421515 TM028840
How To Ask Survey Questions. The Survey Kit, Volume 2.
Fink, Arlene
1995
105p.; The complete "Survey Kit" series consists of nine separate
books, see TM 028 839-847.
ISBN: 0-8039-5745-9
Available From: SAGE Publications, Inc., 2455 Teller Road, Thousand
Oaks, CA 91320; e-mail: order#064;sagepub.com ($14.95).
Document Type: BOOK (010); NON-CLASSROOM MATERIAL (055)
Target Audience: Researchers; Students
The nine-volume Survey Kit is designed to help readers prepare and
All the books in the series contain instructional objectives, exercises and
answers, examples of surveys in use, illustrations of survey
questions, guidelines for action, checklists of "dos and don'ts," and
annotated references. This volume, second in the series, is designed
to guide the reader to prepare and use reliable and valid survey
questions. The first objective is to help the user understand a
survey's cultural, psychological, economic, and political contexts.
The survey developer is encouraged to ask valid questions that make
sense to the respondent, and are concrete, with well-constructed
sentences and careful word choice. The use is led to ask questions
correctly through the use of meaningful response categories,
appropriately grouped. Also discussed is applying special
questioning techniques as needed. The following chapters are
included: (1) "Asking Questions: A Matter of Context"; (2) "Keep
Questions Closed or Open Them Up?"; (3) "Responses: Choices and
Measurement"; and (4) "Knowledge, Attitudes, and Behavior: Additional
Tips When Creating Survey Questions." A list of 15 annotated
additional readings is attached. (Contains 32 examples and 4
tables.) (SLD)
Descriptors: Attitude Measures; *Data Collection; *Educational
Research; Evaluation Methods; Evaluation Utilization; Measurement
Techniques; *Questioning Techniques; Questionnaires; Reliability;
Research Design; *Research Methodology; *Surveys; Test Construction;
Validity
Identifiers: Survey Research
ED421514 TM028839
The Survey Handbook. The Survey Kit, Volume 1.
Fink, Arlene
1995
129p.; The complete "Survey Kit" series consists of nine separate
books, see TM 028 839-847.
ISBN: 0-8039-5934-6
Available From: SAGE Publications, Inc., 2455 Teller Road, Thousand
Oaks, CA 91320; e-mail: order#064;sagepub.com ($16.95).
Document Type: BOOK (010); NON-CLASSROOM MATERIAL (055)
Target Audience: Researchers; Students
The nine-volume Survey Kit is designed to help readers prepare and
All the books in the series contain instructional objectives, exercises and
answers, examples of surveys in use, illustrations of survey
questions, guidelines for action, checklists of "dos and don'ts," and
annotated references. This volume, the first in the series, deals
with skills and resources needed to conduct a survey. The skills
include identifying specific survey objectives, designing studies and
sampling respondents, developing reliable and valid self-administered
questionnaires and interviews, administering the survey, and
analyzing and reporting the results. Specific objectives are to
identify the characteristics of high-quality surveys, describe the
usefulness of surveys, and distinguish among types of survey
instruments. Reliability and validity are defined, and ways to
interpret data from open-ended questions are discussed. Other
aspects of survey administration, including considerations of cost
and efficiency, are discussed. The following chapters are included:
(1) "What Is a Survey? When Do You Use One?"; (2) "Sound Survey
Design"; (3) "Reliable and Valid Survey Instruments"; and (4)
"Reasonable Resources." An annotated list of 31 additional readings
is provided. (Contains 32 examples, 6 figures, and 1 table.) (SLD)
Descriptors: Costs; *Data Collection; *Educational Research;
Evaluation Methods; Evaluation Utilization; Questionnaires;
Reliability; Research Design; *Research Methodology; *Surveys; *Test
Construction; Validity
Identifiers: Survey Research
EJ480286 SO525237
The Organizational Survey Process. General Steps and Practical
Considerations.
Edwards, Jack E.; Thomas, Marie D.
American Behavioral Scientist, v36 n4 p419-42 Mar 1993
ISSN: 0002-7642
Document Type: PROJECT DESCRIPTION (141); JOURNAL ARTICLE (080)
Target Audience: Researchers
Asserts that conducting an organizational survey efficiently and
effectively requires detailed planning. Provides an outline of the
general steps common to organizational surveys but cautions that the
process cannot be covered fully in a brief article. Presents a five-
phase process and discusses common problems and pitfalls. (CFR)
Descriptors: Higher Education; Needs Assessment; Organizational
Climate; *Organizational Effectiveness; *Organizations (Groups);
Policy Formation; *Research Design; *Researchers; *Research
Methodology; Research Problems; Research Skills; *Surveys
ED360938 HE026677
Student Satisfaction Surveys: Measurements and Utilization Issues.
AIR 1993 Annual Forum Paper.
Sanders, Liz; Chan, Susy
May 1993
20p.; Paper presented at the Annual Forum of the Association for
Institutional Research (33rd, Chicago, IL, May 16-19, 1993).
Document Type: PROJECT DESCRIPTION (141); CONFERENCE PAPER (150)
Target Audience: Administrators; Researchers; Practitioners
Student satisfaction surveys assess satisfaction with various
facets of the university and includes key sets of questions on
programs and services, university learning and social environment,
university mission and values, educational preparation, transfer
intent, general satisfaction, attitudes toward coursework, and
student demographic information. Efforts at DePaul University
(Illinois) in meeting student expectations of the educational
experience are discussed including: (1) the methodology for
successfully conducting student satisfaction surveys, (2) the
implications of these surveys for institutional research, and (3) the
strategies for maximizing the use of student satisfaction data.
Specific topics discussed include DePaul University's experiences and
efforts in survey development, sample selection, survey preparation
and mailing, and data processing. Areas for continued improvement in
conducting and utilizing these types of surveys are also examined.
(Contains five references.) (GLR)
Descriptors: College Students; Data Analysis; Data Collection;
Educational Environment; Higher Education; *Information Utilization;
*Institutional Research; *Research Methodology; Student Attitudes;
Student College Relationship; Student Educational Objectives; Student
Needs; *Surveys
Identifiers: *AIR Forum; Cooperative Institutional Research Program;
*De Paul University IL; Diversity (Student); Total Quality Management
ED358090 SP034575
When "Do It Yourself" Does It Best: The Power of Teacher-Made
Surveys and Tests.
Dereshiwsky, Mary I.
Apr 1993
38p.; Paper presented at the Honors Week Symposium (Flagstaff, AZ,
March 31-April 1, 1993).
Document Type: CONFERENCE PAPER (150); TEST, QUESTIONNAIRE (160);
PROJECT DESCRIPTION (141)
Target Audience: Teachers; Practitioners
Classroom teachers have the best possible vantage point for
constructing locally appropriate surveys and tests; the fact is,
however, that teachers tend to rely on nationally mass-produced and
marketed test packages. The purpose of this paper is to present a
procedure for developing and refining teacher-made surveys and tests,
which would be valid and reliable for meeting local needs. First, a
brief rationale is given for teachers producing their own
instrumentation. Next, an easy-to-apply process for developing and
pilot-testing one's surveys and tests is presented, a process that
requires no computers or statistics, but rather depends on open
sharing, discussion, and communication with colleagues. To
illustrate these procedures, an actual example of a survey used to
evaluate the 1992 Arizona Leadership Academy is provided. Four
figures are included. Figures 1 and 2 graphically depict factors to
consider in designing locally appropriate instrumentation, and show
various perspectives of "expert judges" in the instrumentation pilot-
test process. Figures 3 and 4 consist, respectively, of a sample
general pilot-test matrix and a pilot-test matrix of expert judges'
comments from the 1992 Arizona Leadership Academy Evaluation.
Appendices provide a draft of a cover letter to be mailed to pilot-
test judges, an initial survey draft, pilot judges' comment sheet,
and a final (post-pilot) survey draft. (Contains 20 references.)(LL)
Descriptors: Elementary Secondary Education; Evaluation Criteria;
Evaluation Methods; Evaluators; Interprofessional Relationship; *Peer
Evaluation; *Pilot Projects; *Surveys; Teacher Attitudes; *Teacher
Made Tests; *Test Construction; Test Reliability; *Test Reviews; Test
Validity
Identifiers: Commercially Prepared Materials; Northern Arizona Univ
Center Excellence in Educ
ED350915 HE025892
Questionnaire Survey Research: What Works. Resources for
Institutional Research, Number Six.
Suskie, Linda A.
Association for Institutional Research. 1992
111p.; For a related book, see HE 025 891.
Available From: Association for Institutional Research, 314 Stone
Building, Florida State University, Tallahassee, FL 32306-3038 ($9.95
prepaid).
Document Type: REVIEW LITERATURE (070)
Target Audience: Researchers
This monograph for institutional researchers on questionnaire
survey research aims to be both a guide to the basic steps of survey
research and a useful reference tool. The monograph is in an
informal, question and answer format and organized around the various
steps of the survey research process. Chapter I discusses planning
the survey including determining the purpose of the study, collecting
background information, designing the survey, and making a time line
for completing the project. Chapter II introduces questionnaire
design by discussing the pros and cons of various question formats.
Chapter III offers guidance on developing the questionnaire itself in
discussions of ways to maximize the response rate and establish
validity and reliability. Chapters IV and V deal with the mechanics
of conducting a survey including preparing a cover letter, pilot
testing, and making follow-up mailings as well as preparing the
returned surveys for data processing. Chapter VI summarizes
statistical principles as a guide to choosing the most appropriate
statistical analysis. Chapter VII discusses reporting the survey
results. Sample questionnaires are appended. A bibliography lists
65 sources grouped by topic. (JB)
Descriptors: Data Collection; Higher Education; *Institutional
Research; *Questionnaires; Research Design; *Research Methodology;
Response Rates (Questionnaires); Scoring; *Surveys
ED326488 SP032657
Using Questionnaires in Small-Scale Research. A Teachers' Guide.
Munn, Pamela; Drever, Eric
Scottish Council for Research in Education. 1990
75p.
Available From: Scottish Council for Research in Education, 15 St.
John Street, Edinburgh, EH8 8JR, Scotland, United Kingdom.
Document Type: NON-CLASSROOM MATERIAL (055)
Target Audience: Teachers; Students; Practitioners
This guide provides practical advice, based on research expertise,
for teachers looking for reliable research results without waste of
time or effort. The six sections of the guide present and discuss
the decisions and actions that have to be taken to get good results:
(1) the pros and cons of collecting information by questionnaire; (2)
sampling; (3) drafting the questions and producing the design and
layout; (4) piloting and administering the questionnaire; (5)
analysing data; and (6) interpreting, presenting, and using the
results. (JD)
Descriptors: Action Research; Data Collection; Elementary Secondary
Education; *Evaluation Methods; Foreign Countries; Higher Education;
*Questionnaires; *Researchers; *Research Methodology; *Teacher
Participation
ED325513 TM015751
Improving the Quality of Questionnaires: A Tool for Evaluators.
Boser, Judith A.; Clark, Sheldon B.
Oct 1990
27p.; Paper presented at the Annual Meeting of the American
Evaluation Association (Washington, DC, October 18-20, 1990).
Document Type: RESEARCH REPORT (143); CONFERENCE PAPER (150);
TEST, QUESTIONNAIRE (160)
A checklist of characteristics of effective mail questionnaires was
developed that reflects some degree of consensus among experts in
survey research and that can serve as a guide to novices designing a
questionnaire. Journal and book sources of information about mail
questionnaires were reviewed to yield 83 items in 7 categories that
comprised the study survey. The survey was mailed to six authors of
books on survey research and six experienced practitioners of survey
research. Only one author failed to reply; the response rate was 92%.
Detailed background information was provided by 10 of the 11
individuals who participated in this phase of the study. Eight of
the 83 items were judged desirable for all mail questionnaires,
possibly because of a lack of clarity in the instrument. A revised
instrument was submitted to a validation panel of 10 individuals
experienced in survey research as well as to 8 of the original 11
participants. Of the 64 items that a majority of the participants in
the first phase of the study would usually recommend, 38 were
supported by the validation panel, with 80% or higher indicating that
they also would usually make the recommendation. The attached "Check
List of Desirable Characteristics of Mail Surveys" is a compilation
of the items usually recommended by at least 87.5% of the first group
of experts and 80% of the validation panel. These results indicate
that questionnaire design may be a science up to a certain point, but
beyond that point it is an art. A bibliography of the 21 journal and
book sources that were reviewed is provided. The survey instrument
used in this study is included. (SLD)
Descriptors: Authors; *Check Lists; Evaluation Methods; *Evaluators;
Literature Reviews; *Mail Surveys; *Questionnaires; Research Design;
*Researchers; *Research Methodology; Test Construction; Test
Reliability
Identifiers: *Check List Desirable Characteristics Mail Surveys;
Experts
ED302922 EA020603
Conducting a Survey: The Dollars and Sense of It.
Boser, Judith A.
Nov 1988
14p.; Paper presented at the Annual Meeting of the Mid-South
Educational Resarch Association (17th, Louisville, KY, November 8-11,
1988).
Document Type: CONFERENCE PAPER (150); NON-CLASSROOM MATERIAL(055)
This paper helps researchers develop criteria for conducting
surveys. Cost considerations frame the paper's suggestions.
Specifically, the text advises that researchers consider the human
and material resources needed, type of survey instrument, medium for
conducting the survey (mail, telephone, personal interview, etc.),
data analysis methodology, and report organization. (JAM)
Descriptors: *Costs; *Data Analysis; Educational Assessment;
*Evaluation Methods; *Research Design; *Sampling; *Surveys
EJ398479 TM514671
Survey Research and Social Policy.
Wright, James D.
Evaluation Review, v12 n6 p595-606 Dec 1988
Document Type: JOURNAL ARTICLE (080); REVIEW LITERATURE (070);
EVALUATIVE REPORT (142); CONFERENCE PAPER (150)
The historical linkages between the evolution of the survey
research method and applied social research is reviewed. It is
argued that most or all of the elements of the modern survey were
developed in response to immediate, practical (as opposed to
academic) concerns. (TJH)
Descriptors: *History; Literature Reviews; *Methods Research;
*Public Policy; *Research Methodology; *Social Science Research;
Statistical Surveys; *Surveys
ED319115 EA021792
Basic Project Management Methodologies for Survey Researchers.
Beach, Robert H.
Aug 1988
29p.; Paper presented at the Annual Meeting of the National Council
of Professors of Educational Administration (Kalamazoo, MI, August
1988). Contains occasional faint type.
Document Type: CONFERENCE PAPER (150); REVIEW LITERATURE (070)
Target Audience: Researchers
To be effective, project management requires a heavy dependence on
the document, list, and computational capability of a computerized
environment. Now that microcomputers are readily available, only the
rediscovery of classic project management methodology is required for
improved resource allocation in small research projects. This paper
provides an overview of project management, its associated tools, and
the key literature in the field. The term "project" refers to the
organization doing the work, dedicated to completing a single task
within a specific time frame. The overall project task is
differentiated from a routine task by virtue of its: (1) requiring an
unusually rapid completion time; (2) meeting very tight cost
constraints; and (3) need to dispel considerable initial uncertainty
among project personnel regarding completion methods. These three
criteria underline the project's finite nature and emphasize the
exaggerated concern for maintaining schedules and costs. Accompanied
by numerous illustrations, project management concepts such as
preplanning, project control, work breakdown structure, graphic
management procedures, and project scheduling are thoroughly
discussed. Because certain evaluation tools can assume a reality of
their own, management intervention may be needed to complete tasks on
schedule. The justification for using project management tools may
be found in improved grant management. (11 references) (MLH)
Descriptors: *Computer Uses in Education; Elementary Secondary
Education; *Microcomputers; *Research Methodology; *Social Science
Research; *Surveys
Identifiers: *Project Management
ED287879 TM870629
The Use of Mail Questionnaires as a Method of Data Collection.
Galpin, Tim
Sep 1987
13p.
Document Type: REVIEW LITERATURE (070)
This brief review of research examines the mail questionnaire as a
research tool. Major topics reported are the advantages and
disadvantages of mail surveys response rates, and questionnaire
construction. Among the advantages reported are ease of distribution
and tabulation, the possibility of a large sample and geographic
range, low cost, uniformity of questions, convenience of response,
and reduction of bias. Among the disadvantages are impersonal
feelings, possible low rate of response, inability to interact with
respondents, and lack of assurance as to the actual respondent.
Strategies for increasing response rate are identified. Personalized
correspondence, pre-contact letters, special delivery mailing, and
emphasis on benefit to the respondent tend to increase response rates.
Design of the questionnaire, clarity of instructions, simplicity of
response, and quality of cover letter are considered to be important.
A pilot test of the questionnaire to detect possible problems is
recommended. (MDE)
Descriptors: Data Collection; Questioning Techniques;
*Questionnaires; *Research Methodology; Research Problems; Response
Style (Tests); *Surveys; Test Construction
Identifiers: *Mail Surveys; *Response Rates (Questionnaires)
EJ346458 TM511606
Designing Evaluation Studies: A Twenty-Year Perspective.
Benson, Jeri; Michael, William B.
International Journal of Educational Research, v11 n1 p43-56
1987
Theme issue with title "Educational Evaluation: The State of the
Field."
Document Type: JOURNAL ARTICLE (080); PROJECT DESCRIPTION (141)
The purposes of evaluation design are stated. A description of
experimental, quasi-experimental, survey, and naturalistic designs is
presented. Emphasis is placed upon the identification of sources of
invalidity in these designs that may compromise the accuracy of
inferences regarding program effectiveness. (Author/JAZ)
Descriptors: *Educational Assessment; Elementary Secondary
Education; *Evaluation Methods; *Naturalistic Observation;
*Quasiexperimental Design; Questionnaires; *Research Design; *Surveys;
Validity
ED274675 TM860532
Everything They Ever Wanted to Know: Gathering Information for
Public School Decision Makers.
Jackson, Elaine E.
Austin Independent School District, Tex. Office of Research and
Evaluation. Apr 1986
15p.; Paper presented at the Annual Meeting of the American
Educational Research Association (67th, San Francisco, CA, April 16-
20, 1986). Some appendices contain small print.
Document Type: CONFERENCE PAPER (150); PROJECT DESCRIPTION (141);
TEST, QUESTIONNAIRE (160)
Target Audience: Researchers
The Austin (Texas) Independent School District's Office of Research
and Evaluation revised its surveying procedures in 1982. To reduce
the demands on teachers and administrators, various surveys were
consolidated and administered on a regular basis. Teachers and
administrators were surveyed every fall and spring, high school
students in winter, and parents and graduates occasionally.
Computers were used to sample subgroups and compile questionnaire
items for each respondent. The information needs of administrators,
the superintendent, and board members were solicited. Results were
delivered on a computerized printout, and responses were positive.
Procedures for producing answer sheets and coding the data were
improved. It was also possible to quickly compile information needed
for administrative planning. Items from the teacher survey and some
copies of the Questions for Students questionnaire are appended. (GDC)
Descriptors: *Data Collection; Educational Research; Elementary
Secondary Education; Information Dissemination; *Information Needs;
Participant Satisfaction; Program Improvement; Public Schools;
*Questionnaires; *Research Methodology; *School Surveys; *Surveys
Identifiers: Austin Independent School District TX
EJ302116 TM508928
Improving Mailed Questionnaire Design.
New Directions for Program Evaluation, n21 p33-47 Mar
1984
Theme issue with title "Making Effective Use of Mailed
Questionnaires."
Document Type: NON-CLASSROOM MATERIAL (055); POSITION PAPER (120)
Target Audience: Sudman, Seymour; Bradburn, Norman
Situations in which mailed questionnaires are most appropriate are
identified. Population variables, characteristics of questionnaires,
and social desirability variables are examined in depth. (Author)
Descriptors: Attitude Measures; *Evaluation Methods; Program
Evaluation; Research Methodology; Sampling; *Surveys; Test Format;
Test Length
Identifiers: *Mail Surveys; Response Rates (Questionnaires); Social
Desirability; Target Populations
EJ302712 EA517825
Development of a School-Level Environment Questionnaire.
Rentoul, A. John; Fraser, Barry J.
Journal of Educational Administration, v21 n1 p21-39 Win
1983
Document Type: RESEARCH REPORT (143)
Target Audience: Researchers
Describes the development of a questionnaire that measures
teachers' perceptions of eight aspects of a school environment.
Discusses the theory base and predecessors of this instrument, the
criteria and process used to develop it, its validation, and its
application so far. The 56 questionnaire items are appended. (MCG)
Descriptors: *Educational Environment; Elementary Secondary
Education; Factor Analysis; Models; *Questionnaires; Rating Scales;
*Research Methodology; Teachers; Test Validity
Identifiers: *School Level Environment Questionnaire
ED236246 TM830773
Designing and Utilizing Mail Questionnaires in Educational
Research. Monograph Series 83.1.
Humphries, James T.
Southern Illinois Univ., Carbondale. Dept. of Vocational Education
Studies. May 1983
44p.
Available From: Publication and Research Office for Vocational
Education, Dept. of Vocational Education Studies, Southern Illinois
University, Carbondale, IL 62901 ($3.50).
Document Type: NON-CLASSROOM MATERIAL (055)
Target Audience: Researchers
The purpose of this monograph is twofold: (1) to describe the
advantages and disadvantages of mail questionnaires as survey
research instruments, and (2) to provide guidelines for constructing
and utilizing mail questionnaires with a view to maximizing response
rates and minimizing response biases. Construction of an effective
mail questionnaire is a great challenge. The instrument must not
only have well-designed questions; it must also have a format which
encourages respondents to complete it. Pilot testing of
questionnaires is necessary to assure effective instruments. Cover
letters, introducing the researchers and the purpose of the study to
the respondents, should be brief and to the point. Non-response to
questionnaires can be dealt with through follow-ups, advance
notification, postage, and monetary incentives. Insofar as possible,
these recommendations for design and use of mail questionnaires are
based on empirical data. (Tabular summaries of research findings are
appended.) (BW)
Descriptors: Field Tests; Letters (Correspondence); Questioning
Techniques; *Questionnaires; Rating Scales; Responses; Surveys; *Test
Construction; Test Format; Test Items
Identifiers: *Mail Questionnaires; Mail Surveys; Response Rates
(Questionnaires)
ED234659 HE016554
Surveying Your Alumni: Guidelines and 22 Sample Questionnaires.
McKenna, Barbara, Comp.
Council for Advancement and Support of Education, Washington, D.C.
[1983
171p.
Available From: Council for Advancement and Support of Education,
11 Dupont Circle, Suite 400, Washington, DC 20036.
Document Type: NON-CLASSROOM MATERIAL (055); TEST, QUESTIONNAIRE
(160)
Target Audience: Researchers; Support Staff; Practitioners
A guide for conducting alumni surveys is presented, including 22
sample questionnaires. The first section on planning an effective
survey strategy includes the following five articles: "Let's Take a
Survey" (Cletis Pride); "Surveying Your Alumni: Or an Unexamined
College Is Not Worth Loving" (Jocelyn Bartkevicius); "Make Your
Survey Scientific" (James H. Frey); "The Postman Rings Thrice: How to
Survey Your Alumni through the Mail" (H. Martin Moore); and "Let
Your Fingers Do the Walking: The Nine Steps of Surveying Alumni via
Telephone" (Robert D. Mills). Seven biographical questionnaire
samples and 16 opinion questionnaire samples are provided, along with
a selection of cover letters and followup correspondence. Finally,
three articles are provided that address the challenge of presenting
the survey results: "CSPP Alumni: Where Are They Now?" (Special
Report, California School of Professional Psychology); "Who Are the
Alumni" (Elise Hancock in "Johns Hopkins Magazine"); and "The
Shockley Report" (in "Vanderbilt Alumnus"). Specific topics
addressed in the guide include: the problems with many alumni
surveys; using standard scientific sampling and research procedures;
a time-table for planning mail surveys, and a comparison of face-to-
face, mail, and telephone surveys. (SW)
Descriptors: *Alumni; *Attitude Measures; *Biographical Inventories;
College Graduates; *Graduate Surveys; Higher Education; Institutional
Research; *Questionnaires; *Research Methodology
ED230587 TM830361
The Development of a Parent Attitudinal Questionnaire As a Measure
of School Success.
Matthews, Doris B.; Casteel, Jim Frank
[1983
27p.
Document Type: RESEARCH REPORT (143); TEST, QUESTIONNAIRE (160)
Target Audience: Practitioners
The School District Questionnaire described in this paper evolved
from the Orangeburg (North Carolina) School District's plans to
implement programs for improvement. The content-based questionnaire,
which provides the school district with specific attitudinal feedback
from parents, can be used for both pre- and posttesting following
implementation of planned changes. It was developed by an evaluation
team composed of curriculum specialists, test construction experts,
and the district superintendent, with suggestions from parents,
teachers, and school board members. The initial version of the
questionnaire consisted of 55 negative and positive statements that
were designed to elicit responses about parents' ideas of the ideal
school system. A Likert scale of five follows each statement.
Teacher reviews, pilot testing, and subsequent revisions of the
instrument reduced the number of items to 51 in the final version.
The initial version of the questionnaire, instructions to teachers
involved in content validation, instructions to parents involved in
pilot testing, and the final version of the instrument are attached
as Appendices A through D. (LC)
Descriptors: *Attitude Measures; Educational Improvement;
Elementary Secondary Education; *Parent Attitudes; *Questionnaires;
*School Districts; *School Effectiveness; *Test Construction; Test
Validity
Identifiers: Likert Scales; *School District Questionnaire
ED222538 TM820690
A Guide to Survey Development: Manual on Writing a Survey.
Stacey, Susan E.; Moyer, Kerry L.
Pennsylvania State Dept. of Education, Harrisburg. Div. of Research
and Evaluation. 1982
28p.
Document Type: NON-CLASSROOM MATERIAL (055)
Target Audience: Practitioners
This handbook was developed for use by individuals with limited
experience in performing good survey-based research. The essential
procedures in the preparation of a survey are outlined and discussed.
The method of survey construction proposed consists of several tasks:
(1) survey objectives and research questions are specified; (2)
literature is reviewed and abstract concepts are defined; (3)
question formats and type of statistical analysis are selected; (4)
survey items are written and arranged in order; (5) physical
appearance of the questionnaire is adjusted; (6) cover letter and
instructions are prepared; and, finally, (7) the survey is validated.
Examples illustrate the method for properly completing each
procedure, and a summary checklist is provided to evaluate the survey
to be used. A sample self-evaluation form for survey development
completes the information in the manual. (DWH)
Descriptors: Data Collection; Elementary Secondary Education;
Evaluation Methods; Guidelines; *Research Methodology; *Surveys;
*Test Construction; Test Format; Test Items
Identifiers: Pennsylvania Department of Education
ED279726 TM870175
Validity and Reliability in Survey Research. Technical Report No.
15.
Russ-Eft, Darlene F.
American Institutes for Research in the Behavioral Sciences. Palo
Alto, CA. Statistical Analysis Group in Education. Aug 1980
143p.
Sponsoring Agency: National Center for Education Statistics (ED),
Washington, DC.
Document Type: PROJECT DESCRIPTION (141); BIBLIOGRAPHY (131)
With increasing reliance being placed on the results of their
surveys, the National Center for Education Statistics (NCES)
recognized a need for these survey results to be valid and reliable.
As part of the work of the Statistical Analysis Group in Education
(SAGE), an effort was undertaken to investigate validity and
reliability in survey research. This document is the result of that
effort. The first section provides an overview of the concepts of
reliability and validity. Procedures for measuring sources of error
are suggested. Several ways of approaching validity are mentioned
including content validity, criterion-related validity, and construct
validity. The second section presents some suggestions for approving
the reliability and validity of survey data, with a focus on the data
collection phase. These suggestions are based upon previous data
collection experiences of the staff of SAGE. The final section,
encompassing 106 pages, provides an annotated bibliography of
selected materials relevant to validity and reliability in survey
research. (JAZ)
Descriptors: Concurrent Validity; Construct Validity; Content
Validity; Data Collection; Educational Research; Questionnaires;
*Research Design; *Research Methodology; Research Problems; *Surveys;
*Test Reliability; *Test Validity
Identifiers: Internal Consistency; *Test Retest Reliability
ED224130 EA015216
Survey/Feedback. Basic School PR Guide.
Banach, William J.
National School Public Relations Association, Arlington, Va.
1980
36p.; One in a series of eight Guides which comprise the Basic
School PR Kit. For related documents, see EA 015 213-220.
Available From: Publications, National School Public Relations
Association, 1801 North Moore Street, Arlington, VA 22209 ($7.50
each; $37.50 for set of eight).
Document Type: NON-CLASSROOM MATERIAL (055)
Target Audience: Practitioners
To help improve school public relations programs, this handbook
tells how to use survey and feedback techniques and how to interpret
survey results. The first chapter gives a brief overview of the
usefulness of surveys for getting community feedback. Chapter 2
recommends beginning by deciding what one wants to know from a
survey, what human and financial resources will be needed, and what
the survey's timeline should be. Chapter 3 discusses deciding whom
to interview and describes drawing a sample based on statistical
confidence levels and using various sample-selection techniques. The
advantages and disadvantages of personal interviews, mail surveys,
and telephone surveys are enumerated in chapter 4, while chapter 5
discusses whether to use survey questions with multiple-choice,
closed-response, dichotomous, preference, ranking, or rating-scale
answers. Chapter 6 recommends using volunteers to conduct surveys.
Analyzing, interpreting, and reporting survey results are addressed
in chapter 7. Thirteen other ways besides surveys to get feedback are
suggested in chapter 8, including speakers' bureaus, suggestion
boxes, and student rap sessions. The final chapter briefly
summarizes the handbook. Three appendices provide a table of
appropriate sample sizes and a sample questionnaire and tell how to
draw a survey sample. (RW)
Descriptors: *Community Surveys; Data Analysis; Elementary
Secondary Education; Guidelines; Interviews; *Public Opinion; Public
Relations; Questionnaires; *Research Methodology; Research Needs;
Sampling; School Attitudes; School Community Relationship; School
Surveys
Identifiers: Telephone Surveys
ED236204 TM830713
Questionnaires: Their Development and Use.
Long, Susan; Cognetta, Randall A.
San Mateo County Office of Education, Redwood City, CA.
Sep 1978
64p.; Attached Needs Assessment Questionnaire contains small print.
Available From: San Mateo County Office of Education, 333 Main St.,
Redwood City, CA 94063 ($3.00).
Document Type: NON-CLASSROOM MATERIAL (055)
Target Audience: Administrators; Practitioners
After a brief introduction and discussion of the advantages and
disadvantages of questionnaires, this publication explains how to
develop a questionnaire. Each of the five parts of a questionnaire
(heading, procedural statements, items, comment space, and procedures
for return) are discussed, with concrete examples. Guidelines for
pre-test/tryout are presented. The importance of the cover letter
and methods for the distribution of questionnaires are discussed.
The final section addresses the compilation and analysis of the
responses. The appendix includes examples of entire questionnaires. (BW)
Descriptors: Data Analysis; *Data Collection; Field Tests;
*Questionnaires; *Test Construction; Test Items; *Test Use
Return to the Index of FAQs
|
