週次
Week
|
課程主題
Topic
|
課程內容與指定閱讀
Content and Reading Assignment
|
教學活動與作業
Teaching Activities and Homework
|
學習投入時間
Student workload expectation
|
課堂講授In-class Hours
|
課程前後
Outside
-of-class Hours
|
1
(2/27)
|
Introduction: An Overview of Survey Design and Implementation
|
Design of Research – Causality vs. Correlation
|
Presentation & Group Discussion
|
3
|
3
|
2
(3/6)
|
Survey Design Process & Types of Questions and Variables
Measure of Ideas and Concepts
|
Brace, I. (2004). Questionnaire Design. London: Kogan page. (Chapter 4)
Bradburn, N. M., Sudman, S., & Wansink, B. (2004). Asking Questions: The Definitive Guide to Questionnaire Design – For Market Research, Political Polls, and Social and Health Questionnaires. John Wiley & Sons. (Chapter 1, 2, 3)
Fink, A. (2012). How to Conduct Surveys: A Step-by-Step Guide. Sage Publications. (Chapter 1)
Schaeffer, N. C., & Presser, S. (2003). The science of asking questions. Annual Review of Sociology, 29(1), 65-88.
|
Presentation & Group Discussion
|
3
|
3
|
3
(3/13)
|
The Basics of Crafting Good Questions
Item Wording & Context
Constructing Open- and Closed-Ended Questions
|
Brace, I. (2004). Questionnaire Design. London: Kogan page. (Chapter 6)
Bradburn, N. M., & Miles, C. (1979). Vague quantifiers. Public Opinion Quarterly, 43(1), 92-101.
Bradburn, N. M., Sudman, S., & Wansink, B. (2004). Asking Questions: The Definitive Guide to Questionnaire Design – For Market Research, Political Polls, and Social and Health Questionnaires. John Wiley & Sons. (Chapter 5)
Dillman, D. A., Smyth, J. D., & Christian, L. M. (2009). Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method, 3e. John Wiley & Sons. (Chapter 4, 5)
Fink, A. (2012). How to Conduct Surveys: A Step-by-Step Guide. Sage Publications. (Chapter 2)
Schwarz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54(2), 93-105.
|
Presentation & Group Discussion
|
3
|
3
|
4
(3/20)
|
Constructing Attitude, Behavioral, Factual, and Non-Factual Questions
Validity and Reliability
|
Brace, I. (2004). Questionnaire Design. London: Kogan page. (Chapter 5)
Bradburn, N. M., Sudman, S., & Wansink, B. (2004). Asking Questions: The Definitive Guide to Questionnaire Design – For Market Research, Political Polls, and Social and Health Questionnaires. John Wiley & Sons. (Chapter 4, 6, 7)
Winter, G. (2000). A comparative discussion of the notion of validity in qualitative and quantitative research. The Qualitative Report, 4(3), 1-14.
|
Presentation & Group Discussion
|
3
|
3
|
5
(3/27)
|
From Questions to a Questionnaire
Ordering and Formatting Surveys
|
Bradburn, N. M., Sudman, S., & Wansink, B. (2004). Asking Questions: The Definitive Guide to Questionnaire Design – For Market Research, Political Polls, and Social and Health Questionnaires. John Wiley & Sons. (Chapter 10, 11)
Dillman, D. A., Smyth, J. D., & Christian, L. M. (2009). Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method, 3e. John Wiley & Sons. (Chapter 6)
Fink, A. (2012). How to Conduct Surveys: A Step-by-Step Guide. Sage Publications. (Chapter 3)
Harrison, D. A., & McLaughlin, M. E. (1996). Structural properties and psychometric qualities of organizational self-reports: Field tests of connections predicted by cognitive theory. Journal of Management, 22(2), 313-338.
Tourangeau, R., Couper, M. P., & Conrad, F. (2004). Spacing, position, and order: Interpretive heuristics for visual features of survey questions. Public Opinion Quarterly, 68(3), 368-393.
|
Presentation & Group Discussion
|
3
|
3
|
6
(4/3)
|
Paper-Based & Online Surveys – Theories, Tools, and Problems
|
Brace, I. (2004). Questionnaire Design. London: Kogan page. (Chapters 7)
Couper, M.P., Traugott, M.W., & Lamais, M.J. (2001). Web survey design and administration, Public Opinion Quarterly, 65, 230-253.
Smyth, J.D., Dillman, D.A., Christian, L. M. and M. Stern (2006) Comparing check all and forced choice question formats in web surveys. Public Opinion Quarterly, 70: 66-77.
|
Presentation & Group Discussion
|
3
|
3
|
7
(4/10)
|
No Class –
Online Practice & Activity – Online survey building & data collection
|
1. Design your own survey using Qualtrics / Google Doc / SurveyMonkey or other online platforms
2. Send your survey links to the other students and your pretest subjects
3. Respond to the other people’s surveys
|
1st Homework Assignment
|
0
|
9
|
8
(4/17)
|
Practice & Activity – Presentation
|
1. Present your results (basic analyses)
2. Peer review and feedback
|
1st Homework Assignment
|
3
|
6
|
9
(4/24)
|
Simulated Forums – Proposal Presentation Part 1
|
Proposal due at 5pm on 4/22 (Sunday), and please provide a hard copy of your proposal in class.
|
Proposal Presentation and Feedback
|
3
|
6
|
10
(5/1)
|
Simulated Forums – Proposal Presentation Part 2
|
Proposal due at 5pm on 4/29 (Sunday), and please provide a hard copy of your proposal in class.
|
Proposal Presentation and Feedback
|
3
|
6
|
11
(5/8)
|
Other Components of the Questionnaire & Bolstering Response Rates
|
De Bruijne, M., & Wijnant, A. (2014). Improving response rates and questionnaire design for mobile web surveys. Public Opinion Quarterly, 78(4), 951-962.
Dillman, D. A., Smyth, J. D., & Christian, L. M. (2009). Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method, 3e. John Wiley & Sons. (Chapter 2, 7)
Heerwegh, D. (2005). Effects of personal salutations in e-mail invitations to participate in a web survey. Public Opinion Quarterly, 69(4), 588-598.
Herzog, A. R., & Bachman, J. G. (1981). Effects of questionnaire length on response quality. Public Opinion Quarterly, 45(4), 549-559.
Krosnick, J. A. (1999). Survey research. Annual Review of Psychology, 50, 537-567
|
Presentation & Group Discussion
|
3
|
3
|
12
(5/15)
|
Common Method (Source) Bias & Solutions
|
Dillman, D. A., Smyth, J. D., & Christian, L. M. (2009). Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method, 3e. John Wiley & Sons. (Chapter 8)
Doty, D. H., & Glick, W. H. (1998). Common methods bias: does common methods variance really bias results?. Organizational Research Methods, 1(4), 374-406.
Meade, A. W., Watson, A. M., & Kroustalis, C. M. (2007). Assessing common methods bias in organizational research. In 22nd annual meeting of the Society for Industrial and Organizational Psychology, New York, 1-6.
Meier, K. J., & O’Toole, L. J. (2013). Subjective organizational performance and measurement error: Common source bias and spurious relationships. Journal of Public Administration Research and Theory, 23(2), 429-456.
|
Presentation & Group Discussion
|
3
|
3
|
13
(5/22)
|
Basic Statistics & Analytic Tools
|
Introduction on basic statistics
Stata practice
|
2nd Homework Assignment
|
3
|
9
|
14
(5/29)
|
Issues of Response and Nonresponse Bias
|
Brace, I. (2004). Questionnaire Design. London: Kogan page. (Chapters 10)
Groves, R. M. (2006). Nonresponse rates and nonresponse bias in household surveys. Public Opinion Quarterly, 70(5), 646-675.
Sax, L. J., Gilmartin, S. K., & Bryant, A. N. (2003). Assessing response rates and nonresponse bias in web and paper surveys. Research in Higher Education, 44(4), 409-432.
|
Presentation & Group Discussion
2nd Homework Assignment Due
|
3
|
9
|
15
(6/5)
|
Survey Sampling – Theories and Approaches
|
Scheaffer, R., Mendenhall III, W., Ott, R., & Gerow, K. (2012). Survey Sampling, 7e, International Edition. Cengage Learning. (Chapters 1, 2, 4, 5, 7, 8, 9)
|
Presentation & Group Discussion
|
3
|
3
|
16
(6/12)
|
Issues of Self-Selection Bias
|
Hudson, D., Seah, L. H., Hite, D., & Haab, T. (2004). Telephone presurveys, self-selection, and non-response bias to mail and internet surveys in economic research. Applied Economics Letters, 11(4), 237-240.
Søgaard, A. J., Selmer, R., Bjertness, E., & Thelle, D. (2004). The Oslo health study: The impact of self-selection in a large, population-based survey. International Journal for Equity in Health, 3(1), 3.
Whitehead, J. C. (1991). Environmental interest group behavior and self?selection bias in contingent valuation mail surveys. Growth and Change, 22(1), 10-20.
|
Presentation & Group Discussion
|
3
|
3
|
17
(6/19)
|
Simulated Forums – Final Paper Presentation
|
Draft term paper due at 5pm on 06/17 (Sunday), and please provide a hard copy of your draft paper in class.
Revised term paper due at 5pm on 07/01 (Sunday). Please email your revised paper to me (hkdong@nccu.edu.tw) and mark the changes you made in “red.”
|
Presentation and Feedback
|
3
|
3
|
18
(6/26)
|
Simulated Forums – Final Paper Presentation
|
Draft term paper due at 5pm on 06/24 (Sunday), and please provide a hard copy of your draft paper in class.
Revised term paper due at 5pm on 07/01 (Sunday). Please email your revised paper to me (hkdong@nccu.edu.tw) and mark the changes you made in “red.”
|
Presentation and Feedback
|
3
|
3
|
|
Course Requirements & Grade Construction
1. Participation 15 points
2. Assignment 1 10 points
3. Assignment 2 10 points
4. Leading Discussions 20 points
5. Term Paper
(1) Proposal 10 points
(2) Proposal Presentation 5 points
(3) Final Term Paper 15 points
(4) Final Term Paper Presentation 5 points
(5) Discussant 10 points
1. Participation:
Students are expected to be fully prepared to the weekly meetings. Most of the class meetings involve opportunities for you to participate in discussions. You should be prepared to incorporate readings into discussions.
2. & 3. Assignments:
There are a total of 2 assignments. All of them are designed to build upon practical features of the course work. All assignments are due at the beginning of the class as designated. You are expected to submit the assignments on time. Late assignments are not acceptable and will receive a zero.
4. Leading Discussions:
Every member of the class has shared responsibilities to contribute to the interchange of knowledge during this semester. Accordingly, each student will play the role of the discussion leader. The responsibilities of the discussion leader include: 1) summarizing and reviewing the course coverage, 2) offering thoughts, 3) asking questions to stimulate discussion, and 4) helping to integrate ideas of the class members. To ensure the development of a quality discussion, topics will be identified in advance for each student.
5. Term Paper:
You will have to develop your own survey based on the themes/topics you choose. Your grades of the term paper is constructed by the following portions:
(1) Proposal
You will need to address the following questions on your proposal: (1) What is your topic? (2) Why is it important? (3) What does previous research say about your topic, especially how those topics/ideas/concepts were “measured”? (4) How does your own questionnaire look like? (5) Who are the subjects of your research? (6) How do you plan to conduct your survey (your research design)?
(2) Final Term Paper
Your goal is to provide a quality paper on the topic you choose. You will need to clearly review the concepts and how they were measure, offer constructive critique on the measurements they used, analyze the data you collected, and, finally, provide conclusions and implications.
(3) Style & Format
For standard paper style, you will have to follow the guidelines of American Psychological Association (APA) citation and format style. And your term paper has a maximum of 7,000 word limit (text).
(4) Presentation
Everyone is expected to prepare a 20-minute presentation (PPT or other similar software required) followed by a 15-minute Q&A session. (Changes may be required depends on number of enrolled students.)
(5) Discussant
You will need to play the role as a “discussant” for one of your colleague’s term paper. The discussant is expected to prepare a 5-minute comment on the paper assigned (also PPT presentation). You should review and provide constructive suggestions for your colleague to improve the quality of his/her research.
Simulated Forums:
The forums are designed to duplicate panels in real academic conferences. The goal is to provide you a chance to familiarize yourself with academic research presentations and get feedback from your colleague.
Although your participation is expected, you do not have to come to class if you are sick or have unexpected emergencies. However, you should always inform me (by email) before the class if you will be absent. If you have a health or family emergency, you should inform me (by email) within 24 hours of your absence.
If you have any disabilities that may impede your performance in this class, please speak with me after the class and we will plan appropriate adjustments.
|
Bradburn, N. M., Sudman, S., & Wansink, B. (2004). Asking Questions: The Definitive Guide to Questionnaire Design – For Market Research, Political Polls, and Social and Health Questionnaires. John Wiley & Sons.
Brace, I. (2004). Questionnaire Design. London: Kogan page.
Dillman, D. A., Smyth, J. D., & Christian, L. M. (2009). Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method, 3e. John Wiley & Sons.
Fink, A. (2012). How to Conduct Surveys: A Step-by-Step Guide. Sage Publications.
Scheaffer, R., Mendenhall III, W., Ott, R., & Gerow, K. (2012). Survey Sampling, 7e, International Edition. Cengage Learning.
Other reading materials as designated.
|