Session Goals
- To identify core aspects of research design across a range of linguistic methods
- To evaluate quality of research design in existing language-based research projects
- To apply knowledge of linguistic methods to formulate research designs for a given topic
Key Ideas
- The design and evaluation of linguistic methods ultimately depend on the levels of language they are intended to analyze. Social scientists need to understand the assumptions of a given paradigm to formulate appropriate methodologies, or fairly appraise the work of others.
- Challenging across all levels of language is their unique purview within traditionally quantitative or qualitative criteria for rigor and validity. Lexical frameworks require quantitative precision in their counting processes and qualitative completeness of dictionaries. Semantic frameworks require quantitative assessment of topic quality and qualitative sufficiency of textual engagement to designate meanings. Discursive frameworks are not classically quantitative, and primarily require critical and reflexive interpretation of texts in social context.
- Holistic views of the research question are also crucial in evaluating research design. A well-conducted linguistic method may result in invalid inferences if not understood in the appropriate theoretical context. Non-linguistic methodological procedures included in the overall study likewise need to be commensurable with or calibrated within the assumed paradigm of language.
Homework and Activity
- (~6 sentences) Compare the two papers you used for the previous assignment.
- If their underlying approach to language is relatively similar, what common procedures do the two papers implement? What are the strengths and weaknesses of each paper relative to each other in ensuring a rigorous analysis of language within their shared paradigm? For instance, if both Paper A and Paper B are semantic, which paper does a better job of identifying the underlying topics in a corpus?
- If their underlying approach to language is relatively different, what common procedures do the two papers nonetheless share? How might each paper’s research question and methods be revised if their approach to language were converted to the other’s? For instance, if Paper A is lexical and Paper B is discursive, what can we do to make Paper A discursive and Paper B lexical?
- (~8 sentences) Drawing on your research interests for the term, formulate hypothetical projects which draw predominantly on two of the three levels of language we have discussed. For instance, I might choose to formulate a lexical project and a discursive project around collective memories of martial law in the Philippines. For each project, identify: (a) a research question, (b) a research design, (c) major strengths, and (d) major limitations.
Readings
- Brady, W. J., Wills, J. A., Jost, J. T., Tucker, J. A., & Van Bavel, J. J. (2017). Emotion shapes the diffusion of moralized content in social networks. Proceedings of the National Academy of Sciences, 114(28), 7313-7318. https://doi.org/10.1073/pnas.1618923114
BradyETAL2017_PNASMoralContagion.pdf
- Jamison, A., Broniatowski, D. A., Smith, M. C., Parikh, K. S., Malik, A., Dredze, M., & Quinn, S. C. (2020). Adapting and extending a typology to identify vaccine misinformation on Twitter. American Journal of Public Health, 110(53), S331-S339. https://doi.org/10.2105/AJPH.2020.305940
JamisonETAL2020_AJPHVaccineTypology.pdf
OfreneoMontiel2010_AJSPPositioningIPV.pdf
Slides
2022-03-04 ADL Linguistic Methods.pdf