Below we provide an overview of inspiring methodological papers about collecting web data for academic research.
- Landers et al. (2016, Psychological Methods) introduce the notion of a “data source theory” as a critical element for theory-driven web data extractions
- Xu, Zhang, and Zhou (2020, Journal of Management) offer a thoughtful discussion of some of the challenges involved in the collection of “organic” data (including web data) for academic research
- Edelman (2012, Journal of Economic Perspectives) is one of the first articles to identify the potential of extracting web data at scale for academic research