Project-Oriented Web Scraping in Technical Communication Research

John R. Gallagher, Aaron Beveridge

Research output: Contribution to journalArticlepeer-review


This article advocates for web scraping as an effective method to augment and enhance technical and professional communication (TPC) research practices. Web scraping is used to create consistently structured and well-sampled data sets about domains, communities, demographics, and topics of interest to TPC scholars. After providing an extended description of web scraping, the authors identify technical considerations of the method and provide practitioner narratives. They then describe an overview of project-oriented web scraping. Finally, they discuss implications for the concept as a sustainable approach to developing web scraping methods for TPC research.

Original languageEnglish (US)
Pages (from-to)231-250
Number of pages20
JournalJournal of Business and Technical Communication
Issue number2
StatePublished - Apr 2022


  • data creation
  • data harvesting
  • methods
  • sustainability
  • web scraping

ASJC Scopus subject areas

  • Business and International Management
  • Communication
  • General Business, Management and Accounting


Dive into the research topics of 'Project-Oriented Web Scraping in Technical Communication Research'. Together they form a unique fingerprint.

Cite this