Skip to contents

Scraping

The main engines for web data extraction.

paramsScraper()
Scraper Configuration Class
UrlScraper
UrlScraper R6 Class for Parallel Web Scraping with Selenium
extractLinks()
Extract Hyperlinks from an HTML Document

Searching

Defining parameters for Scraping/Search Jobs

paramsGoogleSearch()
Google Search Configuration Class
buildQuery()
Build Encoded Search Queries
runGoogleSearch()
Run Google Search Workflow
searchURL()
Search Google for Business URLs
getGoogleCreds()
Retrieve Google Search Credentials