apify-scrapers

mcp-name: io.github.jlucasmcrell/apify-scrapers

Apify Public Data Scrapers & Extractors

Python 3.10+ Node.js 18+ Apify Verified Glama MCP Server License: MIT Smithery A curated collection of reliable, production-ready scrapers and public-data extractors hosted on the Apify Store.

Each actor is built with strict schema validation, deterministic field mapping, self-healing DOM selectors, and pay-per-event pricing (per-result rates from $0.00015, Actor-start from $0.0005; the live Apify Store price is authoritative).

Quick Navigation

Available Extractors & Store Listings

Tool Store Link Key Output Fields Best For
Google Maps Business Leads captainhandsome/google-maps-business-search Name, phone, website, rating, reviews, address, coordinates, hours B2B lead generation, local agency prospecting
Glassdoor Jobs & Salaries captainhandsome/glassdoor-jobs-scraper Title, company, salary estimate, rating, location, job URL, posting date Hiring intelligence, compensation benchmarking
Airbnb Vacation Rentals captainhandsome/airbnb-listings-search Title, room type, nightly price, rating, reviews count, listing URL Real estate research, market rate tracking
SEC EDGAR Corporate Filings captainhandsome/sec-edgar-filings-search Ticker, CIK, form (10-K, 10-Q, 8-K), filing date, primary document URL Financial diligence, equity research, compliance
USAspending Federal Awards captainhandsome/usaspending-federal-awards Recipient vendor, award amount, awarding agency, description, dates Government contracting, procurement intel
LinkedIn Public Jobs captainhandsome/linkedin-public-jobs-search Job title, employer, location, direct apply URL, posting age Recruitment, tech talent monitoring
Google Play App Reviews captainhandsome/google-play-reviews-scraper Review text, star score, thumbs up, date, reviewer name App store sentiment, competitor feedback
YouTube Video Search captainhandsome/youtube-search-scraper Title, video URL, channel, views count, duration, publish date Content tracking, creator outreach
Twitch Live Streams captainhandsome/twitch-live-streams-scraper Streamer username, title, viewer count, language, category Esports analytics, live stream monitoring
US Contractor Licenses captainhandsome/us-contractor-license-search Contractor name, license number, classification, status, state Trades verification, subcontractor diligence
US Business Entity Registries captainhandsome/us-business-entity-search Legal entity name, filing number, jurisdiction, status Legal due diligence, corporate registration checks
Alabama Business Entity Search & Company captainhandsome/al-business-entity-search entity id, entity name, location, entity type, status Search Alabama business entities by company name and export entity IDs
California Contractor License Search captainhandsome/ca-contractor-license-search contractor name, name type, license number, city, status Search California CSLB contractor records by contractor name and expor
ClinicalTrials.gov Search captainhandsome/clinical-trials-search nct id, title, official title, acronym, org study id Search the official ClinicalTrials.gov API by condition, intervention,
EPA ECHO Facility Compliance and Violati captainhandsome/epa-echo-facility-search registry id, name, street, city, state Search EPA-regulated US facilities by state, ZIP, NAICS, name, program
FEC Campaign Finance Search captainhandsome/fec-campaign-finance-search record type, id, name, party, office Search US federal candidates, PACs and campaign contributions by state
**Florida Sunbiz Business Entity Search & ** captainhandsome/fl-sos-new-filings entity name, document number, status, entity type, date filed Search Florida Sunbiz company-name results and export legal entity nam
Florida Sunbiz Officer & Registered Agen captainhandsome/fl-sunbiz-officer-search officer name, entity name, document number, detail url, entity type Search Florida Sunbiz by officer or registered-agent name and export o
French Company Search captainhandsome/french-company-search siren, name, legal name, acronym, status Search France’s official company register by name, activity, postcode,
**openFDA Drug Labels, Recalls and Events ** captainhandsome/openfda-search dataset, id, brand name, generic name, manufacturer Search official FDA drug labels, approvals, adverse events, and drug,
Europe PMC Paper Search captainhandsome/europe-pmc-paper-search title, doi, pmid, abstract, cited_by_count Best for biomedical literature reviews, citation tracking, and open-access discovery across PubMed and Europe PMC.
Website Tech Stack & Ecommerce Scanner captainhandsome/tech-stack-detector technologies, cms, ecommerce_platform, payments, emails Best for competitive tech research and B2B lead qualification across a batch of company websites.
GLEIF LEI Lookup captainhandsome/gleif-lei-search lei, legal_name, registered_as, legal_form_name, status Best for KYC and counterparty due diligence: resolving a company’s Legal Entity Identifier, registration status, and own national registry number before onboarding.
CMS Healthcare Provider Search captainhandsome/cms-healthcare-provider-search name, provider_type, city, state, star_rating Compare CMS-certified hospitals, nursing homes, and other Medicare providers by location, ownership, and star rating.
US Census Address Geocoder captainhandsome/us-census-geocoder matched_address, county_name, tract_geoid, block_geoid, congressional_district_geoid Best for appending census tract, county FIPS and district GEOIDs to US addresses for demographic joins and compliance reporting.

Python Quickstart

1. Install dependencies

pip install apify-client pandas python-dotenv

2. Export 50 Google Maps Leads to CSV

import os
from apify_client import ApifyClient
import pandas as pd

# Get your API token from https://console.apify.com/account/integrations
client = ApifyClient(os.getenv("APIFY_TOKEN"))

# Run the actor
run = client.actor("captainhandsome/google-maps-business-search").call(run_input={
    "search_query": "commercial electricians",
    "location": "Dallas, Texas",
    "max_items": 50,
    "include_details": True,
})

# Fetch dataset items and export to CSV
items = list(client.dataset(run["defaultDatasetId"]).iterate_items())
df = pd.DataFrame(items)
df.to_csv("dallas_electricians.csv", index=False)
print(f"Exported {len(df)} leads to dallas_electricians.csv")

See examples/google_maps_leads_to_csv.py for the full script.

Node.js Quickstart

1. Install dependencies

npm install apify-client

2. Query SEC EDGAR Filings

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: process.env.APIFY_TOKEN });

const run = await client.actor('captainhandsome/sec-edgar-filings-search').call({
  companies: ['AAPL', 'NVDA', 'MSFT'],
  forms: ['10-K'],
  max_items: 15,
});

const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach(filing => {
  console.log(`[${filing.ticker}] ${filing.form} (${filing.filing_date}): ${filing.primary_document_url}`);
});

See examples/sec_filings.js for the full script.

No-Code & Automation Workflows

If you automate via n8n, Make, Zapier, or Google Sheets, ready-to-import blueprints are included in workflows/:

Pre-Built Example Tasks (Zero Code)

If you prefer runnable web UI tasks without writing any code, each actor includes pre-configured tasks published on Apify Store:

Google Maps Leads

Glassdoor Jobs

Airbnb Rentals

YouTube & Google Play

Free Sample Datasets

Looking for clean data to benchmark, analyze, or train models? Verified sample bundles with metadata schemas are available in datasets/ and hosted publicly on Hugging Face Datasets:

  1. Phoenix HVAC Contractor Leads: datasets/phoenix_hvac_leads/ Hugging Face Hub (20 verified HVAC contractor profiles with ratings, addresses, and phone numbers).
  2. California Licensed Contractors: datasets/california_solar_contractors/ Hugging Face Hub (Active C-46 and B licensed solar installers with state verification numbers).
  3. Austin Software Engineer Postings: datasets/austin_software_jobs/ Hugging Face Hub (Normalized job listings with estimated posting dates and salary ranges).

AI Agent & MCP Integration

All actors in this repository conform to OpenAPI and JSON Schema standards, making them directly callable by AI agents via the Model Context Protocol (MCP):

Option 1: Claude Desktop / Cursor with UVX (Recommended)

Add this to your claude_desktop_config.json or Cursor MCP settings:

{
  "mcpServers": {
    "apify-data-scrapers": {
      "command": "uvx",
      "args": ["apify-data-scrapers"],
      "env": {
        "APIFY_TOKEN": "YOUR_APIFY_API_TOKEN"
      }
    }
  }
}

Option 2: Docker Container (Glama / Cloud)

Run via Docker:

{
  "mcpServers": {
    "apify-data-scrapers": {
      "command": "docker",
      "args": ["run", "-i", "--rm", "-e", "APIFY_TOKEN", "glcr.b-cdn.net/jlucasmcrell/apify-scrapers:latest"],
      "env": {
        "APIFY_TOKEN": "YOUR_APIFY_API_TOKEN"
      }
    }
  }
}

Option 3: Local Python Stdio Runner

Install via pip or run directly:

pip install apify-data-scrapers
export APIFY_TOKEN="your_token_here"
apify-data-scrapers

Or from local source:

python mcp_server.py

Agent Prompts That Work Out-of-the-Box:

In-Depth Engineering Guides

Technical case studies and problem-solution writeups are located in articles/:

Repository Structure

apify-scrapers/
 README.md                                # Documentation and quickstart
 LICENSE                                  # MIT License
 requirements.txt                         # Python client dependencies
 package.json                             # Node.js dependencies
 mcp.json                                 # MCP tool registry specification
 mcp_server.py                            # Native Python stdio MCP server
 articles/                                # In-depth engineering case studies
    airbnb_playwright_pagination_guide.md
    glassdoor_posting_dates_guide.md
    reddit_community_responses.md        # Reference technical answers for forums
 datasets/                                # Sample benchmark datasets
    phoenix_hvac_leads/
    california_solar_contractors/
    austin_software_jobs/
 workflows/                               # No-code automation templates
    n8n_google_maps_to_sheets.json
    n8n_sec_edgar_to_slack.json
    README.md
 examples/                                # Standalone developer scripts
     google_maps_leads_to_csv.py
     sec_edgar_filings_downloader.py
     glassdoor_jobs_tracker.py
     airbnb_market_scraper.py
     usaspending_defense_awards.py
     twitch_live_stream_monitor.py
     google_maps_leads.js
     sec_filings.js

Author & Support

Maintained by Joseph McRell.

License

This project is licensed under the MIT License - see the LICENSE file for details.

This site is open source. Improve this page.