Scrapers
Scrapers overview
The full catalog of 24 built-in scrapers and their MCP tools.
PyScrappy ships 24 scrapers. Every scraper that works without a proxy is also exposed as an MCP tool (last column). Scrapers marked needs proxy are blocked by anti-bot systems and require a proxy or scraping-API service.
| Scraper | What it does | Browser? | MCP tool |
|---|---|---|---|
GenericScraper | Scrape any URL with auto-extraction | Optional | scrape_url |
| Data / Research | |||
WikipediaScraper | Articles, sections, infoboxes | No | scrape_wikipedia |
IMDBScraper | Movie/TV info (via OMDb API; needs OMDB_API_KEY) | No | lookup_movie |
StockScraper | Quotes, history, profiles (Yahoo Finance) | No | scrape_stock |
NewsScraper | RSS/Atom feeds, article extraction | No | scrape_news |
ImageSearchScraper | Image search + download | No | search_images |
LinkedInJobsScraper | Public job listings | No | search_linkedin_jobs |
GitHubScraper | Repository search via GitHub API | No | search_github |
HackerNewsScraper | Story search via HN API | No | search_hackernews |
OpenLibraryScraper | Book search via Open Library | No | search_books |
WeatherScraper | Current weather via Open-Meteo (no key) | No | get_weather |
CryptoScraper | Crypto prices via CoinGecko (no key) | No | get_crypto |
CurrencyScraper | Exchange rates + conversion (no key) | No | convert_currency |
DictionaryScraper | Word definitions (Free Dictionary API) | No | define_word |
| E-Commerce | |||
AmazonScraper | Product search | No | search_amazon |
NeweggScraper | Electronics / hardware search | No | search_newegg |
IKEAScraper | Furniture / home search (per-country) | No | search_ikea |
| Social Media | |||
YouTubeScraper | Video search, channel scraping | Optional | search_youtube |
InstagramScraper | Profiles, hashtag posts (needs proxy) | Recommended | - |
TwitterScraper | Tweet search (needs proxy) | Recommended | - |
| Music | |||
SpotifyScraper | Track/playlist search (needs proxy) | Recommended | - |
SoundCloudScraper | Track search | Optional | search_soundcloud |
| Food Delivery | |||
ZomatoScraper | Restaurant listings by city | Recommended | scrape_zomato |
UberEatsScraper | Restaurants by city + full menus | No | search_ubereats, get_ubereats_menu |
Focused guides
- Data & research: Wikipedia, stocks, news, IMDB, weather, crypto, currency, dictionary.
- E-commerce: Amazon, Newegg, IKEA (per-country pricing).
- Food delivery: Zomato and Uber Eats (city listings + menus).
All other scrapers follow the same construct → .scrape(...) → ScrapeResult pattern
shown in the Quickstart.