Getting started

Installation

Install PyScrappy and its optional extras.

PyScrappy is published on PyPI and requires Python 3.9+ (the MCP server requires Python 3.10+).

pip install pyscrappy

Optional extras

PyScrappy keeps its core install light. Add extras only for the features you need:

# Browser support (for JavaScript-rendered pages)
pip install 'pyscrappy[browser]'
playwright install chromium
 
# DataFrame support (.to_dataframe())
pip install 'pyscrappy[dataframe]'
 
# MCP server (use PyScrappy's scrapers as AI-agent tools)
pip install 'pyscrappy[mcp]'
 
# Everything
pip install 'pyscrappy[all]'
ExtraAddsUse it for
browserPlaywrightJS-heavy pages, SoundCloud, some social sites
dataframepandasresult.to_dataframe()
mcpMCP SDKRunning the pyscrappy-mcp server
allall of the aboveEverything

Dependencies

Required: httpx, beautifulsoup4, lxml

Optional: playwright (JS rendering), pandas (DataFrames), mcp (MCP server)

Verify

import pyscrappy
print(pyscrappy.__version__)