Getting started
Installation
Install PyScrappy and its optional extras.
PyScrappy is published on PyPI and requires Python 3.9+ (the MCP server requires Python 3.10+).
pip install pyscrappyOptional extras
PyScrappy keeps its core install light. Add extras only for the features you need:
# Browser support (for JavaScript-rendered pages)
pip install 'pyscrappy[browser]'
playwright install chromium
# DataFrame support (.to_dataframe())
pip install 'pyscrappy[dataframe]'
# MCP server (use PyScrappy's scrapers as AI-agent tools)
pip install 'pyscrappy[mcp]'
# Everything
pip install 'pyscrappy[all]'| Extra | Adds | Use it for |
|---|---|---|
browser | Playwright | JS-heavy pages, SoundCloud, some social sites |
dataframe | pandas | result.to_dataframe() |
mcp | MCP SDK | Running the pyscrappy-mcp server |
all | all of the above | Everything |
Dependencies
Required: httpx, beautifulsoup4, lxml
Optional: playwright (JS rendering), pandas (DataFrames), mcp (MCP server)
Verify
import pyscrappy
print(pyscrappy.__version__)