Home/Skills/Shopify Scraper

Sourcing & Research · Open source on GitHub

Shopify Scraper

Dump every product from any Shopify store to CSV with one command. It reads Shopify's public products.json endpoint; the script is 9KB.

GitHub Open-source tool Python · 178 ★ Apache-2.0
lagenar/shopify-scraper GitHub repository card

Upfront: I did not build this. It is an open-source project on GitHub (lagenar/shopify-scraper, Apache-2.0). It is listed here on star count, maintenance activity and how well it fits day-to-day storefront operations.

What it does

How to use it

Requires Python 3. Clone and run it against a competitor's domain:

git clone https://github.com/lagenar/shopify-scraper.git
cd shopify-scraper

# whole catalogue
python3 shopify.py https://competitor-store.com

# see available collections first
python3 shopify.py --list-collections https://competitor-store.com

# scrape selected collections only
python3 shopify.py -c col1,col2 https://competitor-store.com

Output is CSV. The repo has not been updated since 2023, but because it depends on Shopify's public endpoint rather than page markup, it still works.

When to use it, and when not to

Fastest route to a one-off category audit, price-band analysis or new-arrival cadence study. For ongoing change monitoring, use changedetection.io. Worth knowing: the repo has not been updated since September 2023. The products.json endpoint it relies on is a public Shopify endpoint that still works, and the script is short enough to patch yourself if needed.