Skip to main content
Waterfall-Fetch Hero Image

​
Waterfall-Fetch

Waterfall-Fetch is a powerful and flexible utility for web scraping and HTML fetching, employing a cascading retry approach with multiple strategies. It’s designed to provide a robust solution for retrieving HTML content from websites, even when faced with various challenges. But above all it is designed to be simple. 
npm install waterfall-fetch

NPM

Download from Node Package Manager (NPM)

Quick Start

Get up and running with Waterfall-Fetch in minutes

API Reference

Explore the Waterfall-Fetch API

​
Key Features

Utilizes Axios, Node-fetch, and Puppeteer for optimal content retrieval
Intelligently cascades through strategies to ensure successful fetching
Employs Puppeteer for JavaScript-heavy sites, enhancing scraping capabilities
Allows you to tailor the fetching process to your specific needs
Robust error management for reliable scraping operations
Fully typed for enhanced developer experience and code quality

​
How Waterfall-Fetch Works

This diagram illustrates the cascading approach of Waterfall-Fetch:
  1. It starts with the fastest method (Axios).
  2. If that fails, it moves to Node-fetch.
  3. If Node-fetch fails, it uses Puppeteer as a last resort.
  4. If all methods fail, it returns an error.
This intelligent, tiered strategy ensures that you’re always using the most appropriate and efficient method for each unique scraping scenario, balancing speed, cost, and accuracy. Ready to dive in? Check out our Quick Start guide to begin your journey with Waterfall-Fetch!
⌘I