Skip to content

introduction.mdx

Latest commit

 

History

History
109 lines (87 loc) · 3.63 KB

introduction.mdx

File metadata and controls

109 lines (87 loc) · 3.63 KB
title Introduction
description Welcome to ScrapeGraphAI - AI-Powered Web Data Extraction

<img className="block dark:hidden w-full" style={{ borderRadius: '0.5rem' }} src="/images/introduction/docs-banner-ligth.png" alt="ScrapeGraphAI Documentation" /> <img className="hidden dark:block w-full" style={{ borderRadius: '0.5rem' }} src="/images/introduction/docs-banner-dark.png" alt="ScrapeGraphAI Documentation" />

Overview

ScrapeGraphAI is a powerful suite of LLM-driven web scraping tools designed to extract structured data from any website and HTML content. Our API is designed to be easy to use and integrate with your existing workflows.

Perfect For

Feed your AI agents with structured web data for enhanced decision-making Extract and structure web data for research and analysis Build comprehensive datasets from web sources Create scraping-powered platforms and applications

Getting Started

Sign up and access your API key from the [dashboard](https://scrapegraphai.com/dashboard) Select from our specialized extraction services based on your needs Begin extracting data using our SDKs or direct API calls

Documentation Structure

Learn how to manage your account, monitor jobs, and access your API keys Explore our core services: SmartScraper, SearchScraper, and Markdownify Implement with Python, JavaScript, or integrate with LangChain and LlamaIndex Detailed API documentation for direct integration

Core Services

  • Scrape: Fetch a page in markdown, HTML, screenshot, JSON, links, images, summary, or branding
  • Extract: AI-powered structured data extraction from any URL, HTML, or markdown
  • Crawl: Asynchronous multi-page site crawling with start / stop / resume controls
  • Monitor: Cron-scheduled jobs that track page changes and fire webhooks

Implementation Options

Official SDKs

  • Production-ready SDKs for Python and JavaScript
  • Comprehensive error handling and retry logic
  • Type hints and full IDE support

Integrations

  • Seamless integration with LangChain
  • Native support for LlamaIndex
  • Perfect for AI agent workflows

Examples & Use Cases

Visit our Cookbook to explore real-world examples and implementation patterns:

  • E-commerce data extraction
  • News article scraping
  • Research data collection
  • Content aggregation
ScrapeGraphAI is built with transparency in mind. Check out our open-source core at: [github.com/scrapegraphai/scrapegraph-ai](https://github.com/scrapegraphai/scrapegraph-ai) Get your API key and start extracting data in minutes!