Scrape

POST /v1/scrape fetches one URL and converts it. The model is firecrawl/scrape. The provider fetches the page, not Aile, and nothing is stored.

cURLcurl
1curl https://api.aile.sh/v1/scrape -H "Authorization: Bearer $AILE_KEY" -H "Content-Type: application/json" -d '{ "model": "firecrawl/scrape", "url": "https://example.com", "formats": ["markdown", "links"] }'
JSONjson
1{
2 "object": "scrape",
3 "model": "firecrawl/scrape",
4 "url": "https://example.com/",
5 "markdown": "# Example Domain ...",
6 "links": ["https://www.iana.org/domains/example"],
7 "metadata": { "title": "Example Domain", "status_code": 200, "content_type": "text/html" }
8}

Fields

  • url: required, http or https.
  • formats: any of markdown, html, raw_html, links. Default ["markdown"].
  • only_main_content: default true.
  • max_pdf_pages: 1 to 50, default 50. Caps how much of a PDF is read.
  • mobile, wait_for (milliseconds, up to 10,000), country.

Billing

  • A web page is one unit. A PDF is one unit plus one per page read.
  • The hold is 1 + max_pdf_pages and is written down to what was read. Lower max_pdf_pages for a smaller hold.
  • Needs an API key. Keyless x402 is not offered, because the price is only known after the page is read.