web-index
Here are 6 public repositories matching this topic...
Internet scale web crawler in Rust. Incremental and realtime, a tiered fetch ladder that handles anti-bot, an open verifiable fetcher protocol, compact columnar storage, published as Parquet to open-index on Hugging Face.
-
Updated
Oct 26, 2026 - Rust
Exa — independent third-party profile of a public API surface, by API Evangelist. Exa is a neural web search API designed for AI agents and applications. It combines a purpose-built web index with embedding-based retrieval to deliver highly relevant results across categories such as full web, news, companies, research, people, and financials.
-
Updated
Sep 18, 2026
How askFinz reads, files and searches the web itself: the index, its typed collections, the crawler and the research behind it.
-
Updated
Oct 28, 2026
You.com — independent third-party profile of a public API surface, by API Evangelist. You.com runs an AI search and chat product alongside a developer platform that exposes web search APIs designed for AI systems, agents, and LLMs. The platform offers Search, Web Search, Contents, News, Smart, Research, and Finance Research APIs for grounding LLMs
-
Updated
Oct 26, 2026
Kagi — independent third-party profile of a public API surface, by API Evangelist. Kagi is a privacy-focused premium search engine that also operates a commercial APIs portfolio for developers. The Kagi APIs Portal exposes Search, Enrichment, Universal Summarizer, and FastGPT endpoints, plus a free Small Web RSS feed for non-commercial use.
-
Updated
Oct 26, 2026
Add this topic to your repo
To associate your repository with the web-index topic, visit your repo's landing page and select "manage topics."