Documentation Index
Fetch the complete documentation index at: https://mintlify.com/algolia/docsearch/llms.txt
Use this file to discover all available pages before exploring further.
Overview
DocSearch offers free crawler hosting for open source projects and technical documentation. Algolia maintains and runs the crawler infrastructure, so you only need to implement the search UI on your site.Eligibility Requirements
DocSearch is available for: ✅ Open source project documentation ✅ Technical blogs with programming content ✅ Public documentation sites (not behind authentication) ✅ Production-ready websites (not staging or development sites)What’s Included
When accepted to the DocSearch program, you receive:Free Algolia Application
Crawler Hosting
Dashboard Access
API Keys
Application Process
Applying to DocSearch is streamlined with automated validation:Submit Your Domain
Automated Validation
- Is the content technical?
- Is it publicly accessible?
- Is it production-ready?
Create Your Crawler
- Configure your crawler settings
- Define URL patterns
- Set up content selectors
Verify Domain Ownership
Data Ingestion
Implement Search UI
- The provided code snippet, or
- One of our framework integrations
Timeline
Automated Approval
If your site meets all criteria: Immediate approval → proceed to crawler setupManual Review
If automated validation is inconclusive: 1-2 business days for manual reviewFirst Crawl
After approval and configuration: Minutes to hours depending on site sizeOngoing Crawls
Default schedule: Once per week (can trigger manually anytime)Before You Apply
Make sure your documentation site is ready:✅ Content is public and accessible
✅ Content is public and accessible
✅ Server-side rendering is enabled
✅ Server-side rendering is enabled
✅ Semantic HTML structure
✅ Semantic HTML structure
✅ Internal linking
✅ Internal linking
✅ Production ready
✅ Production ready
Using Official Integrations
We recommend using one of our official integrations for easier implementation:Docusaurus
VitePress
React
JavaScript
After Acceptance
What You’ll Receive
You’ll get an email with:- Application ID: Your Algolia app identifier
- API Key: A search-only key (safe to commit to your repo)
- Index Name: The name of your documentation index
- Dashboard Access: Credentials to access your Algolia dashboard
Implementation
Add DocSearch to your site:Managing Your Crawler
Access the Crawler Dashboard to:- Trigger crawls manually when you update docs
- Edit your configuration in the live editor
- Monitor crawl statistics and errors
- View indexed content and record structure
- Adjust crawl frequency (within limits)
Multiple Projects
If you have multiple documentation sites, please submit separate applications. This ensures:- Proper API key scoping
- Clear application naming
- Correct index generation
- Proper domain restrictions
- Easier support and troubleshooting
Cost and Limitations
Free Forever
DocSearch is completely free for eligible sites, including:- Crawler hosting and maintenance
- Algolia search infrastructure
- Weekly automated crawls
- Dashboard access
- Analytics and monitoring
Requirements
In exchange for free hosting: ✅ Keep the “Search by Algolia” logo visible ✅ Use it only for technical documentation or blogs ✅ Keep your documentation publicly accessibleRemoving the Logo
If you cannot display the Algolia logo, you have two options:- Self-host the crawler: Use the open source docsearch-scraper with your own Algolia account
- Paid Algolia plan: Contact Algolia sales for a commercial plan
Alternative Options
Run Your Own Crawler
If you’re not eligible or need more control:Self-Hosted Crawler
- Your own Algolia account (free tier supports up to 10k records)
- Docker to run the crawler
- A way to schedule regular crawls
Use Algolia Directly
For non-documentation use cases:Algolia API
Frequently Asked Questions
Can I use DocSearch for non-documentation pages?
Can I use DocSearch for non-documentation pages?
Can I share my API key publicly?
Can I share my API key publicly?
How often does the crawler run?
How often does the crawler run?
Can I crawl localhost or staging sites?
Can I crawl localhost or staging sites?
What if my documentation has authentication?
What if my documentation has authentication?
How do I update my crawler configuration?
How do I update my crawler configuration?
Can I index code examples?
Can I index code examples?
What happens if I exceed free tier limits?
What happens if I exceed free tier limits?
Terms and Conditions
Get Help
Before Applying
Join Discord
Read the Docs
After Acceptance
- Crawler issues: Algolia Support
- UI library issues: GitHub Issues
- General questions: Discord community
