Say Goodbye
to Guesswork
with a data-driven approach
to AI development
The only data-driven toolkit to evaluate and improve your LLM application
View tutorial
pip install relari
![thoropass logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e166ef_logo_thoropass.webp)
![pwc logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e166f0_logo_pwc.webp)
![Shell logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e166f1_logo_Shell.webp)
![Vanta logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e1670a_logo_vanta.webp)
![danswer logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e1670c_logo_danswer.webp)
![wolfia logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e166f2_logo_wolfia.webp)
![ellipsis logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e1670d_logo_ellipsis.webp)
![Abel logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e1670e_logo_abel.webp)
![thoropass logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e166ef_logo_thoropass.webp)
![pwc logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e166f0_logo_pwc.webp)
![Shell logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e166f1_logo_Shell.webp)
![Vanta logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e1670a_logo_vanta.webp)
![danswer logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e1670c_logo_danswer.webp)
![wolfia logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e166f2_logo_wolfia.webp)
![ellipsis logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e1670d_logo_ellipsis.webp)
![Abel logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e1670e_logo_abel.webp)
![thoropass logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e166ef_logo_thoropass.webp)
![pwc logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e166f0_logo_pwc.webp)
![Shell logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e166f1_logo_Shell.webp)
![Vanta logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e1670a_logo_vanta.webp)
![wolfia logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e166f2_logo_wolfia.webp)
![ellipsis logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e1670d_logo_ellipsis.webp)
![danswer logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e1670c_logo_danswer.webp)
![Abel logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e1670e_logo_abel.webp)
Systematically improve your
Go From Prototype to Production Faster
Move quickly and with confidence. Make your complex system more robust and reliable with custom, high-quality data.
Auto Prompt
Optimizer
Custom
Evaluators
Synthetic
Golden Dataset
Systematic
Fine-tuning
Runtime
Monitor
![relari logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e16719_logo.avif)
Data-Driven Development
![Define](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e16729_image.webp)
![Measure](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e1672a_IMG_Measure.webp)
![Improve](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e1672b_IMG_Improve.png)
Product Walkthrough
Trusted by AI pioneers
![Noam Rubin](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e1672d_Noam%20Rubin.avif)
Noam Rubin
AI Engineer at
![vanta logo](https://cdn.prod.website-files.com/669f7329c898141d69e16698/669f7329c898141d69e1672c_logo_vanta.avif)
Security Compliance AI
Before we had Relari, we relied on guesswork and instincts to select key parameters such as similarity threshold, chunk size, embedding models, and retrieval strategies. Using Relari’s synthetic golden datasets and tailored evaluation metrics, we were able to easily understand trade-offs among different parameters over large datasets, and make confident, informed decisions. This data-driven process significantly improved our iteration speed, allowing us to reach production-grade for multiple LLM products over a short period of time.
Read the case studyLearn more about LLM development on our Blog
Pricing
How to get started
Community
Starter
Team
Enterprise
*credits can be used towards dataset generation, evaluation runs, and prompt optimization runs
Got a question?
Why data-driven development?
What's a golden dataset?
Can I use my own datasets with Relari?
What do I need to provide to generate synthetic datasets?
How do I create custom evaluation metrics?
How does auto prompt optimizer work?
My application isn’t written in Python or TypeScript. Will Relari be helpful?
I can’t have data leave my environment. Can I self-host Relari?