Website · Producthunt · Documentation

👉 Follow us: |

YiVal is an GenAI-Ops framework that allows you to iteratively tune your Generative AI model metadata, params, prompts and retrieval configs all at once with your preferred choices of test dataset generation, evaluation algorithms and improvement strategies.

Check out our quickstart guide! →

• Add ROUGE and BERTScore evaluators
• Add support to midjourney
• Add support to LLaMA2-70B, LLaMA2-7B, Falcon-40B,
• Support LoRA fine-tune to open source models

	🔧 Experiment Mode:	🤖 Agent Mode (Auto-prompting):
Workflow	Define your AI/ML application ➡️ Define test dataset ➡️ Evaluate 🔄 Improve ➡️ Prompt related artifacts built ✅	Define your AI/ML application ➡️ Auto-prompting ➡️ Prompt related artifacts built ✅
Features	🌟 Streamlined prompt development process 🌟 Support for multimedia and multimodel 🌟 Support CSV upload and GPT4 generated test data 🌟 Dashboard tracking latency, price and evaluator results 🌟 Human(RLHF) and algorithm based improvers 🌟 Service with detailed web view 🌟 Customizable evaluators and improvers	🌟 Non-code experience of Gen-AI application build 🌟 Witness your Gen-AI application born and improve with just one click
Demos		- Startup Company Headline Generation Bot🔥

pip install yival

To get started with a demo for basic interactive mode of YiVal, run the following command:

yival demo --basic_interactive

Once started, navigate to the following address in your web browser:

http://127.0.0.1:8073/interactive

For more details on this demo, check out the Basic Interactive Mode Demo.

yival demo --qa_expected_results

Once started, navigate to the following address in your web browser: http://127.0.0.1:8073/

Click to view the screenshot

For more details, check out the Question Answering with expected result evaluator.

Dive into the world of YiChing and discover your fortune on our index page. A fun and interactive way to get started with Yival.