The Compare feature enables you to experiment with different task configurations and continuously improve performance. You can access the Compare view by selecting two different versions from the Task view. If you only select one, it will automatically allow you to Compare against your Active task.

compare_initiate_guide.mp4

What Can I Compare?

In the Compare view, you see two task configurations side-by-side. You can configure any of the core components that make up a task, such as:

• User Prompt: Defines the task for the LLM.
• System Prompt: Provides additional context and constraints.
• Temperature: Adjusts the variation in responses.
• Model: Choose from leading proprietary or open-source models.
• Output Format: Specify structured formats that integrate seamlessly with your database.

After you’ve decided on the two versions you’d like to compare, simply provide the input data you’d like to run both on.

Compare_run_guide.mp4

Optimising prompts and output structures

Let’s try comparing a new prompt that provides more detail for the LLM and specifying exactly how we’d like the outputs formatted. You can instantly see the difference in the response.

comparing_diff_prompts_guide.mp4