Experimenting with Prompts
Sometimes, you need to iterate on your prompt to get the best results. deepset Cloud offers Prompt Explorer, where you can test your prompts and compare how they perform. It comes with a library of ready-to-use prompts where you can also save your own prompts.
Changes on their way
We're still actively working on this feature to make it better. This page describes its current, first implementation. We'll be updating it soon to make it smoother.
About This Task
Prompt Explorer is a sandbox environment where you can:
- Test different versions of your prompts before bringing them to production.
- Modify your prompts.
- Compare the same prompt across up to three pipelines.
- Browse through and use curated prompt templates from a library.
- Save custom prompts to the library and reuse them later.
Accessing Prompt Explorer
Prompt Explorer is only available for deployed pipelines that use PromptNode.
In the navigation, click Prompt Explorer:

Testing and Modifying Prompts
Use the Prompt Editor within the Prompt Explorer to modify your prompts and observe how they affect the results. You can experiment with different versions of prompts for the same query and review the history of your results.

By clicking the ellipsis next to a result, you can view the prompt that generated this result.
Using Prompt Templates
Choose a prompt from a library and test it in Prompt Explorer. The prompt you choose shows in Prompt Editor where you can further modify it, if needed.
In Prompt Editor, click Templates. The Custom tab lists the prompts you saved, and the deepset tab lists prompts curated and tested by deepset.

Saving Your Custom Prompts
Save your prompts to the library to be able to use them in the future.
- In Prompt Editor, click Templates.
- On the Custom tab, click Create Custom Prompt.
- Give your prompt a name, type the prompt text, and save your prompt. Use curly brackets to insert a variable that will be filled in at search time. For example
{documents}
.
Comparing Pipelines
You can compare up to three pipelines. This is useful if you have pipelines using different models to understand how they perform. You pass the same query to all the pipelines you're comparing, but you can modify the prompts for each pipeline.
To add a pipeline to comparison, click Add Pipeline at the top of the Playground.

You can then add or remove pipelines using the plus (+) and minus (-) icons:
Each pipeline receives the same query, but you can change the prompt for each pipeline.
Updated 16 days ago