Release 2024.7

July 2024 brings updates to the way deepset Cloud handles user feedback.

New API

We added new API endpoints for feedback to unify ratings for all pipeline types. The new endpoints are:

They replace the Add Feedback and Get Pipeline Feedback endpoints which will be deprecated in October 2024.

🚩

ACTION REQUIRED

We'd like you to migrate to the new API until 21 October 2024. That's when we plan to deprecate the old feedback API.

More Options

We've added a third "thumbs" icon and a free text field for users to justify their rating. Users can now indicate if the answer is accurate (thumbs up), somewhat accurate (thumbs middle), or inaccurate (thumbs down). They can also write additional feedback for each answer.

Tags

Admins can configure tags per pipeline. When giving feedback, users will see these tags and be able to choose them. Here's what tags look like in deepset Cloud:

The text field for giving feedback with tags above it. The tags say: Not the right style, Not factually correct, Issue with the retriever, Refused to answer, No answer, Other. Two tags are selected in blue

You can add and delete tags on the Pipeline Details page in the Settings tab. Just click the name of the pipeline to add tags to it:

Pipeline details page with the Settings tab open and tags visible there

You can also use these REST API endpoints to add, delete, and list existing tags:


Debug Mode in Playground

When testing your pipeline, you can enable debug mode and gain real-time insights into your requests. Ask a question, wait for an answer, and then check the logs to see all the details of how your pipeline is processing the query without switching between interfaces. Now, you can test and debug in one place.

Playground with the debug mode enabled and the view logs option visible Example logs with the response