Why Should I Evaluate?

Before bringing your pipeline to production, you want to make sure it's useful, provides relevant results, and serves the intended purpose. By evaluating your app, you can determine how effective it is and how satisfied the users are. You can share your pipeline prototype with external users and collect their feedback in deepset Cloud interface. Prototypes are customizable, you can add your brand logo and colors to them.

Detailed Steps

Here’s a breakdown of the steps we recommend you take to evaluate your pipeline:

1. Upload files to your workspace. The pipeline you’re evaluating will run on these files. The more files you upload, the more difficult the task of finding the right answer is.
2. Create a pipeline. You can start with one of the ready-made templates.
3. Share your pipeline with users. At this stage, you want to get an idea of how people use your pipeline and if it works OK. You’re not aiming for high user satisfaction at this point. You just want to determine if it’s ready for an evaluation through experiments. If most of your users are happy with the results, it means it’s good to go. Otherwise, try tweaking your app until its performance is satisfactory.
4. Collect user feedback. It's best to have domain experts and qualified users try your pipeline and then use their feedback to improve it.
5. Optimize and improve your pipeline.