What's deepset Cloud?

deepset Cloud is a SaaS platform for building LLM applications and managing them across the whole lifecycle - from early prototyping to large-scale production.

You can design, evaluate, deploy, and monitor your LLM apps using an intuitive user interface and a powerful REST API. Along the way, you can easily involve your colleagues and end-users to ensure you end up with a pipeline delivering true value for your use case. Just share the link to your pipeline prototype, customized with your logo and brand colors, to let others test it and give you feedback without needing to log in or set up accounts.

When your pipeline has been tested, evaluated, and deployed, you can connect deepset Cloud to your target application using the REST API and use it wherever you need.

deepset Cloud is model-agnostic, meaning you can use all major LLMs in your apps created in deepset Cloud. You can also easily switch one LLM for another at any time.

Building an Application with deepset Cloud

deepset Cloud helps you through all the steps of creating an NLP application:

  1. deepset Cloud offers file preprocessing components that you can use in your indexing pipeline to preprocess your data and prepare them for search.
  2. In deepset Cloud, you work with pipelines. Pipelines are made up of components. Each component has a different task. For example, a Retriever component retrieves the documents that best match the query. Then, you can have a Ranker component that ranks the documents by the most relevant. Then, the Ranker can pass the documents on to the Generator that uses an LLM to generate an answer based on your documents, and so on.
    The output of one component is used by another component. Components are like building blocks - you can mix and match different nodes or replace a node with another node to create the perfect search system.
  3. Use deepset Cloud experiments to collect metrics about your pipeline performance and tweak it to achieve even better results.
  4. Demo your app to your colleagues and let them test it, all in the deepset Cloud UI. Just share a link to a pipeline prototype customized with your logo and brand colors. No need to create accounts or invite anyone to your deepset Cloud workspace.

deepset Cloud and Haystack

Haystack is deepset's open source AI framework for creating production-ready AI-based systems. deepset Cloud uses Haystack's components, pipelines, and methods. If you've already worked with Haystack, you can reuse this work in deepset Cloud.