Connect to Model Providers

Connect deepset Cloud with your model providers, such as Hugging Face, Open AI, Cohere, or Amazon Bedrock to use your private models in deepset Cloud pipelines.

πŸ“˜

You must be an Admin to perform this task.

About This Task

If you connect deepset Cloud with a model provider, you no longer need to provide api_key in your pipelines when using a model from this provider. Once a model provider is connected, you could use the models hosted there in your deepset Cloud pipelines.

Currently supported connections:

  • Hugging Face (only needed for private models hosted there)
  • OpenAI
  • Snowflake (you can connect to a Snowflake database and query your data there)
  • Cohere
  • AmazonBedrock and SageMaker
  • Azure OpenAI
  • Azure Document Intelligence
  • unstructured.io (you can use unstructured.io's file preprocessing services)

Prerequisites

Connect to a Model Provider

  1. Click your name in the top right corner and select Connections.
    A screen shot of the deepset Cloud UI with the personal menu expanded and the Connections option underlined.
  2. Click Connect next to a model provider.
  3. Enter your user access token and submit it.