Skip to main content

Use Anthropic Models

Use Anthropic models through Anthropic API in your pipelines.

You can use Anthropic's embedding and ranking models as well as LLMs. For a full list of supported models, see Anthropic documentation.

Prerequisites​

You need an active Anthropic API key to use Anthropic's models.

Use Anthropic Models​

First, connect deepset AI Platform to Anthropic through the Integrations page. You can set up the connection for a single workspace or for the whole organization:

Add Workspace-Level Integration​

  1. Click your profile icon and choose Settings.
  2. Go to Workspace>Integrations.
  3. Find the provider you want to connect and click Connect next to them.
  4. Enter the API key and any other required details.
  5. Click Connect. You can use this integration in pipelines and indexes in the current workspace.

Add Organization-Level Integration​

  1. Click your profile icon and choose Settings.
  2. Go to Organization>Integrations.
  3. Find the provider you want to connect and click Connect next to them.
  4. Enter the API key and any other required details.
  5. Click Connect. You can use this integration in pipelines and indexes in all workspaces in the current organization.

Then, add a component that uses an Anthropic model to your pipeline. Here are the available components:

This is where you pass the model in these components in Pipeline Builder:

The component cards of components using Anthropic models with the model parameter highlighted.