Synchronize Data Using Airbyte

Airbyte is an open source data integration tool you can use to synchronize your data from various sources to destinations. We've added a connector for the deepset AI Platform destination so that you can seamlessly transfer your data from various sources to deepset.

About this Task

With Airbyte, you can easily transfer data from your data sources to a deepset workspace. You can also schedule regular data syncs to automate the process. To learn more about Airbyte, visit their webpage.

You can upload your data from a source you choose to a deepset workspace. Using the deepset destination connector, you can specify:

  • The deepset Cloud API key.
  • The workspace where you want to upload the data.
  • The URL for your deepset Cloud deployment.

For details, see the connector documentation.

Prerequisites

  • You must have an Airbyte account.
  • You must have a deepset Cloud API key. For details, see Generate an API Key.

Synchronize Data with Airbyte

Airbyte is an external service, so we recommend you check their documentation (you can find the links below). Synchronizing data involves three steps:

  1. Add a source.
  2. Add a destination. Choose deepset as the destination. You can check the documentation at deepset.
  3. Set up a connection between source and destination.