Skip to main content

Enable GPU Acceleration for Indexes

By default, indexes run on CPU. You can enable GPU acceleration for an index to speed it up. This is especially useful for pipelines that include components that run faster on a GPU, like DoclingConverter or SentenceTransformersDocumentEmbedder.

About This Task​

When you enable GPU acceleration, the index checks whether a component needs a GPU and assigns one automatically. GPUs are only used when required and are not reserved for the entire index processing.

If GPU acceleration is disabled and your index includes components that rely on a GPU, those components run on the CPU instead. This can slow down processing and may cause timeouts, especially for larger or more complex indexes.

Enable GPU Acceleration​

  1. Go to Indexes and click the index you want to enable GPU acceleration for. This opens the Index Details page.
  2. Open the Settings tab and click the GPU Acceleration toggle to turn it on.
The GPU Acceleration toggle in the pipeline settings