Skip to main content
For the complete documentation index for agents and LLMs, see llms.txt.

Configure Index Settings

Control how an index runs: GPU acceleration, batch size, and queue length per replica.


About This Task​

Most index settings can be changed only while the index is disabled, because an enabled index is read-only. Disable the index first, change the setting, and enable the index again. For details, see Edit an Index.

Other settings have their own guides:

Enable GPU Acceleration​

By default, indexes run on CPU. You can enable GPU acceleration for an index to speed it up. This is especially useful for pipelines that include components that run faster on a GPU, like DoclingConverter or SentenceTransformersDocumentEmbedder.

When you enable GPU acceleration, the index checks whether a component needs a GPU and assigns one automatically. GPUs are only used when required and are not reserved for the entire index processing.

If GPU acceleration is disabled and your index includes components that rely on a GPU, those components run on the CPU instead. This can slow down processing and may cause timeouts, especially for larger or more complex indexes.

To enable GPU acceleration:

  1. Go to Indexes and click the index you want to enable GPU acceleration for. This opens the Builder.
  2. Open the Settings tab and click the GPU Acceleration toggle to turn it on.

If your index needs more CPU or memory rather than a GPU, for example to convert large files, set a larger indexing pod size.

What To Do Next​

After you change the settings, enable the index so it applies them. Wait until indexing finishes before you run queries.