Skip to main content
For the complete documentation index for agents and LLMs, see llms.txt.

File Updates in Indexes

You can upload, delete, and modify files if your index is enabled. You can also update the metadata of individual files. Learn how the index processes these changes.

What Gets Reindexed​

Changes apply only to the specific files you modify. For example, when you upload a file, only that file is indexed. Haystack Platform doesn't reindex all existing files.

Metadata Updates​

When you update a file's metadata, Haystack Enterprise Platform does not reindex the file content. Instead, it does the following:

  • It updates the metadata in the workspace index in OpenSearch.
  • It notifies the index, which then updates any documents derived from the file.

Any changes to the files are queued and delayed to make sure they run in the correct order.

Example​

Let's say you perform these operations on your files:

  • Upload file1.txt.
  • Upload file2.txt.
  • Delete file1.txt.
  • Update metadata of file2.txt.
  • Upload file3.txt.

Haystack Enterprise Platform processes the changes in the same order:

  • Index file1.txt.
  • Index file2.txt.
  • Delete file1.txt.
  • Update documents created from file2.txt with the new metadata.
  • Index file3.txt.
Checking the task status

Only after the steps are completed and the number of pending tasks is 0, the changes are live and you can view them in Haystack Platform.

You can check the task status on the Indexes page. Hover your mouse over the status label:

The task status label on the Indexes page

You can also use the Get Index By Name endpoint to check the task status.