Skip to main content
For the complete documentation index for agents and LLMs, see llms.txt.

Manage Metric GroupsBeta

Beta
This is coming — this page describes a feature that's still being rolled out and may not be available to you yet.

Create, edit, and delete Metric Groups to keep related metrics together, so you can reuse the same set of metrics across experiments.

About This Task​

A Metric Group is a named, ordered set of metrics in your workspace. For background, see Metric Groups.

You manage groups on the Metric Groups tab of the Metrics page, next to the Metrics tab. To share a link that opens Metric Groups directly, copy the page address while the tab is selected.

When you add built-in Metrics, the platform can create a Metric Group for each category for you. For details, see Add Built-In Metrics.

Create a Metric Group​

  1. Open your pipeline, click Evaluation, and go to Metrics > Metric Groups.
  2. Start a new Metric Group.
  3. In the name field, type a name that describes what the group measures, for example Answer quality.
  4. In the metrics field, select the metrics the group contains. You can add up to 50. The order in which you pick them is the order in which results show them.
    The group holds the metrics, not specific versions, so it always uses each metric's latest version.
  5. Save the group.
    Saving is unavailable until the group has a name and at least one metric. If your workspace has no metrics yet, create a metric first, or use the option in the form to create a new metric.

The metrics field doesn't offer archived metrics. To add one, unarchive it first on the Metrics tab. A group that already holds an archived metric keeps showing it by name and still scores with it. For details, see Archived Metrics.

The AI assistant can also propose a Metric Group when it suggests an experiment. In that case, the same form opens pre-filled with the proposed name and metrics, and a notice above the form tells you it came from the assistant. Review the values, change them if needed, and save.

Edit a Metric Group​

  1. Go to Metrics > Metric Groups and open the group you want to change.
  2. Change the name, add metrics, or remove them. Reorder results by changing the order in which the metrics are selected.
  3. Save the group.

To change how much each metric counts toward the group's Composite, see Weigh Metrics in the Composite. Saving a group keeps its weights for the metrics that stay in the group. Weights of metrics you remove are dropped. For details, see Metric Weights.

Weigh Metrics in the Composite​

Use the Composite panel on the right of the Metric Group form to choose which metrics count toward the group's Composite, the single number that summarizes the group, and how much each one counts. The panel shows each metric's share of the total while you type.

  1. Open the Metric Group form: create a group, or open an existing one in Metrics > Metric Groups.
  2. In the Composite panel, switch on each metric that should count toward the Composite.
    Switching a metric on sets its weight to 1. A metric that is switched off is left out of the Composite.
  3. Type a weight for each switched-on metric. Weights are relative, so only their proportions matter: weights of 3 and 1 count the same as 6 and 2.
    The share of each metric appears beside its weight, and the spider chart updates as you type. The chart is read-only. The rings run to 25%, 50%, or 100%, whichever fits your largest share, so small differences stay visible.
  4. Save the group.
    If a switched-on metric has an empty or invalid weight, the panel shows an error and Save stays unavailable until you fix it. The weight must be a number above 0. After you save, reopen the group to check that the weights and shares are as you set them.

Renaming a group doesn't change its weights. Only metrics that have a normalized mean can be weighted. For which metrics qualify and how the Composite is calculated, see Metric Weights.

Editing a group's weights changes only the runs you start afterward. A run that already started keeps the weights the group had at that time, so its Composite doesn't change. For details, see Normalized Means and the Composite.

Delete a Metric Group​

  1. Go to Metrics > Metric Groups and select the group you want to remove.
  2. Delete it and confirm.

The platform doesn't delete a group that is still in use. This happens in two cases:

  • An optimization goal uses the group. Change the goal to use a different group first.
  • A check in a Service's deployment gate uses the group. The REST API answers with a 409 error that names the Service. Remove the check from the gate, or change it to use a different group, and then delete the group. A gate needs its Metric Group to reach a decision, so the check has to go first.

What To Do Next​