Managing Organization Settings
Invite members, add workspaces, create organization-level integrations, secrets, and API keys.
About This Task
All settings you configure on the Organization Settings page apply across the entire organization, including all its workspaces. For example, if you add an integration here, it becomes available to every workspace in the organization.
Access Organization Settings
- Click your profile icon and choose Settings.
- Go to Organization.
- Switch between tabs to access the settings you want to update. You can invite users to organization, assign them roles for each workspace, add secrets, integrations, and API keys that apply organization-wide.
Manage Environments
If you're an organization admin, use the Environments tab to create named fleet environments that group services onto shared underlying infrastructure. Services assigned to the same environment share infrastructure instead of each running in its own isolated setup.
- Go to Organization settings and click the Environments tab.
- To add an environment, type a name in the field at the bottom of the list and confirm.
- To rename an environment, click its name, edit it, and confirm.
- To delete an environment, click Delete next to it and confirm.
After you create an environment, you can assign services to it from the service's hosting settings. For details, see Manage a Service.
Compute Tab
Organization admins use the Compute tab to choose which instance sizes your organization can use, how many spare instances to keep ready for each size, and which size is the default. For steps, see Managing Compute Settings.
Invite Multiple Members and Assign Them to Workspaces
When you click Invite members, you can invite one or several people in a single action:
- In the Emails field, type an email address and press Enter, comma, or space to add it as a tag. Repeat for each person you want to invite, or paste a comma- or space-separated list of addresses. Addresses that aren't valid emails are automatically removed from the field, and listed in an error message below the field so you can fix or remove them.
- In Add members to workspaces, select one or more workspaces. All the people you invite in this action get the same role and access to the same workspaces.
- Click Invite. Each invited address is sent its own invitation. If you invited multiple people, you get a separate success or error notification for each invite, so you can tell which invites went through even if one of them failed.
Environments Tab
Use Environments to manage the shared compute that your services run on. For background, see Gateway.
View Environment Metrics
Services that use the same environment share its compute instances. To learn more about environments, see Gateway. To find out which services put the most load on an environment's shared compute instances, check the environment's metrics. On the Environments tab in Organization Settings, click the chart button in the environment's row. The metrics panel expands.
The metrics panel shows:
- Services: the number of services in your current workspace that use the environment.
- Requests, last 7 days: the total number of requests across those services over the last seven days.
- Each service that uses the environment, with a link to its page and its request count for the last seven days. Once all counts load, the service with the most requests appears first.
- CPU, memory, and replica charts for all pods in the environment. For details, see Check an Environment's Resource Usage.
Click the chart button again to collapse the panel.
Environment Metrics Limits and Permissions
- The metrics panel only includes services in your current workspace. Services and requests from other workspaces that use the same environment aren't counted in the total.
- Viewing request counts needs permission to read search history. If you don't have this permission, you can still see which services use the environment, but request counts are hidden and a message explains why.
- If a service's request count can't be loaded, the environment total shows as unavailable (
n/a) until every service's count is in. - If no service in your current workspace uses the environment, the panel says so.
- The CPU, memory, and replica charts appear only if at least one service that uses the environment is in your current workspace.
Check Environment Resource Usage
To see how much of an environment's shared compute its services use over time, check the CPU, memory, and replica charts in the environment's metrics panel on the Environments tab. For details, see Check an Environment's Resource Usage.
Integrations Tab
Use Integrations to connect external services for your organization. Setting up a connection in Integrations makes it available to every workspace in the organization. You can then use components from the connected service in your pipelines.
External Connections
Register OAuth providers so users can authenticate with third-party services such as Microsoft, Google, Slack, or Notion. You can add, view, and delete OAuth providers from this section. For step-by-step instructions, see Configure External Connections.
Prewarm Models Tab
Use Prewarm Models to shorten cold starts for pipelines that use Hugging Face models. When you list the repo ids of the models your pipelines use, we download them onto your organization's spare instances before a service starts, so your service doesn't wait for the download.
Only organization admins can view and change this setting.
Add Models to Prewarm
- Go to Settings > Organization and click Prewarm Models.
- In the Hugging Face models field, type a Hugging Face repo id, for example
intfloat/multilingual-e5-base, and press Enter. You can also paste several ids separated by commas, spaces, or new lines. Each id appears as a tag. - To remove a model, click the close icon on its tag.
- Click Save changes. The button is active only when you have unsaved changes. When Your prewarm models are saved. appears, your changes are saved. They apply only to spare instances that start after you save, not to instances that are already running.
If the tab shows We couldn't load your prewarm models., click Retry to load the current list before you make changes.
How Prewarming Works
Prewarming is best-effort. It speeds up startup, but it never stops an instance from starting.
- A spare instance becomes available as soon as it starts. It doesn't wait for the model download to finish.
- If a download fails, for example because a model repo can't be reached or the download runs out of memory, the spare instance stays available. Your service downloads the models when it starts, as it does without prewarming.
- If a service claims a spare instance within a few seconds of the instance starting, the download might not be finished, so the service downloads the models when it starts.
Repo ID Requirements
A repo id is either a model name or namespace/name. It can contain letters, digits, underscores, periods, hyphens, and at most one slash. Each segment must start with a letter, digit, or underscore. Leading and trailing spaces are removed, and duplicate ids are saved once. We reject ids that don't follow these rules.
Prewarming doesn't support gated Hugging Face models that need an access token.
To learn how to use Hugging Face models in your pipelines, see Use Hugging Face Models.
Was this page helpful?