NvidiaGenerator Parameters

Check the init and runtime parameters you can use to customize NvidiaGenerator.

YAML Init Parameters

These are the parameters you can pass to this component in the pipeline YAML configuration:

Parameter

Type

Possible values

Description

api_key

Secret

Default: Secret.from_env_var("NVIDIA_API_KEY")

API key for NVIDIA NIM.
Required.

model

String

Name of the model to use. See the NVIDIA NIMs for information on the supported models.
Required.

api_url

String

Default: "https://integrate.api.nvidia.com/v1"

Custom API URL for NVIDIA NIM.
Required.

model_arguments

Dictionary of HarmCategory and HarmBlockThreshold

Default: None

Additional arguments to pass to the model. These arguments are model-specific. Find your model in NVIDIA NIMs
for a list of supported arguments.
Optional.


REST API Runtime Parameters

There are no runtime parameters you can pass to this component when making a request to the Search REST API endpoint.