NvidiaGenerator Parameters

Check the init and runtime parameters you can use to customize NvidiaGenerator.

YAML Init Parameters

These are the parameters you can pass to this component in the pipeline YAML configuration:

ParameterTypePossible valuesDescription
api_keySecretDefault: Secret.from_env_var("NVIDIA_API_KEY")API key for NVIDIA NIM.
Required.
modelStringName of the model to use. See the NVIDIA NIMs for information on the supported models.
Required.
api_urlStringDefault: "https://integrate.api.nvidia.com/v1"Custom API URL for NVIDIA NIM.
Required.
model_argumentsDictionary of HarmCategory and HarmBlockThresholdDefault: NoneAdditional arguments to pass to the model. These arguments are model-specific. Find your model in NVIDIA NIMs
for a list of supported arguments.
Optional.

REST API Runtime Parameters

There are no runtime parameters you can pass to this component when making a request to the Search REST API endpoint.