Check the init and runtime parameters you can use to customize NvidiaGenerator.
YAML Init Parameters
These are the parameters you can pass to this component in the pipeline YAML configuration:
| Parameter | Type | Possible values | Description |
|---|---|---|---|
api_key | Secret | Default: Secret.from_env_var("NVIDIA_API_KEY") | API key for NVIDIA NIM. Required. |
model | String | Name of the model to use. See the NVIDIA NIMs for information on the supported models. Required. | |
api_url | String | Default: "https://integrate.api.nvidia.com/v1" | Custom API URL for NVIDIA NIM. Required. |
model_arguments | Dictionary of HarmCategory and HarmBlockThreshold | Default: None | Additional arguments to pass to the model. These arguments are model-specific. Find your model in NVIDIA NIMs for a list of supported arguments. Optional. |
REST API Runtime Parameters
There are no runtime parameters you can pass to this component when making a request to the Search REST API endpoint.