Check the init and runtime parameters you can use to customize NvidiaGenerator.
YAML Init Parameters
These are the parameters you can pass to this component in the pipeline YAML configuration:
Parameter | Type | Possible values | Description |
---|---|---|---|
| Secret | Default: | API key for NVIDIA NIM. |
| String | Name of the model to use. See the NVIDIA NIMs for information on the supported models. | |
| String | Default: | Custom API URL for NVIDIA NIM. |
| Dictionary of HarmCategory and HarmBlockThreshold | Default: | Additional arguments to pass to the model. These arguments are model-specific. Find your model in NVIDIA NIMs |
REST API Runtime Parameters
There are no runtime parameters you can pass to this component when making a request to the Search REST API endpoint.