Check the init and runtime parameters you can use to customize LinkContentFetcher.
YAML Init Parameters
These are the parameters you can pass to this node in the pipeline YAML configuration:
| Parameter | Type | Possible values | Description |
|---|---|---|---|
raise_on_failure | Boolean | True, FalseDefault: True | If True, raises an exception if it fails to fetch a single URL. For multiple URLs, it logs errors and returns the content it successfully fetched.Required. |
user_agents | List of strings | Default: None | User agents for fetching content. If None, uses a default user agent.Optional. |
retry_attempts | Integer | Default: 2 | Specifies the number of times you want it to retry to fetch the URL's content. Required. |
timeout | Integer | Default: 3 | Timeout in seconds for the request. Required. |
REST API Runtime Parameters
There are no runtime parameters you can pass to this component when making a request to the Search REST API endpoint.