LinkContentFetcher Parameters

Check the init and runtime parameters you can use to customize LinkContentFetcher.

YAML Init Parameters

These are the parameters you can pass to this node in the pipeline YAML configuration:

ParameterTypePossible valuesDescription
raise_on_failureBooleanTrue, False
Default: True
If True, raises an exception if it fails to fetch a single URL. For multiple URLs, it logs errors and returns the content it successfully fetched.
Required.
user_agentsList of stringsDefault: NoneUser agents for fetching content. If None, uses a default user agent.
Optional.
retry_attemptsIntegerDefault: 2Specifies the number of times you want it to retry to fetch the URL's content.
Required.
timeoutIntegerDefault: 3Timeout in seconds for the request.
Required.

REST API Runtime Parameters

There are no runtime parameters you can pass to this component when making a request to the Search REST API endpoint.