LinkContentFetcher Parameters

Check the init and runtime parameters you can use to customize LinkContentFetcher.

YAML Init Parameters

These are the parameters you can pass to this node in the pipeline YAML configuration:

Parameter

Type

Possible values

Description

raise_on_failure

Boolean

True, False
Default: True

If True, raises an exception if it fails to fetch a single URL. For multiple URLs, it logs errors and returns the content it successfully fetched.
Required.

user_agents

List of strings

Default: None

User agents for fetching content. If None, uses a default user agent.
Optional.

retry_attempts

Integer

Default: 2

Specifies the number of times you want it to retry to fetch the URL's content.
Required.

timeout

Integer

Default: 3

Timeout in seconds for the request.
Required.


REST API Runtime Parameters

There are no runtime parameters you can pass to this component when making a request to the Search REST API endpoint.