Interface ApifyDatasetLoaderConfig<Metadata>

interface ApifyDatasetLoaderConfig<Metadata> {
    clientOptions?: ApifyClientOptions;
    datasetMappingFunction: ApifyDatasetMappingFunction<Metadata>;
    maxConcurrency?: number;
    maxRetries?: number;
    onFailedAttempt?: FailedAttemptHandler;
}

Type Parameters

  • Metadata extends Record<string, any>

Hierarchy

  • AsyncCallerParams
    • ApifyDatasetLoaderConfig

Properties

clientOptions? datasetMappingFunction maxConcurrency? maxRetries? onFailedAttempt?

Properties

OptionalclientOptions

clientOptions?: ApifyClientOptions

datasetMappingFunction

datasetMappingFunction: ApifyDatasetMappingFunction<Metadata>

OptionalmaxConcurrency

maxConcurrency?: number

The maximum number of concurrent calls that can be made. Defaults to Infinity, which means no limit.

OptionalmaxRetries

maxRetries?: number

The maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.

OptionalonFailedAttempt

onFailedAttempt?: FailedAttemptHandler

Custom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.

Settings

Member Visibility

On This Page

Properties