Class representing a document loader for loading data from Spider (spider.cloud). It extends the BaseDocumentLoader class.

const loader = new SpiderLoader({
url: "{url}",
apiKey: "{apiKey}",
mode: "crawl"
});
const docs = await loader.load();

Hierarchy (view full)

Constructors

Methods

Constructors

Methods

  • Parameters

    • Optionalsplitter: BaseDocumentTransformer<DocumentInterface<Record<string, any>>[], DocumentInterface<Record<string, any>>[]>

    Returns Promise<Document<Record<string, any>>[]>

    A Promise that resolves with an array of Document instances, each split according to the provided TextSplitter.

    Use this.load() and splitter.splitDocuments() individually. Loads the documents and splits them using a specified text splitter.