Class CollegeConfidentialLoader

A document loader specifically designed for loading documents from the College Confidential website. It extends the CheerioWebBaseLoader.

Example

const loader = new CollegeConfidentialLoader("https:exampleurl.com");
const docs = await loader.load();
console.log({ docs });

Hierarchy (view full)

Constructors

constructor

Properties

caller timeout webPath headers? selector? textDecoder?

Methods

load scrape imports scrapeAll

Constructors

constructor

Properties

caller

caller: AsyncCaller

timeout

timeout: number

webPath

webPath: string

Optionalheaders

headers?: HeadersInit

Optionalselector

selector?: SelectorType

OptionaltextDecoder

textDecoder?: TextDecoder

Methods

load

  • load(): Promise<Document[]>

  • Overrides the base load() method to extract the text content from the loaded document using a specific selector for the College Confidential website. It creates a Document instance with the extracted text and metadata, and returns an array containing the Document instance.

    Returns Promise<Document[]>

    An array containing a Document instance with the extracted text and metadata from the loaded College Confidential web document.

scrape

Staticimports

  • imports(): Promise<{
        load: ((content:
            | string
            | AnyNode
            | AnyNode[]
            | Buffer, options?: null | CheerioOptions, isDocument?: boolean) => CheerioAPI);
    }>

  • A static method that dynamically imports the Cheerio library and returns the load function. If the import fails, it throws an error.

    Returns Promise<{
        load: ((content:
            | string
            | AnyNode
            | AnyNode[]
            | Buffer, options?: null | CheerioOptions, isDocument?: boolean) => CheerioAPI);
    }>

    A Promise that resolves to an object containing the load function from the Cheerio library.

StaticscrapeAll

  • scrapeAll(urls, caller, timeout, textDecoder?, options?): Promise<CheerioAPI[]>

  • Fetches web documents from the given array of URLs and loads them using Cheerio. It returns an array of CheerioAPI instances.

    Parameters

    • urls: string[]

      An array of URLs to fetch and load.

    • caller: AsyncCaller
    • timeout: undefined | number
    • OptionaltextDecoder: TextDecoder
    • Optionaloptions: CheerioOptions & {
          headers?: HeadersInit;
      }

    Returns Promise<CheerioAPI[]>

    A Promise that resolves to an array of CheerioAPI instances.

Settings

Member Visibility

On This Page

Constructors
Properties
Methods