Class InMemoryCache<T>

A cache for storing LLM generations that stores data in memory.

Type Parameters

T = Generation[]

Hierarchy (view full)

BaseCache<T>
- InMemoryCache

Index

Constructors

Methods

lookup update global

Constructors

constructor

new InMemoryCache<T>(map?): InMemoryCache<T>
Type Parameters
- T = Generation[]
Parameters
- Optionalmap: Map<string, T>
Returns InMemoryCache<T>
Overrides BaseCache.constructor
- Defined in langchain-core/src/caches/base.ts:59

Methods

lookup

lookup(prompt, llmKey): Promise<null | T>
Retrieves data from the cache using a prompt and an LLM key. If the data is not found, it returns null.
Parameters
- prompt: string
  The prompt used to find the data.
- llmKey: string
  The LLM key used to find the data.
Returns Promise<null | T>
The data corresponding to the prompt and LLM key, or null if not found.
Overrides BaseCache.lookup
- Defined in langchain-core/src/caches/base.ts:71

update

update(prompt, llmKey, value): Promise<void>
Updates the cache with new data using a prompt and an LLM key.
Parameters
- prompt: string
  The prompt used to store the data.
- llmKey: string
  The LLM key used to store the data.
- value: T
  The data to be stored.
Returns Promise<void>
Overrides BaseCache.update
- Defined in langchain-core/src/caches/base.ts:81

`Static`global

global(): InMemoryCache<Generation[]>
Returns a global instance of InMemoryCache using a predefined global map as the initial cache.

Returns InMemoryCache<Generation[]>
A global instance of InMemoryCache.
- Defined in langchain-core/src/caches/base.ts:90