prompt_cache_hit_tokens

Property

Belongs to type Completion_Usage

Open in TypeHub

Type

Integer

Description

Number of tokens in the prompt that hit the context cache.

part of the Apioo-Project