Skip to main content

​
Installation

​
Overview

The @ai-billing/chutes package provides middleware for tracking token usage and calculating costs when using Chutes models with the Vercel AI SDK. It captures Chutes-specific metrics, such as inputCacheReadTokens, ensuring that Prompt Caching costs are accurately reflected.

​
Usage

To use the middleware, wrap your Chutes model using wrapLanguageModel from the ai package and pass the createChutesMiddleware.
1

Initialize the Chutes provider

First, set up the Chutes provider using your API key.
2

Define model pricing

Set up a price resolver to define the costs for the models you’ll be using. For Chutes, you can specify costs for both standard prompt/completion tokens and cached tokens (inputCacheReadTokens).
3

Create the billing middleware

Initialize the Chutes billing middleware. You need to provide a destination (such as consoleDestination) where billing events will be sent, along with your priceResolver.
4

Wrap the model

Use wrapLanguageModel from the ai package to apply the billing middleware to your Chutes model.
5

Use the wrapped model

Finally, use the wrapped model with AI SDK functions like generateText or streamText. The billing middleware will automatically track tokens, handle caching metrics, and calculate costs.