Maximize token efficiency

​

Understand tokens

Bolt inference uses Anthropic’s Claude 3.7 Sonnet and Claude 3.5 Sonnet AI models. We purchase tokens from Anthropic, defined by them as:

The smallest individual units of a language model, and can correspond to words, subwords, characters, or even bytes (in the case of Unicode).

When you interact with Bolt, tokens are consumed in three primary ways:

• Chat messages between you and the LLM.
• The LLM writing code.
• The LLM reading the existing code to capture any changes you made.

​

How Bolt reduces token usage

Bolt’s goal is to use as few tokens as possible to accomplish each task. The team is hard at work continuing to ship product changes that increase token efficiency.

​

How you can reduce token usage

Following these tips can substantially reduce your token usage.

​

Use Discussion Mode

In Build Mode, Bolt updates your code at each stage of your conversation, which uses up tokens. To avoid unnecessary code changes, use Discussion Mode when you want to get help, troubleshoot, or discuss plans, but don’t want to implement anything immediately. Discussion Mode uses approximately 90% fewer tokens than Build Mode.

​

Avoid repeated automated error fix attempts

Repeatedly clicking the Attempt fix button can lead to unnecessary token consumption. After each attempt, review the result and refine your next request if needed. There are programming challenges that the AI cannot solve automatically, so it is a good idea to do some research and intervene manually if it fails to fix automatically.

​

Add error handling to your project

If you find yourself stuck in an error loop, a useful strategy is to prompt the AI to enhance error handling and implement detailed logging throughout the problematic area. The AI excels at inserting robust error logs, even at a granular level, such as between functions or key steps. These logs provide valuable feedback that the AI can use to better understand the root cause of the issue. The additional logging provides more precise information when the error occurs again. With this detailed feedback, the AI can make more accurate adjustments to fix the issue.

​

Use the rollback feature

Use the rollback feature to revert your project to a previous state without consuming tokens. This is similar to an undo button that can take you back to any prior state of your project. This can save time and tokens if something goes wrong with your project. Keep in mind that there is no redo function though. Be sure you want to revert before using this feature because it is final: Bolt permanently removes all changes made after the rollback point.

​

Add functionality incrementally

Make sure the basics of your app are scaffolded before describing the details of more advanced functionality for your site.

Add one piece of new functionality at a time.

​

Use specific and focused prompts

When prompting the AI, be clear and specific. See Prompting effectively for more information. Tell the model to focus on specific files or functions rather than the entire codebase.

​

Reduce the size of your project

As your project grows, more tokens are required to keep the AI in sync with your code. Larger projects (and longer chat conversations) demand more resources for the AI to stay aware of the context, so it’s important to be mindful of how project size impacts token usage.

​

Use knip.dev to remove unused files

In the Bolt terminal run the following command:

npx knip --production --fix --allow-remove-files

Check the output in the terminal to see if the command ran successfully. This command removes unnecessary files from the codebase, which reduces the project size.

​

Use the .bolt/ignore file

If you open a Bolt project in StackBlitz you can edit a file called .bolt/ignore. In this file, you can list any files or folders that Bolt should exclude from the AI context window. For example, here is our Vite React starter’s ignore file.

There, you see the following files are ignored:

src/components/ui/*
hooks/use-toast.ts

These files are completely invisible to the AI, which frees up space in the context window. You’ll need to edit the .bolt/ignore file in StackBlitz and then reopen the project in Bolt for the changes to take effect.

​

Split the project

Break a large app into smaller chunks, and glue it all back together outside of Bolt later. For example, separating the backend and frontend into different projects is a common developer pattern. Be careful doing this if you don’t have experience as a developer.

​

Reset the AI context window

Resetting the AI context window (clearing the conversation history) reduces the amount of information (context) being sent to the AI.

Get the AI to summarize your chat history:

1. Switch to Discussion Mode: in the Bolt prompt box in your project, click Toggle
2. Prompt the AI: Please generate a short summary of our conversation so far.
3. Check that the AI response is accurate and contains everything you need.
4. Copy the response out of Bolt and save it as a .txt or .md file.

Then, reset the context window:

1. Open the menu next to the project name.
2. Click Duplicate.
3. If you have integrations active in the project, Bolt displays a dialog that confirms which integration settings it will copy. Click Duplicate in the dialog to continue.
4. Bolt creates a new copy of the project, with an empty chat history.

In your new project, add the chat summary:

1. Switch to Discussion Mode: in the Bolt prompt box in your project, click Toggle
2. Click Upload files
3. Provide a prompt such as:

   The attached file is a summary of previous discussion about this project.
   Please use it when working on future changes.

4. Press Enter to upload the file and your prompt.