BoltAI v1.16.0: 20+ new features!

Hi everyone. I'm super super excited to share what I've been working on the last few weeks.

After a mini burnout, I was able to get back to building and added a lot of new and useful features. I can't wait to talk about it.

TL;DR: Lots of new features!

  • Inline Whisper: use Whisper in any text field
  • 7 new plugins: Shell Access, FFmpeg, AppleScript, Kagi Search, Brave Search, Perplexity Search, Search
  • Custom App Icon
  • Support Function Calling for Groq, MistralAI & other services
  • Support local vision model (llava via Ollama)
  • Customize AI Service & model for AI Assistant
  • “Default” as an option for Command & Assistant
  • Better UX for AI Commands & Assistants
  • Instant AI Command: press a shortcut key then ask AI about anything
  • Alternative Profile for AI Command
  • AI Command supports custom System Instruction
  • Import from ChatGPT
  • Import/Export BoltAI data
  • BoltAI Database Management
  • Add “official” support for LM Studio
  • Regenerate using different AI Service/Model
  • Dark theme for code blocks
  • Remember sidebar & state
  • Hide Models
  • Highlight Search Keyword
  • Launch at Login
  • Huge performance improvement!!

BoltAI v1.16 with 20+ new features

There are so many new changes, I don't know where to start. Let's start with the most voted feature requests: Inline Whisper

Inline Whisper

The Inline Whisper feature allows you to activate OpenAI's whisper transcription within any textfield on your Mac. Learn more...

Here is a simple demo video (sound on):

7 New AI Plugins

AI Plugin has been my primary focus for a while now. In this release, I've added 7 more plugins:

  • New Web Search Plugins: Kagi Search, Brave Search, Perplexity Search and Search
  • Shell Access Plugin: allows AI to use bash command. WARNING: Always double check the command.
  • FFmpeg Plugin: allows you to edit audio & video using ffmpeg command.
  • AppleScript Plugin: allows BoltAI to control your computer using AppleScript

In the next version, I will add support for custom plugin development. It's more challenging than I thought.

Follow this guide to learn more on using AI Plugin in a chat

CleanShot 2024-06-10 at 19

Added "Function Calling" support for more AI models

The AI Plugin feature requires the AI model to support Function Calling capability.

Previously, this feature is limited to OpenAI's models only.

In this version, I've extended this capability to more AI services. Here is the list of services you can use AI plugins:

  • OpenAI & Setapp
  • Azure OpenAI Service
  • Anthropic Claude 3
  • Groq (recommended to use with llama3-70b only link)
  • Mistral AI (limited to a few models)
  • Together AI (limited to a few models)
  • OpenRouter (only OpenAI's models are supported)

Features for Pro Users:

BoltAI's pro users love the AI Command & AI Inline features. These features integrate deeply with the OS and provide better user experience, but it also the most challenging to implement.

In this release, I've improved some of the feature to make your life easier.

Local Vision Model

BoltAI now supports local vision model (only llava via Ollama for now).

CleanShot 2024-05-02 at 14

Added official support for LM Studio

CleanShot 2024-06-11 at 14

AI Inline supports custom AI Service & Model

This feature is long overdue. In the early days, BoltAI support OpenAI models only. And it becomes a technical debt.

I'm happy to share that I've added support for custom AI Service & Model, including a new option "Default", where it always follow the default service you set in Settings > Models.

CleanShot 2024-06-11 at 14

Default AI Assistant

Set an assistant as default and new chats will always use this assistant.

Go to Settings > Assistants. Right-click on an AI Assistant and choose Set as Default.

AI Command's Alternative Profile

AI Command's Alternative Profile allows you to run the same command with a different configuration profile. Learn more...

Screenshot 2024-06-10 at 5

Customize Instant Command

In BoltAI, an AI Command consists of pre-defined configuration, system instruction and behavior. An Instant Command* allows you to type your prompt and start chatting right away.

Learn more...

CleanShot 2024-06-10 at 18

More customization

UI & UX has always been my top priority for BoltAI. In this version, I've added App Icon customization & better code block theme support.

Customize App Icon: CleanShot 2024-06-08 at 16

Customize Code Block theme & fonts: CleanShot 2024-06-10 at 18

Data import & export

Another most voted feature is to support iCloud sync. Unfortunately, it requires too much effort and I wasn't able to make much progress on this feature yet.

In the meantime, you can transfer your data from one device to another with this data import & export feature.

You can learn more about the feature here:

In this release, I also added the ability to import your ChatGPT data. Enjoy a seamless transition from ChatGPT to BoltAI! Read the step-by-step guide:

CleanShot 2024-06-10 at 21

Improved user experience

I'm quite happy with the overall UI & UX of BoltAI. But there are certain areas where the experience is not quite good yet.

In this version, I'm trying to address some of them.

Easier to switch AI service & model mid-conversation

Quickly regenerate with another AI service/model configuration.

CleanShot 2024-06-11 at 13

Hide unused AI models

Some AI services like OpenRouter & Together AI support a lot of models. It can be overwhelming to find the right model.

In this version, you can choose which model to show when starting a new chat, or when switching to another model.

CleanShot 2024-06-11 at 13

Highlight search keyword

It's a minor feature but I find it super useful.

CleanShot 2024-06-02 at 21

Easier to manage AI Commands/Assistants/Prompts

You can already do bulk update AI Commands & Assistants but it's a bit hard to discover. In this verison, I've added an "action button" to improve the discoverability.

CleanShot 2024-06-10 at 18

Launch at Login

Another useful quality-of-life feature ✌️

Huge performance improvement

I spent a few days optimize the overall performance of BoltAI and I can say it's a lot faster now.

Closing Thoughts

After more than a year working on BoltAI, I started to understand what it is, and who it's for.

Recently OpenAI launched the official ChatGPT app for macOS. And just yesterday, Apple announced Apple Intelligence with system-wide AI integration.

I must admit, it did stress me quite a bit.

But on second thought, I believe this is actually a positive news. More people will be able to leverage AI in ther day-to-day job. And when they understand the limitation of an AI system, they will naturally find a better alternative that solve their niche problems better.

That's where BoltAI can fill the gaps I think.

And lastly, thank you all for your support messages. BoltAI is nothing without its fans 🫶

CleanShot 2024-06-11 at 14

If you are new here, BoltAI is a native macOS app that allows you to access ChatGPT inside any app. Download now.