Enkaidu WorkIn Progress
Get startedEnkaidu is your transparent second-in-command(line) for coding and creativity. Using your preferred local AI large language models, Enkaidu is designed to assist you with writing & maintaining your code, documentation, or your next great novel.
Here’s a quick demo that shows how Enkaidu reveals what’s happening under the hood as you work with the AI model.
-
Self-sovereign#
Enkaidu works with your locally-hosted AI models, keeping all your inference local.
-
Customizable#
Enkaidu lets you defined your own system prompts, parameterized custom prompts, and macros to suit your workflow.
-
Transparent#
Enkaidu doesn’t hide any of the interaction between you and your AI model, show when tools are used or MCP server calls are made, and more.
-
Terminal first#
Enkaidu is first and foremost a terminal app, letting you work in your console where you can run Enkaidu.
-
Tool-calling#
Enkaidu includes built-in tools that the AI models can call, and lets you choose when you make them availale to the AI model.
-
MCP Client#
Enkaidu supports calling MCP servers (over HTTP) for tools and prompts, letting you connect to them when you need them.
-
Compatibility#
Enkaidu works with any AI inference server that supports the Open AI “chat completion” API. We’ve used it with local models via LM Studio, Llama CPP, Ollama, and cloud models via Azure Open AI.
Questions?
-
Why did you make it?#
AI “feels like” magic and I wanted to figure out how using LLMs to build applications work by using the various protocols from scratch.
-
Who is it for?#
Enkaidu is for anyone who is curious about using an AI assistant and engaging with the AI models in a deeper way than just typing prompts and “vibing.”
-
Where can I use it?#
Enkaidu is a command-line app that runs in the terminal, and can be run locally or remotely as long as you can connect to your AI model.
-
What does it cost?#
Enkaidu is free and open source under the
Mozilla Public License Version 2.0. The code is currently in a private repo until I’m ready to start getting the inevitable “feedback.” -
Can I use it with [NAME YOUR] SaaS AI provider?#
Enkaidu uses the Open AI chat completion protocol, so it can be used with Chat GPT. It “should” work with any SaaS AI providers who support the protocol, and it “should” work via any Open AI protocol proxies.