Large Language Models

Interact with LLMs in Obsidian

The Large Language Models (LLMs) Plugin gives Obsidian users access to LLMs through cloud providers (OpenAI, Anthropic, Google, and Mistral) and locally via GPT4All and Ollama. Models can be interacted with in the sidebar, main window, and a newly added, floating action button popup window.

Instructions

Installation: Download the plugin via the community plugin browser.

Using models from cloud-based providers:

1. In the plugin settings menu, enter an API key from one of the supported model providers
2. To interact with models, open one of the chat views using the newly added commands (see Commands section below)

Using models locally (GPT4All):

1. Download GPT4All
2. Download a model through GPT4All's model browser
3. In the setting menu of GPT4All, toggle on the "Enable Local Server" setting
4. Models downloaded via GPT4All will be selectable via the model switcher in each chat view

Using models locally (Ollama):

1. Install Ollama and pull the models you want to use
2. In the plugin settings, configure the Ollama host (default: http://localhost:11434)
3. Click "Discover Models" to detect your locally available models
4. Select an Ollama model from the model switcher in any chat view

Commands

Models

Cloud-based:

Local:

Credits

• Johnny ✨
• Ryan Mahoney
• Evan Harris