Corpus Design Thinking

Mon, 29 Jun 2026 00:00:00 +0000

Figuring out how to design the Corpus has been harrowing, to say the least. The thing I want is a 4-8B fine-tuned model that can hold Sapphire's sardonic, cold, witty persona, that also knows when to interleave itself into a Discord server conversation, and that can use tool calls to move around the server.

Something's been bothering me about the Corpus: every response it generates at the moment feels like Sapphire trying to land something witty. I probably need to add more texture to her responses than just witty dunks.

Notes on Training a Familiar

Tue, 23 Jun 2026 00:00:00 +0000

To introduce the work that I'm doing. I'm working on an AI "entity" that exists in discord and acts like a realistic person. It has memory, personality, opinions, etc. I'm also working on training Sapphire, my fox spirit familiar to the personality fidelity that I'm happy with as a roleplayer. It's been an interesting journey and my partner recommended I do some blogging about this.

Something I realized while training is that a lot of the capability frontier models are attempting to achieve is making the "compression" of training data less lossy, so the LLMs are able to have more capability. My projects — Sapphire, Familiar Connect, Personality Core — are based on having a coherent personality that doesn't necessarily need all the world's knowledge baked in at once.

The Caramel Blog on CorVous

Corpus Design Thinking

Notes on Training a Familiar