Research / AI Systems
ANNIE V4: Building a Persistent Local AI Runtime
ANNIE V4 is a local-first AI runtime that brings persistent memory, research, project workflows, tools, and voice into one system, with an active research program in evidence-backed recursive self-improvement.
Published on
Purpose
Build an AI system that can preserve continuity, understand ongoing work, and remain useful beyond a single conversation.
Direction
Move from isolated answers toward evidence-backed research, durable project work, controlled action, and measurable recursive self-improvement.
Active Development
ANNIE V4 combines working local AI infrastructure with ongoing research in project execution and recursive self-improvement. Development proceeds through controlled testing, live verification, and measured outcomes.
Why I Started V4
Most AI products are built around a temporary interaction. A user provides a prompt, the model generates an answer, and the useful context slowly disappears as the conversation grows or the session ends. That can work for quick questions, but it is a weak foundation for long projects, continuing research, or any relationship that depends on history.
I built V4 around continuity. Project history, prior decisions, completed work, and relevant memory belong in the runtime rather than depending entirely on a model's temporary context. That requirement shaped the architecture from the beginning.
This version is also a response to the limits I found in earlier ANNIE builds. A model can sound thoughtful while lacking the right memory. It can claim that work is complete without proof. It can call a tool when conversation would have been better, or give a confident answer when fresh evidence was required. ANNIE V4 treats those problems as systems problems, not issues that can be solved by a larger prompt alone.
What ANNIE V4 Is
ANNIE V4 is a local-first AI runtime built around a language model rather than a thin interface placed in front of one. The model is still responsible for interpretation and natural responses, but it operates inside a larger environment that manages memory, projects, research, tools, background work, speech, evaluation, and controlled execution.
The simplest way to describe it is as personal AI infrastructure. It is designed to remain present across different kinds of work while preserving one coherent relationship with the user. Conversation is the main interface, but the system behind that conversation can maintain state, retrieve relevant evidence, follow a project, and record what actually happened.
I do not view ANNIE as a character placed on top of disconnected utilities. The identity of the assistant comes from continuity. It should remember prior work, understand its current limits, distinguish a plan from an executed result, and communicate uncertainty naturally. That requires the surrounding runtime to be as important as the model itself.
From Chatbot to Runtime
A chatbot mainly waits for text and returns text. A runtime has to coordinate many forms of state and decide what the current request actually needs. Some turns should remain ordinary conversation. Others require memory retrieval, research, file inspection, a project plan, a controlled tool, or a longer-running process.
ANNIE V4 separates the visible conversation from the machinery supporting it. The user should receive a direct answer instead of internal status text, raw tool output, or development labels. Background activity can still be recorded for inspection, but it should not take over an unrelated conversation. This sounds like a small distinction, yet it is central to making a complex assistant feel coherent.
The same principle applies to failure. If something breaks, the useful response is not a wall of internal records. ANNIE should explain what the failure means, how it affects the requested task, and what the next reasonable action is. Turning system state into human meaning is one of the core design goals of V4.
Memory Beyond Chat History
Long-term memory is one of the foundations of the project. ANNIE needs to remember personal preferences, decisions, ongoing goals, project context, corrections, failed approaches, and useful lessons without treating every old detail as equally important.
The system therefore treats memory as a selection problem. A current question should retrieve the right part of the past, not simply paste a large conversation archive into the model. Personal history, project knowledge, recent messages, visual material, and learned constraints have different roles. ANNIE must choose the relevant layer and keep unrelated memories from contaminating the answer.
Continuity also has to survive technical interruptions. A long task should not become fictional because a process restarted or a browser disconnected. V4 records completed work and durable task state outside the model's temporary context. The model receives a bounded working view, while the larger system preserves the committed history needed to continue honestly.
Research as a Continuing Process
ANNIE's research direction goes beyond returning search results. The larger goal is to preserve the path from a question to evidence, from evidence to a hypothesis, and from a hypothesis to an experiment that can be evaluated. A useful research system should remember what was already tried, where an idea came from, what contradicted it, and whether a result was actually measured.
V4 contains research pipelines for gathering sources, organizing papers and notes, proposing testable questions, and connecting research findings with practical experiments. It also maintains a research memory layer intended to preserve relationships among ideas, prior attempts, benchmarks, failures, and successful patterns.
This is important because generated novelty is easy to mistake for discovery. A language model can produce an interesting idea without proving that the idea is new, correct, or useful. ANNIE's research systems are moving toward a stricter standard where a promising output becomes a candidate for testing, not an automatic conclusion.
ANNIX and Durable Project Work
ANNIX is the project-work side of ANNIE V4. It is designed to let the assistant understand a selected project, keep project-specific memory, plan work, inspect relevant files, and continue through multiple stages without losing the original objective.
For software work, the intended flow includes understanding the repository, planning a narrow change, previewing the effect, validating it in isolation, preserving rollback information, and reporting the result with evidence. The same project framework is expanding toward research, documents, creative workflows, and administrative work where the output is more than a chat response.
Resumability matters here. Complex work rarely fits inside one perfect interaction. ANNIX is being built to preserve milestones, progress, open questions, validation results, and the next safe action so a project can continue after context pressure or interruption. The long-term goal is for ANNIE to follow the work itself, not merely remember that a conversation happened.
Tools Without Uncontrolled Autonomy
ANNIE can work with research tools, local files, code analysis, documents, images, project environments, and selected external systems. The important design question is not how many tools can be attached. It is whether the system knows when a tool is necessary, what authority it has, and how to prove the outcome.
Read-only inspection, planning, simulation, approval, execution, and verification are treated as different stages. A proposed action is not an executed action. A successful command is not proof that the user's objective was achieved. High-impact operations should remain behind explicit policy and approval boundaries, with isolated testing and rollback evidence where appropriate.
Controlled authority is an engineering requirement. The execution design centers on a defined scope, explicit permissions, and verification of the resulting state. Those controls support dependable project work as the system develops.
Voice as the Same Assistant
Speech is another major part of ANNIE V4. I want voice interaction to feel like access to the same memory and reasoning system, not a separate lightweight assistant with canned responses or a smaller version of the truth.
Spoken turns return to the same conversation path used by text. The final answer is checked and sanitized before speech generation, and interruption controls allow the user to stop playback naturally. Faster voice interactions can use a smaller working context, while deeper questions retain access to the fuller reasoning and memory path.
The direction is a responsive local voice loop that remains honest about what the system knows and what it has done. Speed matters, but it cannot come from inventing an answer before the real model has produced one.
Learning From Failure
One of the most ambitious parts of V4 is its improvement spine. The idea is to make failures useful. A wrong route, weak memory choice, incomplete answer, failed tool call, poor project result, or broken assumption should become structured evidence that the system can study later.
The intended sequence is deliberate. Observe the failure, understand it, preserve the lesson, turn it into an evaluation, propose a small repair, test that repair in isolation, review the evidence, and only then consider a controlled change. After any accepted change, the system should monitor whether the result actually improved the original behavior.
ANNIE's improvement work is designed around gates, comparisons, sandboxes, regression checks, approval, rollback planning, and measured impact. These research systems evaluate proposed changes against observable results, with acceptance tied to evidence rather than the proposing model's confidence.
What RSI Means in ANNIE V4
Recursive self-improvement, or RSI, is one of ANNIE V4's central research directions. I use that term carefully. It does not mean giving a model unrestricted permission to rewrite itself and trusting whatever comes next. In ANNIE, RSI means building a closed evidence loop where the system can identify a weakness, study it, propose a bounded improvement, test that proposal, and retain it only when the result is demonstrably better.
The RSI path has several distinct lanes. Reactive repair begins with a real failure and tries to prevent it from happening again. Proactive improvement looks for missing capabilities or weak areas before they become visible failures. Capability maturation takes an early idea through clearer requirements, evaluation, and repeated testing. Promotion controls whether a proven candidate is allowed to affect the working system. Impact learning then asks whether the accepted change actually helped during later use.
ANNIE's research systems support this direction by turning observations into hypotheses, hypotheses into experiments, and promising research into small prototypes that can be measured. Candidate approaches can be compared against a baseline instead of judged by how convincing their descriptions sound. Memory strategies, routing decisions, tool use, project workflows, and new capabilities can all become subjects of controlled improvement.
The recursive part comes from using the evidence produced by one cycle to improve the quality of the next cycle. Better failure detection should create better evaluations. Better evaluations should produce more focused repair candidates. Better experiments should make promotion decisions more reliable. Measured outcomes should help the system choose more useful future work. The goal is compounding improvement, not an endless stream of generated architecture.
Verification, feedback, efficiency, and real-world impact all matter. A candidate that passes a narrow test but makes the larger system slower, less reliable, harder to control, or worse for the user should not count as progress. ANNIE's RSI direction is built around retaining useful gains while rejecting changes that only appear impressive in isolation.
The honest current boundary is that ANNIE V4 has substantial RSI infrastructure and several parts of the improvement chain have been exercised, but it is not a proven self-improving general intelligence. Many advanced lanes remain guarded, sandboxed, shadow-tested, or dependent on stronger end-to-end evidence. The project direction is to prove that ANNIE can repeatedly produce small, useful, measurable improvements without bypassing human control or losing the behavior that already works.
Evidence and Reality Checks
Large AI systems can accumulate impressive architecture while still failing at ordinary tasks. ANNIE V4 includes several reality-checking layers because source code, configuration, and a passing isolated test do not automatically prove that a live user workflow works.
The project tracks whether an answer used the right memory, whether a requested handler actually ran, whether a claim has supporting evidence, whether a task survived interruption, and whether a proposed improvement produced a measurable result. Internal dashboards are intended to distinguish what is active, what is blocked, what needs approval, and what remains unverified.
The development process distinguishes active runtime paths, guarded tools, research experiments, and planned capabilities. Each has a defined place in the project, with verification guiding what advances into routine use.
Practical Use Cases
The first use case is long-term project collaboration. ANNIE can hold the context surrounding a codebase, research effort, product idea, or operating plan and help continue the work without rebuilding the entire history every time.
The second is private research. A local-first system can collect questions, sources, notes, hypotheses, and experimental results while preserving the reasoning history around them. That makes it useful for technical investigation, product research, AI experiments, and other work where the process matters as much as the final answer.
The third is controlled computer work. ANNIE is being developed to inspect projects, prepare changes, run bounded validations, create artifacts, and coordinate selected tools or environments while keeping consequential operations gated.
The fourth is everyday continuity. Preferences, prior decisions, open questions, and ongoing work give the assistant context beyond the latest message. Persistent memory makes that history available for later retrieval and project collaboration.
Operating Principles
ANNIE's operating principles keep generated responses grounded in the user's request and relevant memory. Background work belongs behind the conversation, and completed work requires evidence separate from a plan or a confident description.
Consequential actions require explicit authority and verification. That includes sending messages, publishing work, modifying important projects, activating new capabilities, and interacting with external systems.
These controls are part of the runtime's design. Capability development remains tied to the operator's ability to understand, inspect, and correct the work.
Engineering Priorities
ANNIE V4 spans several connected systems, making consolidation and end-to-end reliability central engineering priorities. Development focuses on clear ownership, reusable paths, and measurements of the complete user workflow.
Repeated live testing guides that work. Advanced research and improvement systems progress through read-only evaluation, shadow testing, and isolated execution, with activation tied to demonstrated value and safety. Some paths remain disabled while that evaluation continues.
Local operation makes compute, model selection, latency, storage, and maintenance part of the engineering work. The architecture assigns roles according to the capabilities and resources available on the host machine.
The Project Direction
The immediate direction is reliability. ANNIE should answer the current user clearly, retrieve the right memory, preserve completed work, and tell the truth about what happened. Those basic contracts matter more than adding another impressive label.
The next direction is deeper project execution. ANNIX is intended to carry a task from initial understanding through planning, work, validation, repair, and final delivery while preserving enough state to resume safely. Over time, that framework can support software, research, media, documents, operations, and other structured work.
Research is another major lane. I want ANNIE to move from finding information toward building testable hypotheses, running bounded experiments, remembering failed approaches, and translating useful research into measured prototypes. The system should become better at forming the right problem, not only answering the question it was given.
The longer-term improvement direction is evidence-backed RSI. ANNIE should be able to notice recurring weaknesses, create evaluations, compare candidate solutions, and retain changes only when they produce verified positive impact. That is a much harder goal than generating code, but it is the path toward a system that can improve without losing accountability.
Ultimately, I see ANNIE as a private AI infrastructure layer that can support a person's work for a long period of time. It should connect conversation, memory, research, projects, tools, voice, and learning while keeping the human operator in control of consequential decisions.
The Long View
ANNIE V4 is an ongoing engineering and research program. Models and tools evolve, while the runtime's foundations remain persistent memory, controlled execution, evidence, and operator control. Development strengthens those foundations and extends the workflows built on them.
My goal is to build an assistant that becomes more useful because it understands the history of the work, not because it pretends to know everything. It should be able to think with me, research with me, help operate projects, and improve from real outcomes while remaining honest about its limits.
ANNIE V4 brings that work into one local-first runtime. It connects conversation, memory, research, projects, and controlled tools, with continued development focused on reliable execution and measurable improvement.