Fast Native LLM Inference in Coni: The Poem Generator

In our ongoing quest to make Coni the most capable, dependency-free, and relentlessly fun functional language out there, we’ve hit a massive milestone. We didn’t just write an AI script—we went fully native.

Today, we’re unveiling our first fully native AI example: The Poem Generator.

Using the highly capable Qwen 2.5 0.5b instruct model formatted as a raw GGUF binary, this new Coni script takes a theme, invokes a local LLM, computes a beautiful poem, and spits out characters at a shockingly fast rate of over 70 tokens per second (TPS).

Autonomous CVE Patching with Coni Agent Studio

Building a multi-agent orchestration system from scratch often means dealing with endless layers of complexity: orchestrating interpreters, managing external tool executions, and wrangling the rigid schema constraints of external LLM APIs.

But Coni is the answer to complexity.

With Coni Agent Studio, we’ve built a streamlined, native orchestration layer where agents don’t just chat—they act, execute, and solve real-world engineering problems autonomously.

To demonstrate the power of this system, we built an end-to-end swarm dedicated to one of the most tedious tasks in software engineering: Javascript Dependency Security and CVE Patching.

Procedural Audio & WebGL WebAssembly Experiences in Coni

In the last 24 hours alone, we’ve pushed the boundaries of the Coni WebAssembly ecosystem to produce an entire suite of procedural audiovisual web experiences. By combining the Coni macro system with raw WebGL and the WebAudio API, we successfully scaffolded, compiled, and deployed complex graphical and musical systems natively in the browser—with absolutely zero external asset dependencies.

Let’s take a look at the five new applications we’ve built. You can experience them all natively in your browser on the Coni WASM Gallery.

Guided Breathing with WebGL: A 6-2-6 Interactive Experience

Mental health and focus are paramount in today’s fast-paced digital world. Following the success of our brainwave entrainment applications, we decided to tackle another facet of well-being: conscious breathing.

We are excited to unveil our latest Coni WASM application: the WebGL Breathing App, a visual and auditory experience built from scratch to guide you through a calming 6-2-6 breathing exercise (6 seconds inhale, 2 seconds hold, 6 seconds exhale).

Creating a Living UI

Unlike traditional breathing timers that simply show a growing circle, we wanted to build something that feels alive. We designed an interactive menu where you can set your Mood—choosing from Calm (Cyan), Warm (Orange), or Focus (Purple).

Building a Minimal CMS with the Conimo Framework

Conimo is the official full-stack web framework for Coni. It brings together the blazing-fast WASM frontend capabilities and the robust backend server environment into a cohesive, streamlined developer experience.

Recently, we’ve vastly improved the developer experience by embedding the core Conimo CLI scripts directly into the bin directory of the conimo library. This means you don’t need external setup scripts—everything is powered by native Coni code.

In this guide, we’ll walk through scaffolding a new application, running the local development server, and quickly building a minimal Content Management System (CMS) utilizing the powerful patom database.

Hardcore Chaos Testing for Coni's Native Float32 Arrays

When you’re building high-performance applications in the browser, JavaScript’s generic Number type often isn’t enough. You need raw, contiguous memory arrays. In Coni WASM, we rely heavily on native WebAssembly float32 arrays for our most mathematically intensive applications.

Where is Float32 actually used in Coni?

Native float32 arrays (make-float32-array, f32-set!, f32-get) are the absolute backbone of Coni’s performance layer. You’ll find them powering:

  1. WebGL Geometry: In our deep-focus-webgl app, we use float32 arrays to mathematically sculpt an 80,000-vertex brain matrix (240,000 floats!) natively, before shipping it to the GPU in a single shot via js/float32-buffer.
  2. Game Engine Particle Systems: For games like flappy-bird or neon-boids, parallel float32 arrays keep track of thousands of X/Y coordinates, velocities, and lifetimes without garbage collection pauses.
  3. Raw DSP Audio: Our sound-nodes synthesizer calculates complex impulse responses and noise waveforms natively using float32 arrays before mapping them into WebAudio channels.

The Bug: Type Coercion and f64.reinterpret_i64

Because of how critical these arrays are, any bug in them is catastrophic. Recently, we discovered an issue where passing an exact integer (like 150) into f32-set! would mysteriously yield 0.0.