building · 2026
Art & Audio
A browser audio-to-art workbench: analyse a local recording, watch a deterministic artwork evolve with playback, seek through its history, and export a PNG. Live sound and collection portraits have their own flows.
existing local implementation; ongoing visual refinement, public demo availability not verified here
What it does
A Next.js / React / TypeScript app decodes local audio with Web Audio and analyses it in a worker, with Essentia.js and fft.js. A custom physical-art engine renders through WebGL2 with a Canvas fallback. The creator supports local-file playback, live microphone input and PNG export; the collection flow makes a portrait from multiple local recordings. Source audio stays on the device. Optional hosted art-only sharing requires separate storage configuration.
Why I built it
The project maps measured sound into a persistent visual composition rather than generating a disconnected image for each frame.
Technical problem
Keeping an evolving artwork coherent while playback, seeking and export reconstruct the same history. Musical estimates guide the composition; they are not semantic instrument recognition or source separation.
My contribution
Project builder — browser audio analysis, playback and visual composition.
Evidence and limitations
Inspected 20 October 2026: creator and collection routes, BrowserAnalyzer, PhysicalArtist, package manifest and existing playback/export verification captures. These are captures of the real application, not Calia-generated art. Historical verification was read, not rerun by the portfolio. Files are limited to seven minutes and codec support depends on the browser/OS. No public repository or deployment link is asserted.
Technologies
Next.js, React, TypeScript, Web Audio API, WebGL2, Essentia.js, fft.js
