Creative technology / 2026

ExoAVT

Name: ExoAVT
Author: Filippo Galbo

Android video instrument with audio-reactive effects, editable timing, producer tags, and MP4 export.

The problem

Turning a phone recording into a directed visual piece requires choosing effects, shaping their response to sound, controlling when changes happen, and exporting the same result.

My role

Android interface, media-processing engine, and export workflow engineering.

What I built

Private Android beta with a versioned APK and SHA-256 download
Source-aware spatial and liquid organisms alongside the existing visual library
Sound-reactive preview and H.264/AAC MP4 export
Saved effect clips, manual automation points, Favorites, and producer signatures

The result

An Android audiovisual instrument for letting sound and algorithms propose movement, then using selection, intensity, and clip timing to direct the finished video.

ExoAVT Android machine interface with media preview, effect controls, and export control

Statusactive

Evidencereleased

Record reviewed2026-10-22

ReleaseVersion 0.3.0-beta.43 / build 45

Implementation

How it works

Import one video or photo, keep embedded audio or attach a separate recording, then choose a look or combine up to seven effects. The shared library contains 45 processors and 53 looks, including REALITY TEAR's jolting monochrome space and CHROMA CULTURE's mirrored liquid membranes. REALITY TEAR now moves from brief readable poses into sheet stretching, abrupt rolls, recoil, and settling; this remains a 2D treatment of the source. Use Effect Strength for treatment intensity and Audio Motion for sound-driven movement; input calibration stays separate. Split video into effect clips and add Min, Max, or custom points with Hold, Linear, or Smooth transitions. Manual, Audio, and Clip control ownership stays explicit. Save projects or reusable Favorites, add a text or image producer signature with its own audio, compare source and processed views, and export H.264/AAC MP4.

Technical context and methods

A Kotlin and Jetpack Compose instrument uses Media3 decoding, GPU processing, and export. Timestamped local analysis and one parameter evaluator serve preview and export. The beta is distributed through a private access gate as a versioned APK with a SHA-256 checksum. Beta43 verification included 722 JVM tests, 42 screenshot comparisons, desktop GLSL renders at three aspect ratios, and 21 Android 8/API37 emulator checks covering source processing, audio response, seeking, and MP4 export. A static-source probe distinguishes brief spatial jolts from readable holds and checks that flat imagery does not flash. Physical-phone appearance, HDR quality, sustained frame rate, and thermal performance remain separate validation work.

Evidence details

Shared visual descriptors supply Library choices, manual controls, audio routing, clip points, and saved parameter identifiers.
REALITY TEAR uses source-aware spatial deformation and monitor processing. Its revised motion follows observed short holds and rapid slips in a supplied reference, without reconstructing hidden surfaces or new viewpoints.
CHROMA CULTURE uses a deterministic spatial liquid field, false-color boundaries, and manual reflection states. It does not retain previous frames.
Sound responses use local amplitude, band, and onset analysis where applicable. The two organisms use RMS and peak amplitude envelopes; music, speech, impacts, ambience, and silent media do not require a shared tempo.

Kotlin
Jetpack Compose
Media3
Android GPU effects
Audio analysis
Screenshot testing

Limitations

REALITY TEAR's revised motion is informed by the newly supplied RDT_20261019_205216-2.mp4 reference. The CHROMA CULTURE reference 18925.mp4 remains unavailable. The comparison covers motion behavior; an exact visual match is not verified. REALITY TEAR is a 2D source deformation and cannot recover hidden geometry or true changing viewpoints. CHROMA CULTURE uses an animated spatial field, not real temporal feedback. The beta42 effect IDs remain and may not render in older builds; keep an original project copy.
The retained beta41 repair fixes a reproducible native particle-renderer crash during an Audio Motion drag, but the original phone report has no matching device log and is not claimed independently verified. Feral Lava's dark generated background is a separate source-mode behavior, addressed for new choices by the Footage default. Saved Generated projects are not silently migrated: choose Footage in Controls if you want the imported picture. If a crash recurs, report the device model, Android version, selected effects, and exact steps.
Beta40 adds new effect IDs and discrete print events that older builds may not understand. Keep an original project copy. Particle preparation and checkpoints share an 8 MiB CPU budget; discretionary render resources share a 64 MiB GPU budget. These are not total app-memory limits. Seeking may require cancellable preparation. Reduced-resolution fields and snapshots trade fine detail for bounded work. Emulator renders and exports do not establish physical-phone frame rate, thermal stability, HDR quality, or cross-GPU appearance.
New beta39 processors may not render in earlier builds; keep an original project copy. Motion Transport and Time Displacement use at most 32 reduced-resolution history samples at 30 Hz within a 640 × 360 box, with a shared 64 MiB resource budget. This can soften delayed detail. Stacked history increases seek preparation; upstream recursive Temporal Melt can require replay from the clip start. Accurate seeking may scan source timestamps, so longer files can take longer to prepare; Cancel remains available. Multiple-video-track files are not supported for accurate temporal preview. Raster Relief requires working vertex-texture sampling. Known Particle Reassembly and Raster Relief output formats up to 720P at nominal 30 fps request a higher 20 Mbps encoding rate to preserve moving detail, which can increase file size; higher or unknown formats retain the normal encoder policy. Encoder fallback and physical-phone quality still need testing. The existing paused-preview sizing issue remains. Beta41 addresses the reproduced redundant-composition replacement timeout; other player-release failures on physical devices remain unverified. No measured phone frame rate or thermal guarantee is claimed.

Open ExoAVT Download beta APK Verify SHA-256