Layers and pipeline from signal inputs to short prompts that plug into the Codmir fabric.

Architecture

The Codec SDK evolves as a layered pipeline designed to be swappable as research matures.

Layers

1. N0 Signal IO
   • Current: text/voice/gesture
   • Future: EEG/ECoG/MEG (research)
2. N1 Feature Bank
   • Extract time-frequency and envelope features; normalize inputs
3. N2 Phoneme Head
   • Map features → phoneme/posterior probabilities
4. N3 Language Head
   • Phonemes → tokens (subword units) with LM prior
5. N4 Semantic Head
   • Tokens → intents, constraints, structured short prompt
6. SPG (Short Prompt Generator)
   • Compact, role-aware prompt delivered to fabric

Pipeline Diagram

flowchart TD
    N0[N0 Signal IO] --> N1[N1 Feature Bank]
    N1 --> N2[N2 Phoneme Head]
    N2 --> N3[N3 Language Head]
    N3 --> N4[N4 Semantic Head]
    N4 --> SPG[Short Prompt Generator]
    SPG --> Fabric[AGI Fabric (Codmir, Roles, Proctor)]

Execution Modes

• Simulation: text/ASR input → SPG
• Research: plug-in neural feature extractors
• Production (future): BMI device integration