Blinky System Architecture & Execution Map

Blinky System Architecture & Execution Map An architecture diagram generated by Archify. Antigravity IDE · Agent Lifecycle Hooks · Architecture component · IDE Integration Antigravity IDE Agent Lifecycle Hooks IDE Integration External Peripherals · ESP32 & WhatsApp Bot · Architecture component External Peripherals ESP32 & WhatsApp Bot Mobile Companion · Expo React Native 57 · Architecture component · TLS Pinning + KeyStore Mobile Companion Expo React Native 57 TLS Pinning + KeyStore Antigravity Bridge · Webhook Listener (:9003) · Desktop Host (Tauri 2 + Python + Native Rust) › Local Gateway & Bridges (:9001 / :9002 / :9003) · Mobile HITL Gate Antigravity Bridge Webhook Listener (:9003) Mobile HITL Gate WebSocket Gateway · Rustls WSS :9001 · Desktop Host (Tauri 2 + Python + Native Rust) › Local Gateway & Bridges (:9001 / :9002 / :9003) · SHA-256 Pinning WebSocket Gateway Rustls WSS :9001 SHA-256 Pinning File Server · 16MB Chunked HTTPS :9002 · Desktop Host (Tauri 2 + Python + Native Rust) › Local Gateway & Bridges (:9001 / :9002 / :9003) File Server 16MB Chunked HTTPS :9002 AiCut Video & MCP · C++17 Engine + FFmpeg · Desktop Host (Tauri 2 + Python + Native Rust) › Local Gateway & Bridges (:9001 / :9002 / :9003) · faster-whisper Aligner AiCut Video & MCP C++17 Engine + FFmpeg faster-whisper Aligner Tauri 2 Rust Core · IPC Router & Window Control · Desktop Host (Tauri 2 + Python + Native Rust) Tauri 2 Rust Core IPC Router & Window Control Pure Rust Agent · crates/blinky-agent Loop · Desktop Host (Tauri 2 + Python + Native Rust) · Multi-Provider LLM Pure Rust Agent crates/blinky-agent Loop Multi-Provider LLM Pure Rust Daemon · crates/blinky-daemon · Desktop Host (Tauri 2 + Python + Native Rust) · Wayland & /dev/uinput Pure Rust Daemon crates/blinky-daemon Wayland & /dev/uinput Desktop Overlay · React 19 / Transparent HUD · Desktop Host (Tauri 2 + Python + Native Rust) · WDA_EXCLUDE Desktop Overlay React 19 / Transparent HUD WDA_EXCLUDE System 1 Neural Router · decision_engine/ (ONNX) · Desktop Host (Tauri 2 + Python + Native Rust) · <1ms Non-Autoregressive System 1 Neural Router decision_engine/ (ONNX) <1ms Non-Autoregressive Python Backend · Preflight Router & Daemon · Desktop Host (Tauri 2 + Python + Native Rust) Python Backend Preflight Router & Daemon Screen Capture · dxcam / PipeWire / Portal · Desktop Host (Tauri 2 + Python + Native Rust) Screen Capture dxcam / PipeWire / Portal Notebook Hub & OKF · Full-Context Knowledge · Desktop Host (Tauri 2 + Python + Native Rust) · ▶ Execute on PC Notebook Hub & OKF Full-Context Knowledge ▶ Execute on PC Actuation & Autopilot · SendInput / ydotool Loop · Desktop Host (Tauri 2 + Python + Native Rust) · @ref Spatial Index Actuation & Autopilot SendInput / ydotool Loop @ref Spatial Index Vision Grounding · WinRT OCR + OmniParser YOLO · Desktop Host (Tauri 2 + Python + Native Rust) Vision Grounding WinRT OCR + OmniParser YOLO Sarvam Voice & Audio · saaras:v3 STT / bulbul:v3 TTS · Architecture component · Word Highlight Sync Sarvam Voice & Audio saaras:v3 STT / bulbul:v3 TTS Word Highlight Sync Web-In-The-Loop · Playwright + Local SearXNG · Architecture component Web-In-The-Loop Playwright + Local SearXNG IDE Hooks Stream Status WSS :9001 HTTPS :9002 Wi-Fi & Sockets Media Sync Validated WS Tauri IPC Native Agent UNIX Socket System 1 Reflex <1ms Classifier Atomic Action Trigger Capture Raw Pixels @ref Spatial Index Notebook Hub ▶ Execute on PC Audio & Word Sync Web Search Intent Desktop Host (Tauri 2 + Python + Native Rust) Local Gateway & Bridges (:9001 / :9002 / :9003) Legend Frontend Backend Cloud Security External