Lily

Unified Omni-Assistant. Tracks cross-platform screentime. Enforces focus goals. Provides voice-driven Wayland teleprompter UI.

Overview

AI companion serves two functions. Proactive productivity enforcer. Reactive voice-driven assistant. System tracks cross-platform usage. Manages gamified focus stakes. Delivers clean floating teleprompter UI on Linux Wayland for voice dictation, prompt enhancement, system commands.

Features

Reactive Voice Mode

Global shortcut summons top-center floating teleprompter UI. User speaks (Telugu/English). System uses vision for screen context. Enhances prompt or asks questions. Auto-pastes result or executes command. Powered by Groq Whisper and LLM.

Proactive Focus Mode

Runs background usage tracker. Detects distraction (e.g. YouTube during work hours). Triggers aggressive teleprompter UI popup. Plays verbal audio warnings.

Weekly Review Engine

AI initiates text chat weekly. Reviews usage stats. Adjusts app limits. Manages gamification stakes (points/money).

Cross-Platform Tracking

• Desktop Client: Native Linux Wayland UI.
• Mobile Client: React Native app tracks mobile screentime. Syncs to central database. Serves as on-the-go voice assistant.
• Web Extension: Browser-level tracking.

Architecture

System relies on centralized syncing and localized tracking.

1. Desktop Client: Tauri / Electron (Wayland). Global shortcut daemon, floating UI, audio/screen capture, app/URL screentime data generation.
2. Mobile Client: React Native. Mobile tracker daemon, mobile voice UI.
3. Backend: Supabase. Handles Auth, Database, Sync across clients. Houses AI Weekly Review Engine.
4. AI API: Groq. Fast Whisper transcription, Vision LLM processing.

Tech Stack

• Desktop: Tauri (React/Vite). Native Wayland support.
• Mobile: React Native / Expo.
• Web Extension: Vite, TypeScript.
• Backend: Supabase.
• AI: Groq API (Whisper + Llama-3/GPT-4o).