automation-companion

Automation Companion is an Android application designed to empower users to create sophisticated automations on their devices without requiring root access. Adopting an offline-first architecture, the core functionality operates entirely on-device, ensuring privacy and speed, while offering optional cloud API integrations for enhanced intelligence. The app supports a wide range of automation methods. Users can record and replay gestures such as taps, swipes, and text inputs using Android's Accessibility Services. For more complex tasks, it provides a visual, node-based workflow editor that allows for drag-and-drop connections, conditional branching, and multi-node execution. Additionally, the app leverages on-device machine learning (TensorFlow Lite and ML Kit) for screen understanding, enabling features like OCR text detection, UI element recognition, and image template matching. These capabilities support visual triggers that can execute actions when specific patterns appear on the screen. Beyond manual creation, Automation Companion includes robust system context triggers. Automations can be activated based on location (geofencing), battery levels, time of day, Wi-Fi connectivity, or when specific apps are opened. The app also features an "Omni-Chatbot" and semantic automation capabilities, allowing users to define tasks using natural language, which can be processed by local LLMs or connected cloud APIs like OpenAI, Gemini, or Groq. Technically, the project is built with Kotlin and Jetpack Compose, following a modular MVVM architecture. It includes tools for debugging automations in real-time and supports cross-device automation via local Wi-Fi synchronization between phones, tablets, and PCs. The application is licensed under the PolyForm Noncommercial License 1.0.0.