How I built a screen-aware AI assistant in Python – full stack breakdown (PyQt6 + Whisper + Ollama)

Three months ago I started building Clicky — a Windows AI assistant that reads your screen and answers out loud. Here's the full technical breakdown of every piece. TL;DR: PyQt6 system tray → Ctrl+Alt+Space hotkey → screenshot + Whisper STT → Ollama/OpenAI/Claude → edge-tts speaks answer back. Open source, free, no API key needed. Architecture overview User presses Ctrl+Alt+Space ↓ GlobalHotkey listener (pynput) ↓ Screenshot all monitors (mss) ↓ Whisper.cp...

Original Source

Read the full article at Dev →

KhanList aggregates and links to publicly available news content. We do not host full articles from third-party sources. Always verify important information with original sources.