Google Assistant is dead, and I won't miss it thanks to my local LLM

Published Aug 19, 2026, 5:30 PM EDT Nolen began their writing career in 2019, with three years dedicated to editing the Creative section at MakeUseOf. Their expertise lies at the crossroads of technology and creativity, covering areas like photography, video editing, and graphic design. Outside of work, you'll often find Nolen diving into a good book, writing their own stories, or playing video games. Voice assistants have been part of the phone experience for so long that most of us don't really give them second thought anymore. Google is now pulling the plug on the biggest one though. Google Assistant is going away on September 4, 2026, and there's no toggle back to it once your phone flips over. Gemini is set to take over its place. They're both AI, sure, but they're architecturally completely different, since one is fundamentally a chatbot rather than a command-matching assistant. It's probably safe to say that it might take a while for people to adapt their muscle memory. And having a chatbot as the default phone assistant is not something all that many people are asking for, especially when a local LLM can already handle a decent slice of what an assistant is meant to do. Want to stay in the loop with the latest in AI? The XDA AI Insider newsletter drops weekly with deep dives, tool recommendations, and hands-on coverage you won't find anywhere else on the site. Subscribe by modifying your newsletter preferences! Google Assistant is being retired after a decade The transition will be one-way and will roll out over a few weeks Google Assistant is one of those tools that just worked and got the job done. It handled the boring stuff really well, mostly voice commands like setting timers, checking the weather, playing music, and turning off a smart lamp. That predictability is what made it feel like part of the phone. Google confirmed the shutdown in emails to users, with the rollout starting in September 2026 and continuing over several weeks. Once your phone flips there's no going back or reinstalling from anywhere, and the switch cascades to any paired Wear OS watch, compatible earbuds, and Android Auto projected from your phone. Cars with Google aren't part of the September cutoff, but that's a technicality since Gemini is already rolling out to those systems on its own separate timeline. Google's framing is that voice assistants are due for a full rebuild now that generative AI can handle more than the fixed voice commands Google Assistant was built around a decade ago. The company says it's "reimagined the experience with AI at its core" so Gemini can hold multi-step interactions and reach across apps in ways the old assistant couldn't. My guess is that it also makes sense from a cost efficiency perspective by cutting down human coding requirements, and also staying relevant in the AI race. A few features aren't making the trip, including Interpreter Mode for real-time translation, Family Bell announcements, birthday reminders, and daily scheduled briefings. But what if you don't want to rely on Gemini? Running a local LLM on mobile is actually a viable option now The good news is that a local LLM on your phone is actually a viable option now. It used to be more of a party trick or a novelty you'd test once then never open again because it was too slow. That completely changed these past couple of years. The runtimes matured, and model makers started prioritizing phones rather than treating them as an afterthought. I've been running PocketPal for months now. My working set is Gemma 4 E2B and E4B, plus Qwen 3.5 2. Gemma is what I reach for when I'm restructuring an idea or looking something up because its tone is conversational and friendlier, and Qwen tends to be what I reach for for more serious work or studying tasks because it has superior reasoning. None of these will completely replace frontier chatbots, not for demanding tasks at least, and not right now. But they cover a solid chunk of what I actually use a phone assistant for. Google AI Edge Gallery is doing what Assistant used to The runner that made me stop caring about Gemini My point in the previous section is that local is a legit option, but the app you choose makes all the difference. I've cycled through about four right now, and finally found one that can actually replace a hoard of Google Assistant's functions. It's called Google AI Edge Gallery, and it's Google's official app for running Gemma models locally on Android, as well as iOS. Everything stays private and on-device, and the app is open-source. The model lineup includes Gemma 4 E2B and E4B, plus some Gemma 3n variants that handle text, vision, and audio. I've mostly been running Gemma 4 E2B since it's the lightest option that still handles the agent stuff properly. The killer feature you're going to want to use here is Agent Skills. Google DeepMind launched it alongside Gemma 4 as one of the first multi-step agentic workflows that runs entirely on-device. Basically it's a plugin system that lets the model actually do things on the phone rather than just talk about them. Schedule Notification handles the reminders bucket really well, since I can type something like "remind me every morning at 9 to check my schedule" in plain English and the model parses it into structured parameters and hands it off to the phone's notification system. Interactive Map covers the "show me X" use case, pulling up a location in an embedded Google Map with an "Open in Maps" handoff. There's also Ask Image for identifying something in a photo, which is probably one of my most-used features. Moreover, it has Audio Scribe, which is going to be your voice command replacement - you record a voice note, send it, and the model acts accordingly. Edge Gallery won't do hands-free wake-word voice activation, smart home, phone calls, or live info like weather and traffic, so the OS still has to handle that. But I think this is probably the most comprehensive local LLM app I've used on mobile; I actually like it more than the desktop varieties like Jan and LM Studio. No Gemini? No problem The Google Assistant shutdown is going to catch a lot of people off guard, not because they'll miss the specific product but because the replacement isn't really the same thing. Gemini is a chatbot, and if my phone assistant is going to be an LLM either way, I think I'd rather run one that lives on my device and doesn't need a signal bar. Edge Gallery and PocketPal cover the parts of a phone assistant that actually needed intelligence in the first place. Google AI Edge Gallery