The only real advantage of local AI is privacy and that it’s much cheaper if you use it a lot.
The only consumer use case I see in the wild with some real momentum behind it is role play.
All the local AI communities I browse are 50% people trying to find usecases for it at their job (like me; unsuccessfully I might add) and 50% people interested in role play.
People will apparently spend thousands to jerk off to a soulless machine demon simulacrum shell of a human.
To be fair, I can see the appeal of local AI for video games, like RPGs. There is this really fun game called “Suck Up”, where you are a vampire trying to convince AI to let you inside their house. That is the one real “killer” application I see atm.
I personally see a lot of other useful usecases for local AI, but from my experience at work, I would estimste it will take another 5 years until any of it is anywhere near consumer ready.
I don’t understand how mobile apps are still so limited compared to their desktop counter parts. Like I couldn’t even find a single browser that has any of the dev tools in any normal desktop browser. Especially infuriating since websites can just willynilly disable features like downloading images.
Fixing anything in industry is like fighting a very big, very lazy elephant seal bull