Google and Apple have been putting more serious machine learning accelerators in their devices for a bit now. It enables some nice features, like on-device speech-to-text and improved photo processing.
At least when the generative AI hype dies down there will still be legitimate uses for the hardware.
Yeah, it’s so inconvenient that people in online comment sections can install an operating system on my computer and force me to use it!