Apple’s Smart Glasses Coming in 2027, May Run on FastVLM?
0Apple is working on a bunch of new devices to complement its phones and watches, including a pair of smart glasses that should debut in 2027. They are very likely to run one of these AI models Apple is working on. Take FastVLM for instance: it is an efficient vision encoding approach for vision language models. FastVLM is 3.2 times faster and 3.4 times smaller than similar models. You can find it on GitHub at this point.
With this approach, it is possible to output fewer tokens and significantly reduce encoding time for high-resolution images. A sample app is available that shows how this model can answer visual questions on mobile devices. FastVLM runs on iOS (18.2+) and macOS (15.2+). The app has a set of prompts that you can use to get started faster.
[Paper]