Meta’s Ray-Ban branded smart glasses are getting AI-powered reminders and translation features

Meta’s AI assistant has at all times been probably the most intriguing function of its second-generation Ray-Ban smart glasses. Whereas the generative AI assistant had pretty restricted capabilities when the glasses launched last fall, the addition of real-time info and multimodal capabilities provided a variety of latest prospects for the accent.

Now, Meta is considerably upgrading the Ray-Ban Meta good glasses’ AI powers. The corporate confirmed off plenty of new skills for the year-old frames onstage at its Join occasion, together with reminders and reside translations.

With reminders, you’ll be capable of take a look at gadgets in your environment and ask Meta to ship a reminder about it. For instance, “hey Meta, remind me to purchase that e-book subsequent Monday.” The glasses can even be capable of scan QR codes and name a cellphone quantity written in entrance of you.

As well as, Meta is including video help to Meta AI in order that the glasses might be higher capable of scan your environment and reply to queries about what’s round you. There are different extra delicate enhancements. Beforehand, you needed to begin a command with “Hey Meta, look and inform me” with a view to get the glasses to reply to a command based mostly on what you have been . With the replace although, Meta AI will be capable of reply to queries about what’s in entrance of you with extra pure requests. In a demo with Meta, I used to be capable of ask a number of questions and follow-ups with questions like “hey Meta, what am I ” or “hey Meta, inform me about what I’m .”

Once I tried out Meta AI’s multimodal capabilities on the glasses last year, I discovered that Meta AI was capable of translate some snippets of textual content however struggled with something various phrases. Now, Meta AI ought to be capable of translate longer chunks of textual content. And later this yr the corporate is including reside translation skills for English, French, Italian and Spanish, which may make the glasses much more helpful as a journey accent.

And whereas I nonetheless haven’t absolutely examined Meta AI’s new capabilities on its good glasses simply but, it already appears to have a greater grasp of real-time info than what I discovered final yr. Throughout a demo with Meta, I requested Meta AI to inform me who’s the Speaker of the Home of Representatives — a query it repeatedly got wrong final yr — and it answered appropriately the primary time.