AR Week in Review (November 19, 2024): Meta Unveils Project Aria Research Kits, Surge of Chinese Smartglasses, and More!

Greetings from Finland! I’m jotting down this newsletter as I travel across Finland, from Helsinki to the Lapland. It’s been a fantastic visit so far (as it always is here): I’ve had the chance to meet Santa Claus, pet some reindeers, and try out some delightful local dishes. I’m also looking forward to attending MatchXR, one of the most significant XR events in Nordic Europe! I’ll be sure to share my experiences there soon.

But before diving into this week’s news, I want to dedicate this newsletter to Daniel Dyboski-Bryant, who has sadly passed away. I had the good fortune of meeting him several times, both in person at events like AWE US and in virtual spaces like ENGAGE. Daniel was genuinely a kind-hearted person and inspired many of us with his commitment to using VR for education and the betterment of humanity. His presence will be missed, but his legacy will continue to influence all of us who knew him. Farewell, Daniel.

Top News of the Week

(Image by Meta)

Meta Opens Applications for Project Aria Research Kits

A couple of years back, Meta introduced Project Aria, a collection of glasses designed as a precursor to its future augmented reality wearables. While Project Aria lacks a display, it includes numerous sensors such as cameras and microphones. Initially, it was reserved for Meta employees and close associates to help learn user behaviors by tracking and collecting data, similar to what AR glasses would capture. This initiative allowed Meta to gather extensive data to train its AI and machine learning systems in preparation for upcoming AR glasses.

This week brings a change, with Meta announcing the Project Aria Research Kit. Research institutions, whether universities or businesses, can now apply via a designated webpage to receive a Project Aria development kit from Meta. Meta will review these proposals and reward chosen centers not only with the glasses but also the complete development environment including the companion app, SDK, and cloud-based features. These features extend beyond data storage, offering services like reconstructing environments via point clouds captured by the glasses or blurring faces and license plates in videos.

This presents a fascinating opportunity for pioneering research towards the future of augmented reality glasses. To pique the interest of potential research partners, Meta has shared existing case studies from well-known universities like the University of Bristol, University of Iowa, and Carnegie Mellon University, covering topics from accessibility to driver training and skill development. If you’re connected with a research institution, it’s worth considering this opportunity.

Other Relevant News

(Image from Reddit user AR_MR_XR)

A New Wave of Smartglasses is Coming from China (and Beyond)

This week has been bustling with activity in the smartglasses arena, thanks to the popularity of the Ray-Ban Meta, which has triggered a bit of a gold rush. In just this week, three Chinese companies have unveiled their AI-powered smartglasses.

According to a report from Chinese magazine 36kr, Xiaomi might be developing a model to rival the Ray-Ban Meta smartglasses. Xiaomi, with a history of showcasing different prototypes, plans to build these glasses in collaboration with Goertek, a major XR manufacturer responsible for producing Quest headsets in China. These are anticipated for release in Q2 of 2025, possibly debuting at the Mi Fan Festival in April.

Meanwhile, Baidu, the Chinese tech giant, has launched its Xiaodu AI Glasses. Weighing just 45 grams, they come equipped with a 16MP ultra-wide-angle camera with AI stabilization, an efficient four-microphone array, and open-ear speakers designed to minimize sound leakage. The battery is reported to last up to 56 hours on standby and more than 5 hours during continuous audio playback. Offering six main features, including real-time Q&A, calorie counting, object recognition, audio-visual translation, and smart reminders, these glasses are expected to release in the first half of 2025, retailing under 2,100 yuan (around $290).

Additionally, Rokid, another major Chinese AR manufacturer, announced the Rokid Glasses. Powered by a Snapdragon AR1 chipset, these lightweight 49-gram glasses feature monochrome displays for displaying 2D information and include a camera for photos, video capture, and visual searches. These glasses can facilitate payments via QR codes and leverage Alipay AI as a digital assistant, illustrating a partnership with BOLON, a Chinese fashion brand under the EssilorLuxottica group umbrella. Interestingly, this collaboration suggests Luxottica is exploring partnerships with XR vendors in China, a market where Meta is absent.

In parallel, Reuters has reported Amazon’s development of internal smartglasses dubbed "Amelia." Based on the Echo Frames platform, these glasses feature built-in displays designed not for consumers but for Amazon’s delivery drivers, helping them navigate package deliveries with on-screen instructions. Reportedly, Amazon plans to incorporate these screens into future Echo Frames glasses, potentially by Q2 2026.

It’s thrilling to witness so many developments in the smartglasses sector.
(Thanks DannieVR for the tip about the Rokid glasses!)

Meta For Education Launched in Beta

A few months back, Meta teased a Quest headset educational program for universities, which they finally launched last week under the name Meta For Education in Beta.

At the time of the announcement, Meta emphasized providing educators, trainers, and administrators access to education-specific apps and resources, streamlining the management of multiple Quest devices without needing individual updates and preparations for each unit in a classroom setting. They continue to share this plan with some added marketing jargon. It appears this initiative focuses on assembling an educational content store alongside a specialized device management system to give teachers direct control over student headsets.

A handful of notable universities are already implementing this program, including Arizona State University, Houston Community College, Imperial College London, Miami Dade College, Morehouse College, University of Miami, and University of Michigan. Meta is collecting feedback from these pilot universities to refine the program, ensuring it tailors to the specific needs of university educators. Co-developing this product with educational institutions, Meta aims to launch a highly functional program for universities by winter.

Additionally, Meta has collaborated with VictoryXR to pioneer some of the first digital twin "metaversities" in Europe, enabling educators and students at the University of Leeds (UK), University of the Basque Country (Spain), and University of Hannover (Germany) to immerse themselves in virtual campuses that mirror their physical counterparts.

It seems Meta is placing significant bets on the educational sector. I believe it’s a smart move for two reasons: firstly, education represents a substantial market opportunity for Meta. Secondly, introducing students to VR headsets in academic environments familiarizes them with XR’s potential, possibly sparking personal interest and home use, thus accelerating XR adoption.

Meta Teases Orion Operating System

Meta has released a video teaser showcasing the UI of its Orion glasses. Several different interfaces appear in the footage, hinting that Meta is still experimenting with various UI designs for the glasses. Since AR glasses introduce a brand-new paradigm, it’s impossible to implement our current VR or MR interfaces seamlessly. This ongoing experimentation makes complete sense.

Developer Alex Coulombe, who experienced Orion firsthand at Meta Connect, confirmed seeing some interfaces in the video that he tried himself on the glasses.

News Worth a Mention

(Image by bHaptics)

bHaptics Revamps Its Lineup of Devices

Korean company bHaptics, known for its top-tier haptic vests in XR, has announced a refreshed range of devices:

• TactSuit Pro: The new flagship haptic vest for $499.
• TactSuit Air: A more affordable version at $249, reducing cost by having fewer haptic motors compared to the Pro version.
• TactSleeve: The latest iteration of their popular arm-based haptic accessory, offered at $199.

Preorders are open until November 26th. Given that bHaptics gear is compatible with 270 VR titles across Quest, PSVR 2, and SteamVR headsets, there’s plenty of fun to be had if you invest in them.

Horizon Worlds is Getting Its Currency

Horizon Worlds is rolling out Meta Credits, its virtual currency, in select regions. This move is crucial for fostering a thriving economy within the platform, allowing users to purchase digital items from creators. Monetization is always a pivotal phase for a social platform, and it’s intriguing to see how this will shape Horizon Worlds’ community.

Ekto VR Announces Its First Batch of Shoes

After years of development and demonstrations at XR events, Ekto VR is finally shipping its first batch of virtual reality shoes. Named Genesis, these shoes will only ship to 10 initial users, marking the beginning of this groundbreaking hardware’s availability. Priced between $2000 to $3000, depending on features, the shoes are slated for delivery in March 2025.

MeRCURY Diving Mask is Now on IndieGoGo

MeRCURY, an XR headset designed for underwater experiences, aims to transform swimming pools into innovative spaces for virtual adventures, whether underwater, in space, or abstract environments. This uniquely designed device is now available on IndieGoGo, priced steeply at €1250, indicating a primary focus on B2B clientele.

Apple Releases Two New Immersive Videos

Apple has dropped two fresh immersive videos:

• The music video for "Open Hearts" by The Weeknd, available in an immersive format.
• A new installment of the "Concert For One" series, showcasing award-winning singer Raye.

Content Highlights

• Ember Souls, a VR hack-and-slash inspired by Prince of Persia, launches on Quest on November 21st for $25, with a 16% discount for preorders.
• Gadgeteer received a Quest 3 update bringing mixed reality features to its gameplay.
• Beat Saber launched the eagerly anticipated Monstercat Mixtape 2 DLC.
• Clone Drone in the Danger Zone introduces its VR sequel Clone Drone in the Hyperdome.
• Resolution Games is set to release Gears & Goo, a new tower defense game for Vision Pro early next year.
• Spatial Ops, a mixed reality multiplayer shooter by Resolution Games, allows you to engage in laser tag in your living room, priced at $20.
• Little Cities: Diorama is launching for Vision Pro via Apple Arcade on December 5th.
• Exercise Your Demons, a mixed reality fitness game, will be out on December 12 for $20.
• Last Stand, a new mixed reality PvP shooter, has entered early access on Quest.
• Starship Troopers: Continuum adapts the sci-fi series into a new VR co-op shooter, available on Quest for €18.
• VRSO: Bare Knuckle Fighting has been rebranded to Boxing Underdog, releasing this month on Quest.

Reviews of Recent Content

• Triangle Strategy by Square Enix offers a good experience in XR, albeit too similar to its flatscreen counterpart.
• DIG VR excels with engaging visuals, humor-filled minigames, and charming British humor but suffers from tedious campaign missions and interaction hiccups.
• EXOcars strikes a balance between realism and fun, delivering an enjoyable VR racing experience.

Other News

• Sony halts production of the adapter for using the original PSVR on PS5.
• Pico has released a notable update to its operating system, Pico OS.
• Apple Final Cut Pro now facilitates editing of Spatial Videos.
• A revealing article on Wired highlights Meta Horizon Worlds’ growing younger audience.
• A selection of Quixel Megascans assets is available for free on FAB (Thanks, Ivan Aguilar!).
• Vive Ultimate Tracker now supports third-party headsets (Thanks again, Ivan Aguilar!).
• Niantic’s new Spatial Platform unlocks the potential of spatial intelligence (though its exact implications remain a bit perplexing).

Partners and Friends

• The XR Design Challenge is a fresh and exciting XR hackathon. Immersive Insiders, in collaboration with Met, ShapesXR, and IDEO, are organizing the Global XR Design Challenge from December 2 to January 13. This online event boasts a USD 10,000 prize for the top XR design ideas and interaction concepts. Participating is free, so why not give it a shot?

• Story lets you create engaging spatial content on Vision Pro, integrating various media forms seamlessly—2D images, 2D videos, 3D models, etc.

• If you’re looking to amplify the reach of your XR product, advertising on this blog could be ideal, reaching a fantastic audience of AR/VR enthusiasts.

Some XR Fun

Check out the original PCVR Funny link for a dose of lighthearted XR fun.

Donate for Good

This week, just as last week, I encourage you to turn your generosity towards a greater cause rather than supporting my blog. The ongoing crisis in Ukraine demands urgent assistance, so please consider donating to the Red Cross to aid those affected. I want to take a moment to thank my Patreon supporters for their ongoing contributions:

[List of Patreon supporters]

And here’s where you can make a meaningful impact:

Support The Red Cross in Ukraine

(Header image by Meta)

Remember, this blog supports itself through advertising and affiliate links. Clicking these helps sustain our efforts with a small commission on your purchases. Here’s the full disclosure, should you need it.

Share this with your fellow innovators!