OpenAI, Jony Ive struggle with technical details on secretive new AI gadget

OpenAI and star designer Jony Ive are grappling with a series of technical issues with their secretive new artificial intelligence device, as they push to launch a blockbuster tech product next year.

The San Francisco-based startup run by Sam Altman acquired the former Apple design chief’s company io for $6.5 billion in May, but the pair have shared few details on the projects they are building.

Their aim is to create a palm-sized device without a screen that can take audio and visual cues from the physical environment and respond to users’ requests.

People familiar with their plans said OpenAI and Ive had yet to solve critical problems that could delay the device’s release.

Despite having hardware developed by Ive and his team—whose alluring designs of the iMac, iPod, and iPhone helped turn Apple into one of the most valuable companies in the world—obstacles remain in the device’s software and the infrastructure needed to power it.

These include deciding on the assistant’s “personality,” privacy issues, and budgeting for the computing power needed to run OpenAI’s models on a mass consumer device.

“Compute is another huge factor for the delay,” said one person close to Ive. “Amazon has the compute for an Alexa, so does Google [for its Home device], but OpenAI is struggling to get enough compute for ChatGPT, let alone an AI device—they need to fix that first.”

A person close to OpenAI said the teething troubles were simply normal parts of the product development process.

Multiple people familiar with the plans said OpenAI and Ive were working on a device roughly the size of a smartphone that users would communicate with through a camera, microphone and speaker. One person suggested it might have multiple cameras.

The gadget is designed to sit on a desk or table but can also be carried around by the user. The Wall Street Journal previously reported some of the specifications around the device.

One person said the device would be “always on” rather than triggered by a word or prompt. The device’s sensors would gather data throughout the day that would help to build its virtual assistant’s “memory.”