Meta is collaborating with tactile sensor manufacturer GelSight and South Korean robotics firm Wonik Robotics to develop advanced sensors for AI research. These sensors are not designed for consumer use but rather aim to support scientists in exploring AI applications that require complex sensory feedback.
Meta envisions these devices will help AI systems learn more about and model the physical world with greater detail, supporting advancements in fields that require fine-tuned touch perception and environmental interaction.
One of the key products from this collaboration is the Digit 360, an advanced tactile fingertip sensor. Developed by GelSight in partnership with Meta, Digit 360 enhances Meta’s previous Digit sensor by digitizing touch signals through an on-device AI chip and utilizing around 18 sensing features. This sophisticated setup allows Digit 360 to detect subtle changes in its surroundings, making it a valuable tool for AI-driven research that needs multimodal sensing abilities comparable to human touch.
The Digit 360’s design incorporates a unique optical system that captures deformations across a wide field of view, enabling it to detect surface characteristics and respond to multiple sensory modalities.
This sensor can perceive a wide range of environmental attributes, such as vibrations, heat, and even odors, which are typically challenging for traditional sensors to detect. Meta notes that these features make the sensor suitable for in-depth touch perception research, potentially advancing our understanding of how machines can interpret physical interactions with varied surfaces.
For researchers eager to experiment with this technology, Meta has announced that Digit 360 will be commercially available next year. Additionally, the company has launched a proposal initiative through which select researchers can gain early access to the Digit 360 for experimental purposes.
This initiative reflects Meta’s commitment to supporting cutting-edge AI research, offering scientists an opportunity to explore new tactile sensing capabilities that could lead to groundbreaking developments in robotics and machine learning.
Beyond Digit 360, Meta is also working with Wonik Robotics on a new version of Wonik’s Allegro Hand, a robotic hand integrated with tactile sensors similar to those in Digit 360.
The updated Allegro Hand, built on a Meta-designed platform, will incorporate control boards that encode sensor data onto a connected computer, allowing for more detailed manipulation and perception capabilities in robotic hands. The Allegro Hand, like Digit 360, is expected to be available next year, supporting Meta’s vision of advancing robotic and AI tactile interaction technologies.
