Score: 3

STAR: Smartphone-analogous Typing in Augmented Reality

Published: November 26, 2025 | arXiv ID: 2511.21143v1

By: Taejun Kim , Amy Karlson , Aakar Gupta and more

BigTech Affiliations: Meta Princeton University

Potential Business Impact:

Lets you type on virtual keyboard on your hands.

Business Areas:
Augmented Reality Hardware, Software

While text entry is an essential and frequent task in Augmented Reality (AR) applications, devising an efficient and easy-to-use text entry method for AR remains an open challenge. This research presents STAR, a smartphone-analogous AR text entry technique that leverages a user's familiarity with smartphone two-thumb typing. With STAR, a user performs thumb typing on a virtual QWERTY keyboard that is overlain on the skin of their hands. During an evaluation study of STAR, participants achieved a mean typing speed of 21.9 WPM (i.e., 56% of their smartphone typing speed), and a mean error rate of 0.3% after 30 minutes of practice. We further analyze the major factors implicated in the performance gap between STAR and smartphone typing, and discuss ways this gap could be narrowed.

Country of Origin
πŸ‡°πŸ‡· πŸ‡¨πŸ‡¦ πŸ‡ΊπŸ‡Έ United States, Canada, Korea, Republic of

Page Count
13 pages

Category
Computer Science:
Human-Computer Interaction