Imaginative and prescient Professional is constructed solely round hand-tracking whereas Quest 3 makes use of controllers at first, but additionally helps hand-tracking as an alternate possibility for some content material. However which has higher hand-tracking? You may be shocked on the reply.
Imaginative and prescient Professional Hand-tracking Latency
With no help for movement controllers, Imaginative and prescient Professional’s solely motion-based enter is hand-tracking. The core enter system combines fingers with eyes to manage your complete interface.
Previous to the launch of the headset we spotted some footage that allowed us to gauge the hand-tracking latency between 100-200ms, however that’s a fairly large window. Now we’ve run our personal check and extra exactly discover Imaginative and prescient Professional’s hand-tracking to be about 128ms on visionOS beta v1.1.1.
Right here’s how we measured it. Utilizing a display screen seize from the headset which views each the passthrough hand and the digital hand, we will see what number of frames it takes between when the passthrough hand strikes and when the digital hand strikes. We used Apple’s Persona system for hand rendering to remove any extra latency which may very well be launched by Unity.
After sampling a handful of exams (pun meant), we discovered this to be about 3.5 frames. On the seize fee of 30 FPS, that’s 116.7ms. Then we add to that Imaginative and prescient Professional’s known passthrough latency of about 11ms, for the ultimate results of 127.7ms of photon to hand-tracking latency.
We additionally examined how lengthy between a passthrough faucet and a digital enter (to see if full skeletal hand-tracking is slower than easy faucet detection), however we didn’t discover any important distinction in latency. We additionally examined in several lighting situations and located no important distinction.
Quest 3 Hand-tracking Latency
How does that evaluate to Quest 3, a headset which isn’t solely managed by the fingers? Utilizing an analogous check, we discovered Quest 3’s hand-tracking latency to be round 70ms on Quest OS v63. That’s a considerable enchancment over Imaginative and prescient Professional, however precise utilization of the headset would make one assume Quest 3 has even decrease hand-tracking latency. But it surely seems a few of the perceived latency is masked.
Right here’s how we discovered. Utilizing a 240Hz through-the-lens seize, we did the identical type of movement check as we did with Imaginative and prescient Professional to learn how lengthy between the movement of the passthrough hand and the digital hand. That got here out to 31.3ms. Mixed with Quest 3’s known passthrough latency of about 39ms that makes Quest 3’s photon to hand-tracking latency about 70.3ms.
When utilizing Quest 3, hand-tracking feels even snappier than that end result suggests, so what provides?
As a result of Quest 3’s passthrough latency is about three-and-a-half occasions that of Imaginative and prescient Professional (11ms vs. 39ms), the time between seeing your hand transfer and your digital hand transfer seems to be simply 31.3ms (in comparison with 116.7ms on Imaginative and prescient Professional).
– – — – –
An vital level right here: latency and accuracy of hand-tracking are two various things. In lots of instances, they could even have an inverse relationship. In case you optimize your hand-tracking algorithm for pace, you could quit some accuracy. And when you optimize it for accuracy, you could quit some pace. As of now we don’t have an excellent measure of hand-tracking accuracy for both headset, outdoors of a intestine feeling.
