Serving tech enthusiasts for over 25 years.
TechSpot means tech analysis and advice you can trust.
Forward-looking: Nvidia and AMD have been using AI to cut down on input lag for a while now. A new patent from Sony also uses artificial intelligence to reduce latency, though it does so in a very unusual way: the technology is combined with a camera to predict button presses ahead of time.
The patent in question, titled WO2025010132 - TIMED INPUT/ACTION RELEASE, was spotted by Tech4Gamers. It describes using machine learning to predict a player's movements before they complete them, which could theoretically reduce input lag.
The AI model and an external sensor such as a camera would work in tandem. The camera watches the players fingers to see which button you're about to press and the AI uses this data to learn players' movements. Essentially, it could register a button press before the player has pressed, which should reduce latency.
The system could also detect incomplete controller movements and determine the player's intended action, completing it on their behalf.
"There can be latency between the user's input action and the system's subsequent processing and execution of the command," Sony writes. "This in turn results in delayed execution of the command and unintended consequences in the game itself."
A possible alternative to the slightly creepy prospect of having a camera constantly pointed at your fingers is to integrate the sensor into the controller buttons themselves, potentially allowing them to register when a digit is hovering above.
The majority of patents don't become real products, so there's no guarantee this one will ever move beyond the planning stage. However, Sony won plenty of praise for the PS5's excellent DualSense controllers, so it might want something equally impressive in the PlayStation 6. Moreover, the introduction of PlayStation Spectral Super Resolution (PSSR) in the PS5 Pro does introduce a tiny amount of latency (around 2ms), which Sony might want to address in its future consoles.
Nvidia has championed latency-reducing technology with its Reflex tech. The latest version, Reflex 2, which was unveiled at CES, also uses predictive AI to decrease latency – by 75%, according to Nvidia.
While Reflex 2 continues to synchronize CPU and GPU tasks, it also introduces a feature called Frame Warp. This updates rendered frames based on the most recent mouse inputs just before they are displayed. As the GPU renders a frame, the CPU calculates the next frame's camera position using the latest input data. Frame Warp then modifies the current frame to reflect this updated position, ensuring that on-screen actions correspond more closely with player inputs. The process involves a predictive inpainting technique that uses color and depth data from prior frames to fill any gaps created during the frame warp.
Masthead: Rohan
English (US) ·