World Labs, a startup founded by Fei-Fei Li, has introduced a new demonstration project called Frameboy. This web-based interface allows users to explore multimodal worlds generated by the company's Atlas model, which was originally unveiled in September 2024.
The Atlas model is capable of generating image and video frames with pixel-level camera control and 3D reconstruction. Frameboy functions as a browser-based simulator that mimics a handheld gaming console, where users select different virtual environments via virtual game cartridges.
The platform streams content using cloud-based GPU servers at a maximum frame rate of 15 frames per second. Users can navigate these environments using touchscreens or keyboard controls, with specific inputs assigned for movement and camera adjustments.
While the project serves as a technical demonstration, the current implementation faces limitations. The experience is noted to have slight latency due to the frame rate cap, and the reliance on high-performance cloud GPU infrastructure results in significant operational costs compared to local rendering.
