Nvidia introduces Cosmos3-H-Dreams for interactive surgical simulation

Nvidia introduced Cosmos3-H-Dreams on October 20, extending its surgical simulation research from tabletop exercises to scenes inside the body. The system generates video that responds to tool movements, using recordings and robot motion data from gallbladder removal procedures performed with CMR Surgical's Versius platform.

The simulator builds on a model with 16 billion parameters and runs with FlashDreams software on one RTX PRO 6000 GPU. Nvidia released two versions with different speed and image-quality tradeoffs. Training focuses on interactions involving a grasper and a monopolar hook.

The earlier Cosmos-H-Dreams system focused on tabletop suturing. The new release addresses more complex anatomy, tissue movement and obstructed views, but Nvidia cautioned that convincing images do not establish biomechanical accuracy.

Nvidia identified surgeon evaluation, broader procedural coverage and additional instruments as future research directions. It described the release as a research tool without validation for patient care.