NVIDIA Accelerates Humanoid Robotics Development
NVIDIA has announced a suite of services, models, and computing platforms to accelerate humanoid robotics development globally. Key offerings include:
1. New NVIDIA NIM microservices for robot simulation and learning, including MimicGen for synthetic motion data generation and Robocasa for task and environment generation.
2. NVIDIA OSMO, a cloud-native service for orchestrating complex robotics workflows.
3. An AI- and Omniverse-enabled teleoperation workflow for efficient data capture and synthetic data generation.
4. Access to NVIDIA AI supercomputers, Isaac Sim, and Jetson Thor humanoid robot computers.
5. The NVIDIA Humanoid Robot Developer Program for early access to these technologies.
These initiatives aim to simplify and accelerate humanoid robot development, reducing deployment times and costs for developers worldwide.
NVIDIA ha annunciato una suite di servizi, modelli e piattaforme di calcolo per accelerare lo sviluppo della robotica umana a livello globale. Le offerte principali includono:
1. Nuovi microservizi NVIDIA NIM per la simulazione e l'apprendimento robotico, tra cui MimicGen per la generazione di dati di movimento sintetico e Robocasa per la generazione di compiti e ambienti.
2. NVIDIA OSMO, un servizio cloud-native per orchestrare flussi di lavoro robotici complessi.
3. Un flusso di lavoro di teleoperazione abilitato da AI e Omniverse per una cattura dati efficiente e generazione di dati sintetici.
4. Accesso agli supercomputer AI di NVIDIA, Isaac Sim e computer per robot umani Jetson Thor.
5. Il Programma di Sviluppo di Robot Umani NVIDIA per un accesso anticipato a queste tecnologie.
Queste iniziative mirano a semplificare e accelerare lo sviluppo dei robot umani, riducendo i tempi e i costi di implementazione per gli sviluppatori in tutto il mondo.
NVIDIA ha anunciado un conjunto de servicios, modelos y plataformas inform谩ticas para acelerar el desarrollo de la rob贸tica humanoide a nivel global. Las principales ofertas incluyen:
1. Nuevos microservicios NVIDIA NIM para la simulaci贸n y el aprendizaje de robots, que incluyen MimicGen para la generaci贸n de datos de movimiento sint茅tico y Robocasa para la generaci贸n de tareas y entornos.
2. NVIDIA OSMO, un servicio nativo de la nube para orquestar flujos de trabajo rob贸ticos complejos.
3. Un flujo de trabajo de teleoperaci贸n habilitado para AI y Omniverse para una captura de datos eficiente y generaci贸n de datos sint茅ticos.
4. Acceso a supercomputadoras AI de NVIDIA, Isaac Sim y computadoras para robots humanoides Jetson Thor.
5. El Programa de Desarrollo de Robots Humanoides NVIDIA para acceder anticipadamente a estas tecnolog铆as.
Estas iniciativas tienen como objetivo simplificar y acelerar el desarrollo de robots humanoides, reduciendo los tiempos y costos de implementaci贸n para los desarrolladores de todo el mundo.
狈痴滨顿滨础电� 頊措ǜ雲胳澊霌� 搿滊磭 臧滊皽鞚� 鞝� 靹戈硠鞝侅溂搿� 臧�靻嶍檾頃橁赴 鞙勴暅 靹滊箘鞀�, 氇嵏 氚� 旎错摠韺� 頂岆灚韽检潣 氇潓鞚� 氚滍憸頄堨姷雼堧嫟. 欤检殧 鞝滉车 靷暛鞚� 雼れ潓瓿� 臧欖姷雼堧嫟:
1. 搿滊磭 鞁滊霠堨澊靺� 氚� 頃欖姷鞚� 鞙勴暅 靸堧鞖� NVIDIA NIM 毵堨澊韥靹滊箘鞀�, 頃╈劚 氇厴 雿办澊韯� 靸濎劚鞚� 鞙勴暅 MimicGen 氚� 鞛戩梾瓿� 頇橁步 靸濎劚鞚� 鞙勴暅 Robocasa毳� 韽暔頃╇媹雼�.
2. 氤奠灐頃� 搿滊磭 鞗岉伂頂岆毳� 臁办爼頃橁赴 鞙勴暅 韥措澕鞖半摐 旮半皹 靹滊箘鞀れ澑 NVIDIA OSMO.
3. 須湪鞝侅澑 雿办澊韯� 旌§矘 氚� 頃╈劚 雿办澊韯� 靸濎劚鞚� 鞙勴暅 AI 氚� Omniverse毳� 頇滌毄頃� 鞗愱博 臁办瀾 鞗岉伂頂岆.
4. NVIDIA AI 鞀堩嵓旎错摠韯�, Isaac Sim 氚� Jetson Thor 頊措ǜ雲胳澊霌� 搿滊磭 旎错摠韯办棎 雽�頃� 鞎§劯鞀�.
5. 鞚措煬頃� 旮办垹鞐� 臁瓣赴鞐� 鞎§劯鞀ろ暊 靾� 鞛堧姅 NVIDIA 頊措ǜ雲胳澊霌� 搿滊磭 臧滊皽鞛� 頂勲攴鸽灗.
鞚措煬頃� 鞚措媹靺旐嫲敫岆姅 頊措ǜ雲胳澊霌� 搿滊磭 臧滊皽鞚� 雼垳頇旐晿瓿� 臧�靻嶍檾頃橃棳 鞝� 靹戈硠 臧滊皽鞛愲摛鞚� 氚绊彫 鞁滉皠瓿� 牍勳毄鞚� 欷勳澊電� 瓴冹潉 氇╉憸搿� 頃╇媹雼�.
NVIDIA a annonc茅 une suite de services, de mod猫les et de plateformes de calcul pour acc茅l茅rer le d茅veloppement de la robotique humano茂de 脿 l'茅chelle mondiale. Les principales offres comprennent :
1. Nouveaux microservices NVIDIA NIM pour la simulation et l'apprentissage des robots, y compris MimicGen pour la g茅n茅ration de donn茅es de mouvement synth茅tique et Robocasa pour la g茅n茅ration de t芒ches et d'environnements.
2. NVIDIA OSMO, un service natif du cloud pour orchestrer des flux de travail robotiques complexes.
3. Un flux de t茅l茅op茅ration activ茅 par l'IA et Omniverse pour une capture de donn茅es efficace et une g茅n茅ration de donn茅es synth茅tiques.
4. Acc猫s aux superordinateurs AI de NVIDIA, Isaac Sim et ordinateurs de robots humano茂des Jetson Thor.
5. Le Programme de D茅veloppement de Robots Humano茂des NVIDIA pour un acc猫s anticip茅 脿 ces technologies.
Ces initiatives visent 脿 simplifier et acc茅l茅rer le d茅veloppement de robots humano茂des, r茅duisant ainsi les d茅lais et les co没ts de d茅ploiement pour les d茅veloppeurs du monde entier.
NVIDIA hat eine Suite von Dienstleistungen, Modellen und Computerplattformen angek眉ndigt, um die Entwicklung humanoider Robotik weltweit zu beschleunigen. Zu den Hauptangeboten geh枚ren:
1. Neue NVIDIA NIM-Mikrodienste zur Robotersimulation und -lernen, darunter MimicGen zur Generierung synthetischer Bewegungsdaten und Robocasa zur Generierung von Aufgaben und Umgebungen.
2. NVIDIA OSMO, ein cloud-nativer Dienst zur Orchestrierung komplexer Roboter-Workflows.
3. Ein Teleoperations-Workflow, der durch KI und Omniverse unterst眉tzt wird, um eine effiziente Datenerfassung und die Erzeugung synthetischer Daten zu erm枚glichen.
4. Zugang zu NVIDIA AI-Supercomputern, Isaac Sim und Jetson Thor humanoiden Robotern.
5. Das NVIDIA Humanoid Robot Developer Program f眉r fr眉hen Zugang zu diesen Technologien.
Diese Initiativen zielen darauf ab, die Entwicklung humanoider Roboter zu vereinfachen und zu beschleunigen, wodurch die Bereitstellungszeiten und -kosten f眉r Entwickler weltweit gesenkt werden.
- Introduction of NVIDIA NIM microservices for enhanced robotics simulation workflows
- Launch of NVIDIA OSMO cloud-native service for efficient robotics workflow orchestration
- Development of AI-enabled teleoperation workflow for cost-effective data capture and synthetic data generation
- Establishment of NVIDIA Humanoid Robot Developer Program for early access to new technologies
- Potential to significantly reduce deployment and development cycle times for robotics projects
- None.
Insights
NVIDIA's latest announcement marks a significant leap forward in humanoid robotics development, potentially accelerating progress in this cutting-edge field. The introduction of NVIDIA NIM microservices, OSMO orchestration service and AI-enabled teleoperation workflow addresses critical challenges in robot simulation, training and data generation.
The MimicGen and Robocasa NIM microservices are particularly noteworthy. These tools could dramatically reduce the time and resources required for generating synthetic motion data and simulation-ready environments. This advancement may lead to more rapid iterations in robot design and behavior modeling.
The OSMO cloud-native managed service is a game-changer for workflow orchestration. By simplifying complex robotics development processes, it could significantly reduce development cycle times from months to weeks. This efficiency gain may accelerate innovation and time-to-market for robotics companies.
NVIDIA's AI-enabled teleoperation workflow, leveraging Apple Vision Pro for data capture, addresses a important bottleneck in humanoid robotics development: the need for vast amounts of training data. By generating synthetic datasets from a small number of human demonstrations, this approach could dramatically reduce data collection costs and time.
The expansion of NVIDIA's Humanoid Robot Developer Program, offering early access to these tools, could foster a more collaborative and innovative robotics ecosystem. This initiative, coupled with NVIDIA's comprehensive computing platforms, positions the company as a central player in shaping the future of humanoid robotics.
NVIDIA's announcement represents a significant advancement in the application of AI and machine learning to robotics development. The integration of generative AI techniques, particularly in the realm of synthetic data generation, is a important step forward.
The Project GR00T humanoid foundation model is particularly intriguing. By combining real and synthetic data for training, this model could potentially achieve higher performance and generalization capabilities than traditional approaches. This hybrid data strategy could become a new standard in robotics AI development.
The use of Apple Vision Pro for teleoperation data capture is an innovative application of spatial computing technology. This approach could significantly enhance the quality and realism of the initial demonstration data, leading to more accurate and natural robot behaviors.
NVIDIA's focus on simulation-based learning through Isaac Sim and Isaac Lab aligns with the growing trend of using virtual environments for AI training. This approach allows for safer, faster and more cost-effective development of robot behaviors, especially for complex tasks that would be challenging or dangerous to learn in the real world.
The introduction of NIM microservices for generative physical AI in robotics simulation is a novel application of generative AI techniques. This could lead to more diverse and realistic simulation scenarios, ultimately resulting in more robust and adaptable robot behaviors.
Overall, NVIDIA's integrated approach, combining hardware acceleration, simulation tools and AI models, creates a powerful ecosystem for advancing humanoid robotics AI. This could potentially accelerate breakthroughs in areas such as robot learning, decision-making and human-robot interaction.
NVIDIA's latest announcements in humanoid robotics development tools could have far-reaching implications for the robotics market and related industries. This move positions NVIDIA as a key enabler in the rapidly growing humanoid robotics sector.
The global robotics market, valued at
The introduction of OSMO and NIM microservices could disrupt the robotics development software market. By offering cloud-based, scalable solutions, NVIDIA may capture a significant share of this market segment, potentially challenging existing players in the robotics middleware and simulation software space.
The collaboration with major robotics companies like Boston Dynamics and emerging players like Figure and Fourier indicates strong industry interest. This ecosystem approach could lead to network effects, further solidifying NVIDIA's position in the market.
NVIDIA's strategy of providing end-to-end solutions - from AI training supercomputers to simulation environments and onboard computing with Jetson Thor - creates a compelling value proposition for robotics developers. This integrated approach could lead to increased adoption of NVIDIA's technologies across the robotics value chain.
While the immediate market impact may be to the robotics development sector, the long-term implications could be substantial. As humanoid robotics become more advanced and commercially viable, we could see disruptions in industries such as manufacturing, healthcare and personal assistance, potentially opening new markets for NVIDIA's technologies.
Developers Gain Access to New NVIDIA NIM Microservices for Robotics Simulation in Isaac Lab and Isaac Sim, OSMO Robot Cloud Compute Orchestration Service, Teleoperated Data Capture Workflow and More
DENVER, July 29, 2024 (GLOBE NEWSWIRE) -- 厂滨骋骋搁础笔贬鈥�To accelerate humanoid development on a global scale, NVIDIA today announced it is providing the world鈥檚 leading robot manufacturers, AI model developers and software makers with a suite of services, models and computing platforms to develop, train and build the next generation of humanoid robotics.
Among the offerings are new and frameworks for robot simulation and learning, the orchestration service for running multi-stage robotics workloads, and an AI- and simulation-enabled teleoperation workflow that allows developers to train robots using small amounts of human demonstration data.
鈥淭he next wave of AI is robotics and one of the most exciting developments is humanoid robots,鈥� said Jensen Huang, founder and CEO of NVIDIA. 鈥淲e鈥檙e advancing the entire NVIDIA robotics stack, opening access for worldwide humanoid developers and companies to use the platforms, acceleration libraries and AI models best suited for their needs.鈥�
Accelerating Development With NVIDIA NIM and OSMO
NIM microservices provide pre-built containers, powered by NVIDIA inference software, that enable developers to reduce deployment times from weeks to minutes. Two new AI microservices will allow roboticists to enhance simulation workflows for in 鈩�, a reference application for robotics simulation built on the 鈩� platform.
The MimicGen NIM microservice generates synthetic motion data based on recorded teleoperated data from spatial computing devices like Apple Vision Pro. The Robocasa NIM microservice generates robot tasks and simulation-ready environments in , a universal framework for developing and collaborating within 3D worlds.
NVIDIA OSMO, available now, is a cloud-native managed service that allows users to orchestrate and scale complex 鈥宺obotics development workflows across distributed computing resources, whether on premises or in the cloud.
OSMO vastly simplifies robot training and simulation workflows, cutting deployment and development cycle times from months to under a week. Users can visualize and manage a range of tasks 鈥� like generating , training models, conducting and implementing software-in-the-loop testing at scale for humanoids, autonomous mobile robots and industrial manipulators.
Advancing Data Capture Workflows for Humanoid Robot Developers
Training foundation models for humanoid robots requires an incredible amount of data. One way of capturing human demonstration data is using teleoperation, but this is becoming an increasingly expensive and lengthy process.
An NVIDIA AI- and Omniverse-enabled teleoperation reference workflow, , allows researchers and AI developers to generate massive amounts of synthetic motion and perception data from a minimal amount of remotely captured human demonstrations.
First, developers use Apple Vision Pro to capture a small number of teleoperated demonstrations. Then, they simulate the recordings in NVIDIA Isaac Sim and use the MimicGen NIM microservice to generate synthetic datasets from the recordings.
The developers train the humanoid foundation model with real and synthetic data, enabling developers to save time and reduce costs. They then use the Robocasa NIM microservice in , a framework for robot learning, to generate experiences to retrain the robot model. Throughout the workflow, NVIDIA OSMO seamlessly assigns computing jobs to different resources, saving the developers weeks of administrative tasks.
Fourier, a general-purpose robot platform company, sees the benefit of using simulation technology to synthetically generate training data.
鈥淒eveloping humanoid robots is extremely complex 鈥� requiring an incredible amount of real data, tediously captured from the real world,鈥� said Alex Gu, CEO of Fourier. 鈥淣VIDIA鈥檚 new simulation and generative AI developer tools will help bootstrap and accelerate our model development workflows.鈥�
Expanding Access to NVIDIA Humanoid Developer Technologies
NVIDIA provides three computing platforms to ease humanoid robotics development: NVIDIA AI supercomputers to train the models; NVIDIA Isaac Sim built on Omniverse, where robots can learn and refine their skills in simulated worlds; and NVIDIA Jetson鈩� Thor humanoid robot computers to run the models. Developers can access and use all 鈥� or any part of 鈥� the platforms for their specific needs.
Through a new , developers can gain early access to the new offerings as well as the latest releases of NVIDIA Isaac Sim, , Jetson Thor and Project GR00T general-purpose humanoid foundation models.
1x, Boston Dynamics, ByteDance Research, , Figure, Fourier, Galbot, LimX Dynamics, , Neura Robotics, RobotEra and Skild AI are among the first to join the early-access program.
鈥淏oston Dynamics and NVIDIA have a long history of close collaboration to push the boundaries of what鈥檚 possible in robotics,鈥� said Aaron Saunders, chief technology officer of Boston Dynamics. 鈥淲e鈥檙e really excited to see the fruits of this work accelerating the industry at large, and the early-access program is a fantastic way to access best-in-class technology.鈥�
Availability
Developers can join the NVIDIA Humanoid Robot Developer Program now to get access to NVIDIA OSMO and Isaac Lab, and will soon gain access to NVIDIA NIM microservices.
Learn more about the latest in generative AI and accelerated computing by at SIGGRAPH, the premier computer graphics conference, running through Aug. 1 in Denver.
About NVIDIA
(NASDAQ: NVDA) is the world leader in accelerated computing.
For further information, contact:
David Pinto
Corporate Communications
NVIDIA Corporation
dpinto@nvidia.com
Certain statements in this press release including, but not limited to, statements as to: the benefits, impact, performance, features, and availability of NVIDIA鈥檚 products and technologies, including NVIDIA NIM microservices, NVIDIA OSMO, NVIDIA Isaac Sim, NVIDIA Isaac Lab, MimicGen NIM, Robocasa NIM, NVIDIA Omniverse, Project GR00T humanoid foundation model, NVIDIA Jetson Thor and NVIDIA Humanoid Robot Developer Program; third parties using or adopting NVIDIA products, technologies and platforms, and the benefits and impacts thereof; our collaboration with third parties and the benefits and impacts thereof; the next wave of AI being robotics and one of the most exciting developments being humanoid robots; NVIDIA advancing the entire NVIDIA robotics stack, opening access for worldwide humanoid developers and companies to use the platforms, acceleration libraries and AI models best suited for their needs; and the timing, participants, availability and impact of SIGGRAPH are forward-looking statements that are subject to risks and uncertainties that could cause results to be materially different than expectations. Important factors that could cause actual results to differ materially include: global economic conditions; our reliance on third parties to manufacture, assemble, package and test our products; the impact of technological development and competition; development of new products and technologies or enhancements to our existing product and technologies; market acceptance of our products or our partners' products; design, manufacturing or software defects; changes in consumer preferences or demands; changes in industry standards and interfaces; unexpected loss of performance of our products or technologies when integrated into systems; as well as other factors detailed from time to time in the most recent reports NVIDIA files with the Securities and Exchange Commission, or SEC, including, but not limited to, its annual report on Form 10-K and quarterly reports on Form 10-Q. Copies of reports filed with the SEC are posted on the company's website and are available from NVIDIA without charge. These forward-looking statements are not guarantees of future performance and speak only as of the date hereof, and, except as required by law, NVIDIA disclaims any obligation to update these forward-looking statements to reflect future events or circumstances.
Many of the products and features described herein remain in various stages and will be offered on a when-and-if-available basis. The statements hereto are not intended to be, and should not be interpreted as a commitment, promise, or legal obligation, and the development, release, and timing of any features or functionalities described for our products is subject to change and remains at the sole discretion of NVIDIA. NVIDIA will have no liability for failure to deliver or delay in the delivery of any of the products, features or functions set forth herein.
漏 2024 NVIDIA Corporation. All rights reserved. NVIDIA, the NVIDIA logo, NVIDIA Isaac, NVIDIA Isaac Sim, NVIDIA NIM and NVIDIA Omniverse are trademarks and/or registered trademarks of NVIDIA Corporation in the U.S. and other countries. Other company and product names may be trademarks of the respective companies with which they are associated. Features, pricing, availability and specifications are subject to change without notice.
A photo accompanying this announcement is available at
FAQ
What new services did NVIDIA announce for humanoid robotics development?
How does the NVIDIA OSMO service benefit robotics developers?
What is the purpose of the NVIDIA Humanoid Robot Developer Program?
How does NVIDIA's new teleoperation workflow improve data capture for humanoid robots?
What are the key components of NVIDIA's computing platforms for humanoid robotics development?
