Home
Courses
Knowledge Base
Register
Login
✕
Home
Courses
Simulation and Digital Tools
NVIDIA Isaac Sim: Полное Погружение
NVIDIA Isaac Sim: Полное Погружение
Curriculum
31 Sections
284 Lessons
Lifetime
Expand all sections
Collapse all sections
1. Введение в мир робототехнического моделирования
7
1.1
SWS7 1.1 What are robotic simulations and why do we need them
1.2
SWS7 1.2 Overview of existing simulators — Gazebo, Webots, PyBullet, Isaac Sim
1.3
SWS7 1.3 Advantages of NVIDIA Isaac Sim — photorealism, PhysX physics, GPU acceleration
1.4
SWS7 1.4 NVIDIA ecosystem for robotics — Isaac Sim, Lab, GROOT, ROS
1.5
SWS7 1.5 Applications of simulations — robot training, testing, prototyping
1.6
SWS7 1.6 Sim-to-real transfer concept — transitioning from simulation to reality
1.7
SWS7 1. Test
3 Questions
2. Подготовка рабочего места и монтаж
11
2.1
SWS7 2.1 System requirements for Isaac Sim — hardware, drivers, operating systems
2.2
SWS7 2.2 Installing NVIDIA drivers and CUDA toolkit
2.3
SWS7 2.3 Installing Omniverse Launcher and interface navigation
2.4
SWS7 2.4 Installing Isaac Sim via Omniverse Launcher
2.5
SWS7 2.5 Alternative installation methods — Docker, native installation, cloud
2.6
SWS7 2.6 Installing Omniverse Nucleus — local storage and collaboration
2.7
SWS7 2.7 Installing Omniverse Cache for asset acceleration
2.8
SWS7 2.8 First Isaac Sim launch — what happens on startup
2.9
SWS7 2.9 Setting up Python environment for Isaac Sim API
2.10
SWS7 2.10 Troubleshooting common installation issues
2.11
SWS7 2. Test
3 Questions
3. Isaac Sim Основные интерфейсы и первые шаги
13
3.1
SWS7 3.1 Main window overview — viewport, panels, menus, toolbars
3.2
SWS7 3.2 Navigating 3D space — camera movement, zoom, rotation
3.3
SWS7 3.3 Stage concept — scene object hierarchy
3.4
SWS7 3.4 Creating first scene — adding ground plane and lighting
3.5
SWS7 3.5 Adding simple primitives — cubes, spheres, cylinders
3.6
SWS7 3.6 Object transformations — position, rotation, scale
3.7
SWS7 3.7 Property panel — exploring object properties
3.8
SWS7 3.8 Materials and textures — creating visual diversity
3.9
SWS7 3.9 Lighting system — light source types and configuration
3.10
SWS7 3.10 First simulation run — Play button and what happens
3.11
SWS7 3.11 Simulation time control — timestep, speed, pause
3.12
SWS7 3.12 Saving and loading scenes — USD format
3.13
SWS7 3. Test
3 Questions
4. Universal Scene Description (USD) Базовые форматы
8
4.1
SWS7 4.1 What is USD and why it matters for robotics
4.2
SWS7 4.2 USD file structure — prims, attributes, relationships
4.3
SWS7 4.3 USD layers — composing scenes from multiple files
4.4
SWS7 4.4 References and Payloads — asset reuse
4.5
SWS7 4.5 Variants — creating object variations without duplication
4.6
SWS7 4.6 Working with USD via Python API
4.7
SWS7 4.7 Exporting and importing USD files
4.8
SWS7 4. Test
3 Questions
5. Физические сцены в Isaac Sim - PhysX 5 Basics
11
5.1
SWS7 5.1 Introduction to PhysX 5 physics engine
5.2
SWS7 5.2 Rigid bodies — properties (mass, inertia, center of mass)
5.3
SWS7 5.3 Collision shapes — collision detection forms
5.4
SWS7 5.4 Difference between visual and collision meshes
5.5
SWS7 5.5 Physics materials — friction, elasticity, damping
5.6
SWS7 5.6 Gravity and other global forces
5.7
SWS7 5.7 Contacts and handling — collision detection
5.8
SWS7 5.8 PhysX Scene parameters for accuracy and performance
5.9
SWS7 5.9 Deformable bodies — soft and deformable objects
5.10
SWS7 5.10 Particle systems — fluids and granular materials
5.11
SWS7 5. Test
3 Questions
6. Соединения, сочленения и механизмы роботов
11
6.1
SWS7 6.1 Joint concept in robotics
6.2
SWS7 6.2 Joint types — revolute, prismatic, fixed, spherical
6.3
SWS7 6.3 Creating first joint — connecting two bodies
6.4
SWS7 6.4 Degrees of Freedom (DOF)
6.5
SWS7 6.5 Articulation concept — linked body system
6.6
SWS7 6.6 Kinematic chains
6.7
SWS7 6.7 Joint limits — angle and position constraints
6.8
SWS7 6.8 Joint drives — actuators (position, velocity, effort control)
6.9
SWS7 6.9 Stiffness and damping in joints
6.10
SWS7 6.10 Creating simple manipulator from scratch — 2-link arm
6.11
SWS7 6. Test
3 Questions
7. Импорт и настройка готовых роботов
10
7.1
SWS7 7.1 Isaac Sim asset library — finding ready robots
7.2
SWS7 7.2 Importing URDF files — ROS robot description format
7.3
SWS7 7.3 Importing MJCF files — MuJoCo format
7.4
SWS7 7.4 Converting models to USD format
7.5
SWS7 7.5 Importing popular robots — Franka Emika Panda, UR5, Fetch
7.6
SWS7 7.6 Verifying import correctness — joints, links, collision meshes
7.7
SWS7 7.7 Fixing issues with imported models
7.8
SWS7 7.8 Configuring robot visualization — materials, colors
7.9
SWS7 7.9 Configuring imported robot physical properties
7.10
SWS7 7. Test
3 Questions
8. Контроллеры и управление роботами
12
8.1
SWS7 8.1 Controller types in robotics — position, velocity, effort
8.2
SWS7 8.2 Creating simple position controller for joint
8.3
SWS7 8.3 PID controllers — theory and practical tuning
8.4
SWS7 8.4 Velocity control
8.5
SWS7 8.5 Torque/Force control
8.6
SWS7 8.6 Impedance control — compliant control for collaboration
8.7
SWS7 8.7 Inverse Kinematics (IK) — solving inverse kinematics problem
8.8
SWS7 8.8 Forward Kinematics (FK)
8.9
SWS7 8.9 Configuring IK controller for manipulator
8.10
SWS7 8.10 Trajectory planning
8.11
SWS7 8.11 Motion planning algorithms — RRT, PRM basics
8.12
SWS7 8. Test
3 Questions
9. Датчики и восприятие окружающей среды
13
9.1
SWS7 9.1 Sensor overview in robotics — vision, range, proprioception
9.2
SWS7 9.2 RGB cameras — configuration, resolution, FOV, frequency
9.3
SWS7 9.3 Depth cameras — obtaining depth maps
9.4
SWS7 9.4 Stereo cameras — stereovision for 3D perception
9.5
SWS7 9.5 LiDAR — laser rangefinders (2D and 3D)
9.6
SWS7 9.6 IMU (Inertial Measurement Unit) — acceleration and angular velocity measurement
9.7
SWS7 9.7 Force/Torque sensors — measuring forces in joints
9.8
SWS7 9.8 Contact sensors — detecting touches
9.9
SWS7 9.9 Encoders — reading joint positions
9.10
SWS7 9.10 Getting sensor data via Python API
9.11
SWS7 9.11 Visualizing sensor data in real-time
9.12
SWS7 9.12 Sensor noise and domain randomization for robustness
9.13
SWS7 9. Test
3 Questions
10. Типы роботов и возможности симуляции
10
10.1
SWS7 10.1 Manipulators (robot arms) — kinematics, workspace, singularities
10.2
SWS7 10.2 Configuring Franka Panda manipulator for pick-and-place tasks
10.3
SWS7 10.3 Mobile robots — differential drive, holonomic platforms
10.4
SWS7 10.4 Creating mobile robot with wheels
10.5
SWS7 10.5 Humanoid robots — balance, locomotion, control complexity
10.6
SWS7 10.6 Quadcopters and drones — flight dynamics, stabilization
10.7
SWS7 10.7 Collaborative robots (cobots) — safety, compliance control
10.8
SWS7 10.8 Hybrid robots — mobile manipulators (Fetch, TIAGo)
10.9
SWS7 10.9 Underwater and aerial robots — special physics
10.10
SWS7 10. Test
3 Questions
11. Python API и программирование симуляций
12
11.1
SWS7 11.1 Introduction to Isaac Sim Python API
11.2
SWS7 11.2 Script structure — setup, step loop, cleanup
11.3
SWS7 11.3 Creating scene programmatically — adding objects via code
11.4
SWS7 11.4 Controlling robot via Python — sending commands
11.5
SWS7 11.5 Reading sensor data programmatically
11.6
SWS7 11.6 Standalone scripts vs Extension API
11.7
SWS7 11.7 Creating first standalone script
11.8
SWS7 11.8 Working with SimulationContext — simulation control
11.9
SWS7 11.9 Callbacks and events — reacting to simulation events
11.10
SWS7 11.10 Debugging Python code in Isaac Sim
11.11
SWS7 11.11 Best practices for writing efficient code
11.12
SWS7 11. Test
3 Questions
12. Isaac Lab — фреймворк обучения с подкреплением
14
12.1
SWS7 12.1 What is Isaac Lab and how it differs from Isaac Sim
12.2
SWS7 12.2 Installing Isaac Lab and environment setup
12.3
SWS7 12.3 Isaac Lab architecture — managers, environments, wrappers
12.4
SWS7 12.4 Ready environments in Isaac Lab — available task overview
12.5
SWS7 12.5 Running first RL environment — CartPole
12.6
SWS7 12.6 RL task structure — observations, actions, rewards
12.7
SWS7 12.7 Creating custom environment from scratch
12.8
SWS7 12.8 Observation Manager — configuring what agent sees
12.9
SWS7 12.9 Action Manager — defining action space
12.10
SWS7 12.10 Reward Manager — reward function for training
12.11
SWS7 12.11 Termination conditions — when episode ends
12.12
SWS7 12.12 Parallel environments — running thousands of robots simultaneously
12.13
SWS7 12.13 Domain randomization — variability for robustness
12.14
SWS7 12. Test
3 Questions
13. Алгоритмы и обучение с подкреплением
12
13.1
SWS7 13.1 Reinforcement Learning basics — agent, environment, policy
13.2
SWS7 13.2 Popular RL algorithms — PPO, SAC, DQN
13.3
SWS7 13.3 Integration with RL libraries — Stable Baselines3, RL Games
13.4
SWS7 13.4 Hyperparameter tuning for training
13.5
SWS7 13.5 Starting training process — training loop
13.6
SWS7 13.6 Training monitoring — TensorBoard, Weights & Biases
13.7
SWS7 13.7 Policy evaluation — testing trained agent
13.8
SWS7 13.8 Saving and loading trained policies
13.9
SWS7 13.9 Fine-tuning existing policies
13.10
SWS7 13.10 Sim-to-real transfer — transferring policy to real robot
13.11
SWS7 13.11 Troubleshooting training issues — instability, low reward
13.12
SWS7 13. Test
3 Questions
14. Имитационное обучение и сбор демонстраций
11
14.1
SWS7 14.1 What is Imitation Learning and when to use it
14.2
SWS7 14.2 Teleoperation — human robot control
14.3
SWS7 14.3 Recording demonstrations in Isaac Sim
14.4
SWS7 14.4 Demonstration data format — HDF5 structure
14.5
SWS7 14.5 Isaac Lab Mimic — automatic demonstration generation
14.6
SWS7 14.6 Annotating subtasks in demonstrations
14.7
SWS7 14.7 Behavioral Cloning — learning from imitation
14.8
SWS7 14.8 Training policy on collected dataset
14.9
SWS7 14.9 Dataset Aggregation (DAgger) — iterative improvement
14.10
SWS7 14.10 Comparing IL and RL — when to use what
14.11
SWS7 14. Test
3 Questions
15. Визуально-языковые модели (VLM) для робототехники
9
15.1
SWS7 15.1 Introduction to Vision-Language Models
15.2
SWS7 15.2 Popular VLMs — CLIP, BLIP, LLaVA, PaliGemma
15.3
SWS7 15.3 Integrating VLM with Isaac Sim via Python
15.4
SWS7 15.4 Visual grounding — linking language instructions with objects
15.5
SWS7 15.5 Processing camera images for VLM
15.6
SWS7 15.6 Zero-shot object detection with VLM
15.7
SWS7 15.7 Creating natural language commands system for robot
15.8
SWS7 15.8 VLM as high-level planner for robot
15.9
SWS7 15. Test
3 Questions
16. Визуально-языково-действенные модели (VLA) и управление роботами
11
16.1
SWS7 16.1 What are VLA models — from perception to actions
16.2
SWS7 16.2 VLA architecture — vision encoder, language model, action head
16.3
SWS7 16.3 Popular VLA models — RT-2, OpenVLA, SmolVLA, Octo
16.4
SWS7 16.4 Preparing data for VLA training
16.5
SWS7 16.5 Action tokenization — action representation
16.6
SWS7 16.6 Fine-tuning VLA model on custom task
16.7
SWS7 16.7 VLA inference in Isaac Sim — generating actions in real-time
16.8
SWS7 16.8 Action chunking — predicting action sequences
16.9
SWS7 16.9 Asynchronous inference for better reactivity
16.10
SWS7 16.10 Comparing VLA with classic RL
16.11
SWS7 16. Test
3 Questions
17. Большие языковые модели (LLM) как планировщики
9
17.1
SWS7 17.1 LLM in robotics — high-level planning
17.2
SWS7 17.2 Integrating OpenAI API / local LLMs with Isaac Sim
17.3
SWS7 17.3 Prompt engineering for robotics tasks
17.4
SWS7 17.4 Breaking complex tasks into subtasks with LLM
17.5
SWS7 17.5 Function calling — executing robot commands via LLM
17.6
SWS7 17.6 Chain-of-thought reasoning for complex manipulations
17.7
SWS7 17.7 Multimodal LLM — processing images and text
17.8
SWS7 17.8 Error recovery with LLM
17.9
SWS7 17. Test
3 Questions
18. Isaac GROOT — универсальные политики управления роботами
11
18.1
SWS7 18.1 Introduction to Isaac GROOT (Generalist Robot 00 Technology)
18.2
SWS7 18.2 GROOT architecture — foundation model for robots
18.3
SWS7 18.3 GR00T-N1 model — capabilities and limitations
18.4
SWS7 18.4 Integrating GROOT with Isaac Lab
18.5
SWS7 18.5 Loading pretrained GROOT policies
18.6
SWS7 18.6 GROOT evaluation in simulation
18.7
SWS7 18.7 Fine-tuning GROOT on specific task
18.8
SWS7 18.8 Data collection for GROOT — dataset requirements
18.9
SWS7 18.9 GROOT for humanoid robots
18.10
SWS7 18.10 Multi-embodiment learning — training different robots
18.11
SWS7 18. Test
3 Questions
19. Интеграция ROS 2 с Isaac Sim
12
19.1
SWS7 19.1 Introduction to ROS 2 — basic concepts
19.2
SWS7 19.2 Installing ROS 2 and setup with Isaac Sim
19.3
SWS7 19.3 ROS 2 Bridge in Isaac Sim — installation and configuration
19.4
SWS7 19.4 Publishing sensor data to ROS topics
19.5
SWS7 19.5 Subscribing to control commands from ROS
19.6
SWS7 19.6 TF transforms — broadcast transform tree
19.7
SWS7 19.7 Visualization in RViz of Isaac Sim data
19.8
SWS7 19.8 Using Navigation2 stack with Isaac Sim
19.9
SWS7 19.9 MoveIt2 for manipulator motion planning
19.10
SWS7 19.10 Creating custom ROS 2 nodes for control
19.11
SWS7 19.11 ROS 2 Actions for long tasks
19.12
SWS7 19. Test
3 Questions
20. Навигация и SLAM для мобильных роботов
11
20.1
SWS7 20.1 Autonomous navigation basics
20.2
SWS7 20.2 Configuring mobile robot with lidar
20.3
SWS7 20.3 Obstacle avoidance
20.4
SWS7 20.4 Path planning — A*, RRT
20.5
SWS7 20.5 SLAM (Simultaneous Localization and Mapping) basics
20.6
SWS7 20.6 Creating environment map in simulation
20.7
SWS7 20.7 Robot localization on map
20.8
SWS7 20.8 Navigation stack — autonomous driving in Isaac Sim
20.9
SWS7 20.9 Waypoint navigation — moving through points
20.10
SWS7 20.10 Dynamic obstacles — reacting to moving objects
20.11
SWS7 20. Test
3 Questions
21. Манипуляции и задачи Pick-and-Place (захват и перемещение объектов)
13
21.1
SWS7 21.1 Robotic manipulation basics
21.2
SWS7 21.2 Gripper types — parallel grippers, vacuum, dexterous
21.3
SWS7 21.3 Grasp planning — planning object grasp
21.4
SWS7 21.4 Configuring controller for gripper
21.5
SWS7 21.5 Creating pick-and-place scene
21.6
SWS7 21.6 Object pose estimation
21.7
SWS7 21.7 Approach trajectory — approaching object
21.8
SWS7 21.8 Grasping — implementing grasp
21.9
SWS7 21.9 Lifting and transport
21.10
SWS7 21.10 Placing — precise object placement
21.11
SWS7 21.11 Error handling — manipulation error handling
21.12
SWS7 21.12 Multi-object manipulation — working with multiple objects
21.13
SWS7 21. Test
3 Questions
22. Продвинутые методы симуляции
11
22.1
SWS7 22.1 Multi-robot systems — simulating multiple robots
22.2
SWS7 22.2 Robot coordination — collaborative tasks
22.3
SWS7 22.3 Distributed simulation
22.4
SWS7 22.4 GPU-accelerated simulation — maximum performance
22.5
SWS7 22.5 Real-time factor — measuring simulation speed
22.6
SWS7 22.6 Headless mode — running without GUI for training
22.7
SWS7 22.7 Scripting automation — experiment automation
22.8
SWS7 22.8 Batch processing
22.9
SWS7 22.9 Checkpointing — saving simulation state
22.10
SWS7 22.10 Deterministic simulation — reproducible results
22.11
SWS7 22. Test
3 Questions
23. Создание реалистичных окружений
11
23.1
SWS7 23.1 Scene composition — complex scene composition
23.2
SWS7 23.2 Importing 3D models — formats, optimization
23.3
SWS7 23.3 Materials and PBR — physically based rendering
23.4
SWS7 23.4 Lighting setup — realistic illumination
23.5
SWS7 23.5 Background and skybox
23.6
SWS7 23.6 Procedural generation — automatic scene generation
23.7
SWS7 23.7 Warehouse environments
23.8
SWS7 23.8 Kitchen/household environments
23.9
SWS7 23.9 Industrial environments
23.10
SWS7 23.10 Outdoor environments
23.11
SWS7 23. Test
3 Questions
24. Оптимизация производительности
10
24.1
SWS7 24.1 Profiling — measuring performance
24.2
SWS7 24.2 Bottlenecks identification
24.3
SWS7 24.3 LOD (Level of Detail) — simplifying distant objects
24.4
SWS7 24.4 Collision mesh optimization — simplifying collision shapes
24.5
SWS7 24.5 Physics substeps — balancing accuracy and speed
24.6
SWS7 24.6 GPU memory management
24.7
SWS7 24.7 Batching strategies — grouping operations
24.8
SWS7 24.8 Parallel environments optimization
24.9
SWS7 24.9 Network latency for distributed simulation
24.10
SWS7 24. Test
3 Questions
25. Расширения и кастомизация Isaac Sim
8
25.1
SWS7 25.1 What are Omniverse Extensions
25.2
SWS7 25.2 Creating first Extension
25.3
SWS7 25.3 UI customization — adding custom panels
25.4
SWS7 25.4 Custom physics — creating custom physical components
25.5
SWS7 25.5 Custom sensors — developing new sensor types
25.6
SWS7 25.6 Packaging and distribution Extensions
25.7
SWS7 25.7 Using third-party Extensions
25.8
SWS7 25. Test
3 Questions
26. Компьютерное зрение и обработка изображений
9
26.1
SWS7 26.1 Synthetic data generation — generating training data
26.2
SWS7 26.2 Semantic segmentation
26.3
SWS7 26.3 Instance segmentation — separating objects
26.4
SWS7 26.4 Bounding box annotation — automatic labeling
26.5
SWS7 26.5 Depth estimation
26.6
SWS7 26.6 Optical flow — motion in frame
26.7
SWS7 26.7 Object tracking
26.8
SWS7 26.8 Pose estimation — determining pose of objects and people
26.9
SWS7 26. Test
3 Questions
27. Реальные кейсы и проекты
7
27.1
SWS7 27.1 Project 1 — Autonomous object sorting on conveyor
27.2
SWS7 27.2 Project 2 — Mobile delivery robot in office
27.3
SWS7 27.3 Project 3 — Collaborative assembly with two manipulators
27.4
SWS7 27.4 Project 4 — Humanoid robot — simple locomotion
27.5
SWS7 27.5 Project 5 — Drone with autonomous indoor navigation
27.6
SWS7 27.6 Project 6 — VLA-controlled robot with natural language commands
27.7
SWS7 27. Test
3 Questions
28. Тестирование и валидация
7
28.1
SWS7 28.1 Unit testing for robotics code
28.2
SWS7 28.2 Scenario testing
28.3
SWS7 28.3 Performance testing
28.4
SWS7 28.4 Safety testing
28.5
SWS7 28.5 Regression testing — preventing degradation
28.6
SWS7 28.6 CI/CD for robotics projects
28.7
SWS7 28. Test
3 Questions
29. Переход от симуляции к реальности (Sim-to-Real)
9
29.1
SWS7 29.1 Sim-to-real gap — differences between simulation and reality
29.2
SWS7 29.2 Domain randomization strategies
29.3
SWS7 29.3 Reality gap mitigation — reducing gap
29.4
SWS7 29.4 System identification — calibrating model for real robot
29.5
SWS7 29.5 Hardware-in-the-loop testing
29.6
SWS7 29.6 Deployment to real robot
29.7
SWS7 29.7 On-robot testing and debugging
29.8
SWS7 29.8 Continuous learning — learning from real data
29.9
SWS7 29. Test
3 Questions
30. Карьера и дальнейшее профессиональное развитие
11
30.1
SWS7 30.1 Career paths in robotics — research, engineering, product
30.2
SWS7 30.2 Project portfolio — what to show employers
30.3
SWS7 30.3 Open-source contribution — contributing to community
30.4
SWS7 30.4 Scientific publications and conferences
30.5
SWS7 30.5 Advanced topics to study — optimal control, machine learning theory
30.6
SWS7 30.6 Community and networking — where to communicate with roboticists
30.7
SWS7 30.7 Resources for further learning
30.8
SWS7 30.8 Robotics trends 2025+ — where industry is moving
30.9
SWS7 30.9 Final course project — comprehensive system
30.10
SWS7 30.10 Conclusion and next steps
30.11
SWS7 30. Test
3 Questions
SWS7 Финальный квиз
1
31.1
SWS7 Final Test
5 Questions
This content is protected, please
login
and
enroll
in the course to view this content!
Modal title
Main Content