Skip to content
MathWorks - Mobile View
  • Sign In to Your MathWorks AccountSe connecter
  • Access your MathWorks Account
    • Mon compte
    • Mon profil
    • Mes licences
    • Se déconnecter
  • Produits
  • Solutions
  • Le monde académique
  • Support
  • Communauté
  • Événements
  • Obtenir MATLAB
MathWorks
  • Produits
  • Solutions
  • Le monde académique
  • Support
  • Communauté
  • Événements
  • Obtenir MATLAB
  • Sign In to Your MathWorks AccountSe connecter
  • Access your MathWorks Account
    • Mon compte
    • Mon profil
    • Mes licences
    • Se déconnecter

Vidéos et webinars

  • MathWorks
  • Vidéos
  • Vidéos
  • Recherche
  • Vidéos
  • Recherche
  • Contacter l'équipe commerciale
  • Version d'essai
3:16 Video length is 3:16.
  • Description
  • Full Transcript
  • Related Resources

3D Simulation for Testing UAV Applications

UAV Toolbox provides a 3D drone simulation environment rendered using the Unreal Engine® from Epic Games® to help UAV engineers build realistic scenarios, model sensors, and test UAV algorithms. Using these capabilities, you can design autonomous UAV applications, co-simulate Simulink® with Unreal Engine, and generate synthetic lidar and image data. The sensor data generated enables closed-loop simulation to verify UAV algorithms.

The toolbox also supports depth and semantic segmentation visualization, which can be used to validate depth estimation algorithms and generate semantic segmentation data to train neural networks. Explore the UAV Package Delivery example to see the Unreal Engine used with multiple sensors in a real use case. Finally, while the toolbox comes installed with prebuilt scenes, you can also build custom scenes with UAV Toolbox Interface for Unreal Engine Projects.

UAV Toolbox provides a 3D simulation environment using the “Unreal Engine® simulation environment from Epic Games” to help UAV developers build realistic scenarios, model sensors, and test their behavior in the provided environment.

Using these capabilities, you can build a Simulink flight model, simulate it in the Unreal Engine co-simulation controlling it from Simulink, and analyze the Lidar and image data generated.

To quickly get started, open a new “Simulink model” and select “blank model”.

Open the “Library Browser”, and scroll down to the “UAV Toolbox”. Expand it and select “Simulation 3D”. This consists of the blocks needed to create a simple model.

To get started, we drag and drop the “Simulation 3D UAV Vehicle” block to the new Simulink model.

This block implements a quadrotor or fixed wing UAV in the 3D simulation environment.

For this model, we select the quadrotor and set the name to “Quadrotor1”.

Next, we copy over the “Simulink 3D Scene Configuration” block.

This block implements a 3D simulation environment that is rendered using the Unreal Engine.

For this model, we use the default “US city block” scene and set the scene view to “Quadrotor1”.

Finally, we add a sensor to the model. The UAV Toolbox provides Lidar, Fisheye camera, and normal camera blocks for you to simulate.

For this model, we import the “Simulation 3D Camera” block into the model and check that “parent name” is set to the “Quadrotor1”. You can change the location of the camera on the vehicle and for this model, we will move it 10 cm forward.

To display the camera output, we add a “Video viewer” block.

To move the quadrotor in the simulation, we add translation and rotation inputs using constant and ramp blocks.

The model is now complete. To run it, click on “Run”. Two windows pop up, the first is the Unreal engine viewer, and the second is the view of the camera data.

Pausing the Simulink model also pauses the Unreal simulation which shows the synchronization between them and enables the validation of the model next to the live environment.

The toolbox also supports more complex 3D simulation capabilities such as depth visualization and semantic segmentation visualization.

You can use depth maps to validate depth estimation algorithms, and generate semantic segmentation data that can be used to train neural networks.

For a more comprehensive example showcasing the unreal engine being used with multiple sensors and a real use case, you can explore the “UAV Package Delivery” example.

This example shows how to implement a small multicopter simulation to takeoff, fly, and land at a different location.

Finally, while the toolbox comes installed with prebuilt scenes, users can use custom scenes. To do this, please refer to the help page “Customize Unreal Engine Scenes for UAVs” which gives you instructions on the support packages and tools needed.

For more information on 3D simulation, please search for "Scenario Simulation" in the UAV Toolbox documentation. Here you can find additional information and examples to get started.

Related Products

  • UAV Toolbox
  • Computer Vision Toolbox

Learn More

Scenario Simulation
UAV Package Delivery
Depth and Semantic Segmentation Visualization Using Unreal Engine Simulation
Customize Unreal Engine Scenes for UAVs
What Is Drone Simulation?

3 Ways to Speed Up Model Predictive Controllers

Read white paper

A Practical Guide to Deep Learning: From Data to Deployment

Read ebook

Bridging Wireless Communications Design and Testing with MATLAB

Read white paper

Deep Learning and Traditional Machine Learning: Choosing the Right Approach

Read ebook

Hardware-in-the-Loop Testing for Power Electronics Control Design

Read white paper

Predictive Maintenance with MATLAB

Read ebook

Electric Vehicle Modeling and Simulation - Architecture to Deployment : Webinar Series

Register for Free

How much do you know about power conversion control?

Start quiz

Feedback

Featured Product

UAV Toolbox

  • Request Trial
  • Get Pricing

Up Next:

42:27
Machine Learning and Computer Vision for Medical Imaging...

Related Videos:

40:27
Machine Learning and Computer Vision for Biological Imaging...
46:56
Computer Vision with MATLAB for Object Detection and...
7:01
Introduction to Kalman Filters for Object Tracking
4:59
Object Recognition and Tracking for Augmented Reality

View more related videos

MathWorks - Domain Selector

Select a Web Site

Choose a web site to get translated content where available and see local events and offers. Based on your location, we recommend that you select: .

  • Switzerland (English)
  • Switzerland (Deutsch)
  • Switzerland (Français)
  • 中国 (简体中文)
  • 中国 (English)

You can also select a web site from the following list:

How to Get Best Site Performance

Select the China site (in Chinese or English) for best site performance. Other MathWorks country sites are not optimized for visits from your location.

Americas

  • América Latina (Español)
  • Canada (English)
  • United States (English)

Europe

  • Belgium (English)
  • Denmark (English)
  • Deutschland (Deutsch)
  • España (Español)
  • Finland (English)
  • France (Français)
  • Ireland (English)
  • Italia (Italiano)
  • Luxembourg (English)
  • Netherlands (English)
  • Norway (English)
  • Österreich (Deutsch)
  • Portugal (English)
  • Sweden (English)
  • Switzerland
    • Deutsch
    • English
    • Français
  • United Kingdom (English)

Asia Pacific

  • Australia (English)
  • India (English)
  • New Zealand (English)
  • 中国
    • 简体中文Chinese
    • English
  • 日本Japanese (日本語)
  • 한국Korean (한국어)

Contact your local office

  • Contacter l'équipe commerciale
  • Version d'essai

MathWorks

Accelerating the pace of engineering and science

MathWorks est le leader mondial des logiciels de calcul mathématique pour les ingénieurs et les scientifiques.

Découvrir…

Découvrir les produits

  • MATLAB
  • Simulink
  • Version étudiante
  • Support Hardware
  • File Exchange

Essayer ou acheter

  • Téléchargements
  • Version d'essai
  • Contacter un commercial
  • Tarifs et licences
  • Comment acheter

Se former

  • Documentation
  • Tutoriels
  • Exemples
  • Vidéos et webinars
  • Formation

Obtenir de l'aide

  • Aide à l'installation
  • MATLAB Answers
  • Services de consulting
  • Centre de gestion des licences
  • Contacter le support technique

La société

  • Offres d'emploi
  • Actualités
  • Mission sociale
  • Témoignages clients
  • La société
  • Select a Web Site United States
  • Trust Center
  • Marques déposées
  • Charte de confidentialité
  • Lutte anti-piratage
  • État des applications

© 1994-2022 The MathWorks, Inc.

  • Facebook
  • Twitter
  • Instagram
  • YouTube
  • LinkedIn
  • RSS

Rejoignez la conversation