Stacey Svetlichnaya, Deep Learning Engineer

Harness the Sky: Aerial Segmentation Benchmark with DroneDeploy

TL;DR our latest benchmark in partnership with DroneDeploy trains models for understanding aerial drone imagery—join our efforts here!

The Aerial Segmentation Benchmark

We’re excited to announce our newest benchmark in partnership with DroneDeploy: train machine learning models to segment high-resolution aerial orthomosaics and elevation images from drones. You can read more in the DroneDeploy blog post.

Combine visual & elevation images to identify buildings, ground, vegetation, water, etc.

The challenge

The goal of this project is to collaborate on and advance scene understanding from drone data. Given a high-resolution photograph and elevation of an area mapped by a drone, how well can we locate the different types of objects or landscapes in the scene?  The training data currently has six classes labeled (ground, water, vegetation, cars, clutter, and buildings) and an impressive level of detail at 10cm per pixel. From the benchmark, you can follow two examples (using FastAI or Keras) to reproduce initial baselines on the data and explore many potential improvements: data augmentation and post processing, hyperparameter and architecture tuning, integrating the elevation signal (not currently used), and more.

Long-term impact

Faster and more accurate models for aerial segmentation can help at a massive scale in many domains, including:

At Weights & Biases, we are building tools to support ethical and effective development of machine learning models. Benchmarks give us the opportunity to share datasets and host public collaboration, fostering a transparent environment around a meaningful application.

We are working to support more collaborations and benchmarks in the future, especially on projects relevant to climate change and social good. If you have an interesting dataset or baseline model you’d like to contribute, please reach out at contact@wandb.com.


Enter your email to get updates about new features and blog posts.

Weights & Biases

We're building lightweight, flexible experiment tracking tools for deep learning. Add a couple of lines to your python script, and we'll keep track of your hyperparameters and output metrics, making it easy to compare runs and see the whole history of your progress. Think of us like GitHub for deep learning.

Partner Program

We are building our library of deep learning articles, and we're delighted to feature the work of community members. Contact Lavanya to learn about opportunities to share your research and insights.

Try our free tools for experiment tracking →