SMARTS Competition of Autonomous Driving

Introduction

Autonomous driving is one of the most significant applications of AI. From eliminating road accidents due to human errors to massively reducing urban space devoted to parking, autonomous promises to fundamentally change our daily lives in many ways. Deep learning, reinforcement learning, and multi-agent learning have achieved phenomenal success in recent years, and are now being actively researched for use in autonomous driving. However, large-scale research competitions and standard benchmarks in autonomous driving have mainly focused on perception and prediction rather than planning and interaction. To help advance the frontier of autonomous driving research and to stimulate research that takes multi-agent interaction in driving seriously, we organize the Autonomous Driving Competition at DAI 2020.

Principles

Participants are expected to develop their autonomous driving planning and control solutions to tackle complex interactive traffic scenarios provided by the SMARTS simulation platform. The solutions will be evaluated according to their competence for driving, interaction, and generalization.

There are two separate tracks in the competition. Track 1 is focused on single-agent multi-lane cruising, where the AI agent controls a vehicle to drive along lengthy routes that go through intersections and roundabouts while interacting with social vehicles. Track 2 is focused on multi-agent safe driving, where the AI agent is expected to control one or more vehicles to coordinately accomplish scenario-specific missions such as left turn at T-junction, on-ramp merge, etc.

For either track, participants will submit their autonomous driving agents (as model file) to the competition platform for automated evaluation. To reduce the variance of evaluation, there will be repeated runs with different random seeds for each route (Track 1) or mission (Track 2). The evaluation metrics include:

Simulation Environment

SMARTS (Scalable Multi-Agent Reinforcement Learning Training School) is the first of its kind simulation platform in that it is centrally focused on realistic dynamical driving interaction. It allows construction and control of interaction scenarios that emulate real-world behaviors at different levels of granularity. In doing so, it serves to bring research on multi-agent learning closer to the reality of autonomous driving than ever before.

Training Support: Huawei Cloud

We will provide some computing resources for training, participants can send a request via registered email.

Track 1: Single Agent, Multi-Lane Cruising

The solution agent is expected to follow a specific route through a road network that includes intersections, merges, and roundabouts. The task of the agent is to follow the prescribed route, drive as quickly and safely as possible from the start line to the finish line, amid background traffic that consists only of other vehicles.

Track 2: Multi-Agent Collaboration

For this track, participants are supposed to develop a parameter-sharing multi-agent model to control a group of agents to accomplish short missions in specific scenarios, including Ramp, Double Merge, T-junction, Crossroads and Roundabout. Each submission will be evaluated on all of these scenarios simultaneously. Moreover, in each scenario, there are more than one mission and more than one agent instances (all sharing the same set of policy parameters), and each of these agent instances will be randomly assigned a mission. In addition to the agent-controlled vehicles, there will also be background traffic vehicles driving in the scenario.

Committees

Organizing Comittee

Academic Committee

Return to homepage