ADaSci Banner 2024

Design of Reward Function for Multi-Objective Adaptive Cruise Control using Deep Reinforcement Learning

Author(s): Praveen Prasath KV, Rahul Benjamin D


Adaptive Cruise Control (ACC) is an essential component of Advanced Driver Assistance System (ADAS) which regulates the motor vehicles in adhering to speed limit and maintaining a safe following distance without driver’s intervention. This work showcases the use of Deep Reinforcement Learning (DRL) controller with Deep Deterministic Policy Gradient (DDPG) algorithm to make acceleration and braking decisions to meet the multi-objective ACC requirements.

A Simulation environment of ACC, with a lead car and a follower Battery Electric Vehicle (BEV) is integrated with DRL, where the controller regulates the velocity of the ego car (BEV). Individual driving objectives namely, tracking accuracy, ride comfort and safety are translated to appropriate reward function components to ensure the conformity of ACC. During training, the DRL agent interacts with the environment and learns an optimal policy by trial and error, which is evaluated in a highway driving scenario and compared with Model Predictive Control (MPC) controller. The DRL and MPC controllers are comparable in tracking accuracy and safety, but the DRL significantly outperforms MPC in ride comfort.

The MPC frequently crosses the jerk limit of 2.5 m/s3 whereas the DRL stays well within this limit. Further, the DRL agent is evaluated under different scenarios which include, highway cruising and cut-in cut-out. The DRL proved to be robust, efficient, and optimal in its control whilst having strong generalization characteristics.

Access The Research Paper:

Picture of Vaibhav Kumar

Vaibhav Kumar

The Chartered Data Scientist Designation

Achieve the highest distinction in the data science profession.

Elevate Your Team's AI Skills with our Proven Training Programs

Strengthen Critical AI Skills with Trusted Generative AI Training by Association of Data Scientists.

Our Accreditations

Get global recognition for AI skills

Chartered Data Scientist (CDS™)

The highest distinction in the data science profession. Not just earn a charter, but use it as a designation.

Certified Data Scientist - Associate Level

Global recognition of data science skills at the beginner level.

Certified Generative AI Engineer

An upskilling-linked certification initiative designed to recognize talent in generative AI and large language models

Join thousands of members and receive all benefits.

Become Our Member

We offer both Individual & Institutional Membership.