Luo, Man, Zhang, Wenzhe, Song, Tianyou, Li, Kun, Zhu, Hongming, Du, Bowen and Wen, Hongkai (2020) Rebalancing expanding EV sharing systems with deep reinforcement learning. In: International Joint Conference on Artificial Intelligence, Yokohama, Japan, 11-17 Jul 2020. Published in: Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence pp. 1338-1344. doi:10.24963/ijcai.2020/186

PDF WRAP-rebalancing-expanding-EV-sharing-systems-deep-reinforcement-learning-Wen-2020.pdf - Accepted Version Embargoed item. Restricted access to Repository staff only - Requires a PDF viewer. Download (2527Kb)

Request Changes to record.

Abstract

Electric Vehicle (EV) sharing systems have recently experienced unprecedented growth across the world. One of the key challenges in their operation is vehicle rebalancing, i.e., repositioning the EVs across stations to better satisfy future user demand. This is particularly challenging in the shared EV context, because i) the range of EVs is limited while charging time is substantial, which constrains the rebalancing options; and ii) as a new mobility trend, most of the current EV sharing systems are still continuously expanding their station networks, i.e., the targets for rebalancing can change over time. To tackle these challenges, in this paper we model the rebalancing task as a Multi-Agent Reinforcement Learning (MARL) problem, which directly takes the range and charging properties of the EVs into account. We propose a novel approach of policy optimization with action cascading, which isolates the non-stationarity locally, and use two connected networks to solve the formulated MARL. We evaluate the proposed approach using a simulator calibrated with 1-year operation data from a real EV sharing system. Results show that our approach significantly outperforms the state-of-the-art, offering up to 14% gain in order satisfied rate and 12% increase in net revenue.

Item Type:	Conference Item (Paper)
Subjects:	T Technology > TL Motor vehicles. Aeronautics. Astronautics
Divisions:	Faculty of Science, Engineering and Medicine > Science > Computer Science
Library of Congress Subject Headings (LCSH):	Electric vehicles, Artificial intelligence, Reinforcement learning -- Computer simulation, Machine learning
Journal or Publication Title:	Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence
Official Date:	2020
Dates:	Date Event 2020 Available 19 April 2020 Accepted
Page Range:	pp. 1338-1344
DOI:	10.24963/ijcai.2020/186
Status:	Peer Reviewed
Publication Status:	Published
Reuse Statement (publisher, data, author rights):	Luo, Man, Zhang, Wenzhe, Song, Tianyou, Li, Kun, Zhu, Hongming, Du, Bowen and Wen, Hongkai (2020) Rebalancing expanding EV sharing systems with deep reinforcement learning. In: International Joint Conference on Artificial Intelligence, Yokohama, Japan, 11-17 Jul 2020. Published in: Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence pp. 1338-1344. doi:10.24963/ijcai.2020/186 SOLE copyright owner is Copyright © 2020, IJCAI All rights reserved. Not to be reproduced
Access rights to Published version:	Open Access (Creative Commons)
Copyright Holders:	IJCAI (International Joint Conferences on Artificial Intelligence)
Date of first compliant deposit:	27 April 2020
Conference Paper Type:	Paper
Title of Event:	International Joint Conference on Artificial Intelligence
Type of Event:	Conference
Location of Event:	Yokohama, Japan
Date(s) of Event:	11-17 Jul 2020
Related URLs:	Organisation

Request changes or add full text files to a record

Repository staff actions (login required)

View Item