Journal Papers

Safe Reinforcement Learning in Autonomous Driving With Epistemic Uncertainty Estimation Zhang Z., Liu Q., Li Y., Lin K. and Li L. IEEE Transactions on Intelligent Transportation Systems, 2024.


Distributional Policy Gradient With Distributional Value Function. Liu Q., Li Y., Shi X., Lin K., Liu Y. and Lou Y. IEEE Transactions on Neural Networks and Learning Systems, 2024.


PCE: Multi-Agent Path Finding via Priority-Aware Communication & Experience Learning. Gao J., Li Y, Ye Z, Wu X. IEEE Transactions on Intelligent Vehicles, 2024.


Learning Agile Quadrotor Flight in Restricted Environments with Safety Guarantees. Chen, S., Li Y. , Lou Y., Lin K., and Wu X. IEEE Transactions on Intelligent Vehicles, 2024.


A Time-Aggregated Model-Free RL Algorithm for Optimal Containment Control of MASs. Shi X., Li Y., et al. IEEE Transactions on Circuits and Systems II: Express Briefs, 2024.


Almost Surely Safe Exploration and Exploitation for Deep Reinforcement Learning with State Safety Estimation. Lin K., Li Y., Liu, Q., et al. Information Sciences, 2024.


Data Efficient Deep Reinforcement Learning with Action-ranked Temporal Difference Learning. Liu Q., Li Y., Liu Y., Lin K. IEEE Transactions on Emerging Topics in Computational Intelligence, 2023.


Distributional reinforcement learning with epistemic and aleatoric uncertainty estimation. Liu Q., Li, Y., Chen S., Lin K., et al. Information Sciences, 2023.


FHCPL: An Intelligent Fixed-Horizon Constrained Policy Learning System for Risk-Sensitive Industrial Scenario. Lin K., Li, D., Li, Y., Chen S., Wu, X. IEEE Transactions on Industrial Informatics, 2023.


Optimal Lateral Path-Tracking Control of Vehicles With Partial Unknown Dynamics Via DPG-Based Reinforcement Learning Methods. Shi X., Li Y., Hu W., et al. IEEE Transactions on Intelligent Vehicles, 2023.


A review of graph-based multi-agent pathfinding solvers: From classical to beyond classical. Gao, J., Li, Y., Li, X., Yan, K., Lin, K., & Wu, X. Knowledge-Based Systems, 2023.


Motion Planner with Fixed-Horizon Constrained Reinforcement Learning for Complex Autonomous Driving Scenarios. Lin, K., Li, Y., Chen, S., Li, D., Wu, X. IEEE Transactions on Intelligent Vehicles, 2023.


TAG: Teacher-Advice Mechanism With Gaussian Process for Reinforcement Learning. Lin, K., Li, D., Li, Y., Chen, S., Liu, Q., Gao, J., Jin, Y., & Gong, L. IEEE Transactions on Neural Networks and Learning Systems, 2023.


A fully distributed adaptive event-triggered control for output regulation of multi-agent systems with directed network. Shi, X., Li, Y., Liu, Q., Lin, K., & Chen, S. Information Sciences, 2023.


Learning Real-Time Dynamic Responsive Gap-Traversing Policy for Quadrotors with Safety-Aware Exploration. Chen, S., Li, Y., Lou, Y., Lin, K., & Wu, X. IEEE Transactions on Intelligent Vehicles, 2022.


A Two-Objective ILP Model of OP-MATSP for the Multi-Robot Task Assignment in an Intelligent Warehouse. Gao, J., Li, Y., Xu, Y., & Lv, S. Applied Sciences, 2022.


Rotating consensus for double-integrator multi-agent systems with communication delay. Shi, X., Li, Y., Yang, Y., Sun, B., & Li, Y.. ISA Transactions, 2021.


Online Extrinsic Parameter Calibration for Robotic Camera–Encoder System. Wang, X., Chen, H., Li, Y., & Huang, H. IEEE Transactions on Industrial Informatics, 2019.


Vision and laser fused SLAM in indoor environments with multi-robot system. Chen, H., Huang, H., Qin, Y., Li, Y., Liu, Y. Assembly Automation, 2019.


Coupling Based Estimation Approaches for the Average Reward Performance Potential in Markov Chains. Li, Y., Wu, X., Lou, Y., Chen, H., Li, J.. Automatica, 2018.


Motion Tracking of the Carotid Artery Wall From Ultrasound Image Sequences: a Nonlinear State-Space Approach. Gao, Z., Li, Y., Sun, Y., etc. IEEE Transactions on Medical Imaging, 2018.


Online optimization of dynamic power management. Zhai, J.-F., Li, Y.-J., Chen, H.-Y. Control Theory and Applications, 2018.


Autonomous wi-fi relay placement with mobile robots. Gao, Y., Chen, H., Li, Y., Lyu, C., Liu, Y. IEEE/ASME Transactions on Mechatronics, 2017.


A unified approach to time-aggregated Markov decision processes. Li, Y., Wu, X. Automatica, 2016.


A basic formula for performance gradient estimation of semi-Markov decision processes. Li, Y., Cao, F. European Journal of Operational Research, 2013.


Finding optimal memoryless policies of POMDPs under the expected average reward criterion. Li, Y., Yin, B., Xi, H. European Journal of Operational Research, 2011.


Partially observable Markov decision processes and performance sensitivity analysis. Li, Y., Yin, B., Xi, H. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 2008.




Conference Papers


An Environmental-Complexity-Based Navigation Method Based on Hierarchical Deep Reinforcement Learning. Chen P., Liu Q., Li Y., Ma S. IEEE International Conference on Robotics and Automation (ICRA), 2024.


Optimal Containment Control of Nonlinear MASs: A Time-Aggregation-Based Policy Iteration Algorithm. Shi X., Li Y., et al. IEEE Conference on Decision and Control (CDC), 2023.


Multi-Agent Path Finding with Time Windows: Preliminary Results. Gao J., Liu Q., Chen S., Yan K., Li X. & Li Y. International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2023.


Battery Management for Warehouse Robots via Average-Reward Reinforcement Learning. Mu, Y., Li, Y., Lin, K., Deng, K., & Liu, Q. In IEEE International Conference on Robotics and Biomimetics (ROBIO), 2022.


Multi-Robot Real-time Game Strategy Learning based on Deep Reinforcement Learning. Deng, K., Li, Y., Lu, S., Mu, Y., Pang, X., & Liu, Q. In IEEE International Conference on Robotics and Biomimetics (ROBIO), 2022.


Multi-agent Pathfinding with Communication Reinforcement Learning and Deadlock Detection. Ye, Z., Li, Y., Guo, R., Gao, J., & Fu, W. In Intelligent Robotics and Applications: 15th International Conference, (ICIRA), 2022.


Decision Making for Autonomous Driving Via Multimodal Transformer and Deep Reinforcement Learning. Fu, W., Li, Y., Ye, Z., & Liu, Q. In IEEE International Conference on Real-time Computing and Robotics (RCAR), 2022.


A Mapless Navigation Method Based on Reinforcement Learning and Local Obstacle Map. Pang, X., Li, Y., Liu, Q., and Deng, K.”,” 2022 China Automation Congress (CAC), Xiamen, China, 2022.


Exploration via Distributional Reinforcement Learning with Epistemic and Aleatoric Uncertainty Estimation. Liu, Q., Li, Y., Liu, Y., Chen, M., Lv, S., & Xu, Y. IEEE International Conference on Automation Science and Engineering, 2021.


Towards Autonomous Driving Decision by Combining Self-attention and Deep Reinforcement Learning. Chen, M., Li, Y., Liu, Q., Lv, S., Xu, Y., & Liu, Y. IEEE International Conference on Real-time Computing and Robotics, 2021.


Efficient Power Grid Topology Control via Two-Stage Action Search. Liu, Y., Li, Y., Liu, Q., Xu, Y., Lv, S., & Chen, M. International Conference on Intelligent Robotics and Applications, 2021.


A 3D Simulation Environment and Navigation Approach for Robot Navigation via Deep Reinforcement Learning in Dense Pedestrian Environment. Liu Q., Li Y. and Liu L. 2020 IEEE 16th International Conference on Automation Science and Engineering (CASE), 2020.


An Overview of Robust Reinforcement Learning. Chen, S., Li, Y. IEEE International Conference on Networking, Sensing and Control, 2020.


Robust identification of visual markers under boundary occlusion condition. Chang, R., Li, Y., Wu, C. IEEE International Conference on Robotics and Biomimetics, 2019.


Deep Reinforcement Learning Apply in Electromyography Data Classification. Song, C., Chen, C., Li, Y., Wu, X. IEEE International Conference on Cyborg and Bionic Systems, 2019.


A deep reinforcement learning algorithm with expert demonstrations and supervised loss and its application in autonomous driving. Liu, K., Wan, Q., Li, Y. Chinese Control Conference, 2018.


Visual Grasping for a Lightweight Aerial Manipulator Based on NSGA-II and Kinematic Compensation. Fang, L., Chen, H., Lou, Y., Li, Y., Liu, Y. IEEE International Conference on Robotics and Automation, 2018.


Singularity-Robust Hybrid Visual Servoing Control for Aerial Manipulator. Quan, F., Chen, H., Li, Y., …Chen, J., Liu, Y. IEEE International Conference on Robotics and Biomimetics, 2018.


A monocular vision localization algorithm based on maximum likelihood estimation. Chen, S., Li, Y., Chen, H. IEEE International Conference on Real-Time Computing and Robotics, 2018.


An Inverse Reinforcement Learning Algorithm for semi-Markov Decision Processes. Tan, C., Li, Y., Cheng, Y. IEEE International Conference on Information and Automation, 2018.


Online calibration for monocular vision and odometry fusion. Wang, X., Chen, H., Li, Y.** Proceedings of 2017 IEEE International Conference on Unmanned Systems, 2018.


A cross-coupled iterative learning control design for biaxial systems based on natural local approximation of contour error. Liu, S., Li, Y.** Chinese Control Conference, 2017.


The control of two-wheeled self-balancing vehicle based on reinforcement learning in a continuous domain. Xia, P., Li, Y.** Youth Academic Annual Conference of Chinese Association of Automation, 2017.


Face recognition based on convolutional neural network & support vector machine. Guo, S., Chen, S., Li, Y.** IEEE International Conference on Information and Automation, IEEE, 2017.


Real-Time tracking a ground moving target in complex indoor and outdoor environments with UAV. Chen, S., Guo, S., Li, Y.** IEEE International Conference on Information and Automation, 2017.


Average Reward Reinforcement Learning for Semi-Markov Decision Processes. Yang, J., Li, Y., Chen, H., Li, J. International Conference on Neural Information Processing, 2017.


Visual Servo Tracking Control of Quadrotor with a Cable Suspended Load. Jia, E., Chen, H., Li, Y., Lou, Y., Liu, Y. International Conference on Computer Vision Systems, 2017.


A semi-Markov decision process based dynamic power management for mobile devices. Zhang, M., Li, Y., Chen, H. IEEE International Conference on Real-Time Computing and Robotics, 2016.


Autonomous WiFi-relay control with mobile robots. Gao, Y., Chen, H., Li, Y., Liu, Y. IEEE International Conference on Real-Time Computing and Robotics, 2016.


Sample-path based performance sensitivity construction of semi-Markov systems. Li, Y., Zhang, J. Chinese Control Conference, 2016.


An online optimization for dynamic power management. Zhai, J., Li, Y., Chen, H. IEEE International Conference on Industrial Technology, 2016.


A Gradient Learning Optimization for Dynamic Power Management. Li, Y., Jiang, F. IEEE International Conference on Systems, Man, and Cybernetics, 2015.


Visual laser-SLAM in large-scale indoor environments. Liang, X., Chen, H., Li, Y., Liu, Y. 2016 IEEE International Conference on Robotics and Biomimetics, 2016.


An adaptive kalman filter to estimate state-of-charge of lithium-ion batteries. Luo, Z., Li, Y., Lou, Y. IEEE International Conference on Information and Automation, 2015.


A simulation study of control methods for three-phase energy storage inverter. Du, J., Li, Y., Lou, Y. IEEE International Conference on Information and Automation, 2015.


A unified approach for semi-Markov decision processes with discounted and average reward criteria. Li, Y., Wang, H., Chen, H. The World Congress on Intelligent Control and Automation (WCICA), 2015.


Auction-based multi-agent task assignment in smart logistic center. Guo, Y., Li, Y., Zhang, Y. Chinese Control Conference, 2014.


Convex optimization of battery energy storage station in a micro-grid. Zhang, R., Li, Y., Lou, Y. IEEE International Conference on Information and Automation, 2013.


Sensitivity-based inverse reinforcement learning. Tao, Z., Chen, Z., Li, Y.** Chinese Control Conference, 2013.


Performance analysis of a small-scale unmanned helicopter under large wind disturbance. Zeng, W., Zhu, X., Li, Y., Li, L. Chinese Control Conference, 2013.


An average reward performance potential estimation with geometric variance reduction. Li, Y. Chinese Control Conference, 2012.


An average-reward reinforcement learning algorithm based on Schweitzer’s Transformation. Li, J., Ren, J., Li, Y.** Chinese Control Conference, 2012.


Reinforcement learning algorithms for semi-Markov decision processes with average reward. Li, Y. IEEE International Conference on Networking, Sensing and Control, 2012


Less computational unscented Kalman filter for practical state estimation of small scale unmanned helicopters. Zeng, W., Zhu, X., Li, Y., Li, Z. IEEE International Conference on Robotics and Automation, 2011.


RVI reinforcement learning for Semi-Markov decision processes with average reward. Li, Y., Cao, F. The World Congress on Intelligent Control and Automation (WCICA), 2010.


An improvement of policy gradient estimation algorithms. Li, Y., Cao, F., Cao, X.-R. International Workshop on Discrete Event Systems, 2008.