A Reinforcement Learning Review: Past Acts, Present Facts and Future Prospects

Authors

  • Benjamin Kommey Department of Computer Engineering, Kwame Nkrumah University of Science and Technology
  • Oniti Jesutofunmi Isaac Department of Computer Engineering, Kwame Nkrumah University of Science and Technology
  • Elvis Tamakloe Department of Computer Engineering, Kwame Nkrumah University of Science and Technology
  • Daniel Opoku4 Department of Computer Engineering, Kwame Nkrumah University of Science and Technology

DOI:

https://doi.org/10.25299/itjrd.2023.13474

Keywords:

Reinforcement Learning, Machine Learning, Artificial Intelligence, Deep Learning, Supervised Learning

Abstract

Reinforcement Learning (RL) is fast gaining traction as a major branch of machine learning, its applications have expanded well beyond its typical usage in games. Several subfields of reinforcement learning like deep reinforcement learning and multi-agent reinforcement learning are also expanding rapidly. This paper provides an extensive review on the field from the point of view of Machine Learning (ML). It begins by providing a historical perspective on the field then proceeds to lay a theoretical background on the field. It further discusses core reinforcement learning problems and approaches taken by different subfields before discussing the state of the art in the field. An inexhaustive list of applications of reinforcement learning is provided and their practicability and scalability assessed. The paper concludes by highlighting some open areas or issues in the field

Downloads

Download data is not yet available.

References

J. T. Sri Suma A. Hammoudeh, "A concise introduction to reinforcement learning," Princess Suamaya University for Technology: Amman, Jordan 2018.

R. Sutton, A. G. Barto, 2nd ed. in progress, and M. The MIT Press: Cambridge, USA, "Chapter 1 The Reinforcement Learning Problem," pp. 1-25, 2017.

L. Tai and M. Liu, "Towards cognitive exploration through deep reinforcement learning for mobile robots," 2016.

L. Buşoniu, Lucian, Robert Babuška, and B. De Schutter, “Multi-agent reinforcement learning: An overview,” Chapter 7 in Innovations in Multi-Agent Systems and Applications – 1 (D. Srinivasan and L.C. Jain, eds.), vol. 310 of Studies in Computational Intelligence, Berlin, Germany: Springer, pp. 183–221, 2010.

V. Cherkassky and F. Mulier, Learning from Data Concepts, theory, and methods. New York: J. Wiley, 1998.

G. Hinton and T. J. Sejnowski, Unsupervised learning: foundations of neural computation. MIT press, 1999.

L. P. Kaelbling, M. L. Littman, and A. W. Moore, “Reinforcement learning: A survey,” Journal of Artificial Intelligence Research, vol. 4, pp. 237–285, 1996.

Kaelbling L. P., Littman M. L., Moore A. W. Reinforcement Learning: A Survey, 1996, J. Artif. Intell. Res.

Agostinelli F., Hocquet G., Singh S., Baldi P. (2018) From Reinforcement Learning to Deep Reinforcement Learning: An Overview. In: Rozonoer L., Mirkin B., Muchnik I. (eds) Braverman Readings in Machine Learning. Key Ideas from Inception to Current State. Lecture Notes in Computer Science, vol 11100. Springer, Cham.

Benjamin Recht, A Tour of Reinforcement Learning: The View from Continuous Control (2019). Annu. Rev. Control Robot. Auton. Syst. 2019.2:253–79

Yi, Fengji; Fu, Wenlong; and Liang, Huan,” Model-based reinforcement learning: A survey” (2018). ICEB 2018 Proceedings. 60. https://aisel.aisnet.org/iceb2018/60

K. Arulkumaran, M. P. Deisenroth, M. Brundage and A. A. Bharath,” Deep Reinforcement Learning: A Brief Survey,” in IEEE Signal Processing Magazine, vol. 34, no. 6, pp. 26-38, Nov. 2017, doi: 10.1109/MSP.2017.2743240.

Mousavi, Sajad & Schukat, Michael & Howley, Enda. (2018). Deep Reinforcement Learning: An Overview. Lecture Notes in Networks and Systems. 426-440. 10.1007/978-3-319-56991-8 32.

Yuxi Li, Deep Reinforcement Learning: An Overview. CORR, abs/1701.07274 2017.

Ghavamzadeh, Mohammed et al. “Convex Optimization: Algorithms and Complexity.” Foundations and Trends in Machine Learning 8.5-6 (2015): 359–483. Crossref. Web.

L. Bu¸soniu, D. Ernst, B. De Schutter and R. Babuˇska,” Approximate reinforcement learning: An overview,” 2011 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), Paris, 2011, pp. 1-8, doi: 10.1109/ADPRL.2011.5967353.

L. Busoniu, R. Babuska and B. De Schutter, ”A Comprehensive Survey of Multiagent Reinforcement Learning,” in IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol. 38, no. 2, pp. 156-172, March 2008, doi: 10.1109/TSMCC.2007.913919.

Bu¸soniu L., Babuˇska R., De Schutter B. (2010) Multi-agent Reinforcement Learning: An Overview. In: Srinivasan D., Jain L.C. (eds) Innovations in Multi-Agent Systems and Applications - 1. Studies in Computational Intelligence, vol 310. Springer, Berlin, Heidelberg

Hernandez-Leal, P., Kartal, B. & Taylor, M.E. A survey and critique of multiagent deep reinforcement learning. Auton Agent Multi-Agent Syst 33, 750–797 (2019). https://doi.org/10.1007/s10458- 019-09421-1

Y. Choi and H. Ahn,” A survey on multi-agent reinforcement learning: Coordination problems,” Proceedings of 2010 IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications, Qingdao, 2010, pp. 81-86, doi: 10.1109/MESA.2010.5552089.

Kober, J., Bagnell, J. A., & Peters, J. (2013). Reinforcement learning in robotics: A survey. The International Journal of Robotics Research, 32(11), 1238–1274. https://doi.org/10.1177/0278364913495721

Polydoros, A.S., Nalpantidis, L. Survey of Model-Based Reinforcement Learning: Applications on Robotics. J Intell Robot Syst 86, 153–173 (2017). https://doi.org/10.1007/s10846-017-0468-y

Kun Shao, Zhentao Tang, Yuanheng Zhu, Nannan Li and Dongbin Zhao. A Survey of Deep Reinforcement Learning in Video Games, (2019).

M. Mahmud, M. S. Kaiser, A. Hussain and S. Vassanelli,” Applications of Deep Learning and Reinforcement Learning to Biological Data,” in IEEE Transactions on Neural Networks and Learning Systems, vol. 29, no. 6, pp. 2063-2079, June 2018, doi: 10.1109/TNNLS.2018.2790388.

Chao Yu and Jiming Liu and Shamim Nemati, Reinforcement Learning in Healthcare: A Survey (2019).

A. El Gourari, M. Raoufi, M. Skouri, and F. Ouatik, “The implementation of deep reinforcement learning in e-learning and distance learning: Remote practical work,” Mobile Information Systems, vol. 2021, pp. 1–11, 2021.

A. L. C. Bazzan and F. Klügl, “Introduction to Intelligent Systems in Traffic and Transportation”, vol. 7, no. 3. 2013

M. Lauer, "An algorithm for distributed reinforcement learning in cooperative multiagent systems." In Proc. 17th International Conf. on Machine Learning. 2000.

B. Price and C. Boutilier, “Accelerating reinforcement learning through implicit imitation,” Journal of Artificial Intelligence Research, vol. 19, pp. 569–629, 2003.

D. Fudenberg and D. K. Levine, The theory of learning in games. Cambridge, Mass.: MIT Press, 1998.

Y. Shoham, R. Powers, and T. Grenager, “If multi-agent learning is the answer, what is the question?,” Artificial Intelligence, vol. 171, no. 7, pp. 365–377, 2007.

G. Pahl, W. Beitz, Engineering Design: A Systematic Approach, Springer Science & Business Media, 2013.

J. Viquerat, J. Rabault, A. Kuhnle, H. Ghraieb, A. Larcher, and E. Hachem, “Direct shape optimization through deep reinforcement learning,” Journal of Computational Physics, vol. 428, p. 110080, 2021.

F. Dworschak, S. Dietze, M. Wittmann, B. Schleich, and S. Wartzack, “Reinforcement learning for engineering design automation,” Advanced Engineering Informatics, vol. 52, p. 101612, 2022.

A. Belmonte-Baeza, J. Lee, G. Valsecchi, and M. Hutter, “Meta reinforcement learning for optimal design of Legged Robots,” IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 12134–12141, 2022.

C. Semini, N. G. Tsagarakis, E. Guglielmino, M. Focchi, F. Cannella, and D. G. Caldwell, “Design of hyq – a hydraulically and electrically actuated quadruped robot,” Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering, vol. 225, no. 6, pp. 831–849, 2011.

F. Ouatik, M. Raoufi, M. El Mohadab, F. Ouatik, B. Bouikhalene, and M. Skouri, “Modeling collaborative practical work processes in an e-learning context of engineering electric education,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 16, no. 3, p. 1464, 2019.

A. W. Moore and C. G. Atkeson, “Prioritized sweeping: Reinforcement learning with less data and less time,” Machine Learning, vol. 13, no. 1, pp. 103–130, 1993.

R. S. Sutton, “Integrated Architectures for learning, planning, and reacting based on approximating dynamic programming,” Machine Learning Proceedings 1990, pp. 216–224, 1990.

D. Silver, “Deep reinforcement learning,” in International Conference on Machine Learning (ICML), 2016.

N. D. Daw, S. J. Gershman, B. Seymour, P. Dayan, and R. J. Dolan, “Model-based influences on humans' choices and striatal prediction errors,” Neuron, vol. 69, no. 6, pp. 1204–1215, 2011.

B. H. Abed-alguni, S. K. Chalup, F. A. Henskens, and D. J. Paul, “A multi-agent cooperative reinforcement learning model using a hierarchy of consultants, tutors and workers,” Vietnam Journal of Computer Science, vol. 2, no. 4, pp. 213–226, 2015.

M. Van Otterlo and M. Wiering, "Reinforcement learning and Markov decision processes," pp. 3-42, 2012.

D. Silver, R. S. Sutton, and M. Müller, "Reinforcement Learning of Local Shape in the Game of Go," in IJCAI, 2007, vol. 7, pp. 1053-1058.

D. A. Berry, B. J. L. C. Fristedt, and Hall, "Bandit problems: sequential allocation of experiments (Monographs on statistics and applied probability)," vol. 5, no. 71-87, pp. 7-7, 1985.

Y. Shoham and K. Leyton-Brown, Multiagent systems: Algorithmic, game-theoretic, and logical foundations. Cambridge University Press, 2008.

N. Vlassis, "A concise introduction to multiagent systems and distributed artificial intelligence," vol. 1, no. 1, pp. 1-71, 2007.

G. Weiss, Multiagent systems: a modern approach to distributed artificial intelligence. MIT press, 1999.

H. V. D. Parunak, "Industrial and practical applications of DAI," pp. 377-421, 1999.

G. Tesauro, J. O. Kephart, "Pricing in agent economies using multi-agent Q-learning," vol. 5, pp. 289-304, 2002.

P. Stone and M. Veloso, "Multiagent systems: A survey from a machine learning perspective," vol. 8, pp. 345-383, 2000.

B. Bakker, M. Steingrover, R. Schouten, E. Nijhuis, and L. Kester, "Cooperative multi-agent reinforcement learning of traffic lights," 2005.

M. Tan, "Multi-agent reinforcement learning: Independent vs. cooperative agents," in Proceedings of the tenth international conference on machine learning, 1993, pp. 330-337.

L. Busoniu, B. De Schutter, and R. Babuska, "Multiagent Reinforcement Learning with Adaptive State Focus," in BNAIC, 2005, pp. 35-42: Citeseer.

C. Guestrin, M. Lagoudakis, and R. Parr, "Coordinated reinforcement learning," in ICML, 2002, vol. 2, pp. 227-234: Citeseer.

P. Osinenko, D. Dobriborsci, and W. J. I.-P. Aumer, "Reinforcement learning with guarantees: a review," vol. 55, no. 15, pp. 123-128, 2022.

C. J. C.H. Watkins, "Learning from delayed rewards." (1989).

C.J.C.H. Watkins and P. Dayan, “Q-learning,” Machine Learning, vol. 8, no. 3-4, pp. 279–292, 1992.

G. A. Rummery and M. Niranjan, On-line Q-learning using connectionist systems. University of Cambridge, Department of Engineering Cambridge, UK, 1994.

G. Tesauro, "Temporal difference learning and TD-Gammon," vol. 38, no. 3, pp. 58-68, 1995.

S. C. Chan, S. Fishman, J. Canny, A. Korattikara, and S. Guadarrama, "Measuring the reliability of reinforcement learning algorithms," 2019.

Y. Duan, X. Chen, R. Houthooft, J. Schulman, and P. Abbeel, "Benchmarking deep reinforcement learning for continuous control," in International conference on machine learning, 2016, pp. 1329-1338: PMLR.

M. Fortunato et al., "Noisy networks for exploration," 2017.

M. G. Bellemare, W. Dabney, and R. Munos, "A distributional perspective on reinforcement learning," in International conference on machine learning, 2017, pp. 449-458: PMLR.

S. Jordan, Y. Chandak, D. Cohen, M. Zhang, and P. Thomas, "Evaluating the performance of reinforcement learning algorithms," in International Conference on Machine Learning, 2020, pp. 4962-4973: PMLR.

M. El Fouki, N. Aknin, and K. E. El. Kadiri, "Intelligent adapted e-learning system based on deep reinforcement learning," in Proceedings of the 2nd International Conference on Computing and Wireless Communication Systems, 2017, pp. 1-6

M. Agrebi, M. Sendi, and M. Abed, "Deep reinforcement learning for personalized recommendation of distance learning," in New Knowledge in Information Systems and Technologies: Volume 2, 2019, pp. 597-606: Springer.

Z. Shahbazi and Y. C. Byun, "Toward social media content recommendation integrated with data science and machine learning approach for E-learners," vol. 12, no. 11, p. 1798, 2020.

M. Chadwick, H. Kolvenbach, F. Dubois, H. F. Lau, M. Hutter, "Vitruvio: An open-source leg design optimization toolbox for walking robots," vol. 5, no. 4, pp. 6318-6325, 2020.

C. Finn, P. Abbeel, and S. Levine, "Model-agnostic meta-learning for fast adaptation of deep networks," in international conference on machine learning, 2017, pp. 1126-1135: PMLR.

W. S. Cleveland and S. Devlin, "Locally weighted regression: an approach to regression analysis by local fitting," vol. 83, no. 403, pp. 596-610, 1988.

A. W. Moore and C. G. Atkeson, "An investigation of memory-based function approximators for learning control," Tech. rep., MIT Arti cal Intelligence Laboratory, Cambridge, MA1992.

A. Sage and C. C. White, "Optimum systems control. Prentice Hall," 1977.

S. Mahadevan and J. Connell, "Automatic programming of behavior-based robots using reinforcement learning," vol. 55, no. 2-3, pp. 311-365, 1992.

S. Shalev-Shwartz, S. Shammah, and A. Shashua, "Safe, multi-agent, reinforcement learning for autonomous driving," 2016.

P. Maramotti, A. P. Capasso, G. Bacchiani, and A. Broggi, "Tackling Real-World Autonomous Driving using Deep Reinforcement Learning," in 2022 IEEE Intelligent Vehicles Symposium (IV), 2022, pp. 1274-1281: IEEE.

P. Wang, C. Y. Chan, and A. De La Fortelle, "A reinforcement learning based approach for automated lane change maneuvers," in 2018 IEEE Intelligent Vehicles Symposium (IV), 2018, pp. 1379-1384: IEEE.

C.J. Hoel, K. Wolff, and L. Laine, "Automated speed and lane change decision making using deep reinforcement learning.," presented at the 21st International Conference, Intelligent Transportation Systems (ITSC), 2018

B. Mirchevska, C. Pek, M. Werling, M. Althoff, and J. Boedecker, "High-level decision making for safe and reasonable autonomous lane changing using reinforcement learning," in 2018 21st International Conference on Intelligent Transportation Systems (ITSC), 2018, pp. 2156-2162: IEEE.

A. E. Sallab, M. Abdou, E. Perot, and S. J. a. p. a. Yogamani, "End-to-end deep reinforcement learning for lane keeping assist," 2016.

A. Feher, S. Aradi, and T. Becsi, "Q-learning based reinforcement learning approach for lane keeping," in 2018 IEEE 18th International Symposium on Computational Intelligence and Informatics (CINTI), 2018, pp. 000031-000036: IEEE.

M. Kaushik, V. Prasad, K. M. Krishna, and B. Ravindran, "Overtaking maneuvers in simulated highway driving using deep reinforcement learning," in 2018 IEEE intelligent vehicles symposium (iv), 2018, pp. 1885-1890: IEEE.

L. García Cuenca, E. Puertas, J. Fernandez Andrés, and N. Aliane, "Autonomous driving in roundabout maneuvers using reinforcement learning with Q-learning," vol. 8, no. 12, p. 1536, 2019

A. P. Capasso, G. Bacchiani, and D. Molinari, "Intelligent roundabout insertion using deep reinforcement learning," 2020.

V. Mnih et al., "Asynchronous methods for deep reinforcement learning," in International conference on machine learning, 2016, pp. 1928-1937: PMLR.

A. P. Capasso, G. Bacchiani, and A. Broggi, "From simulation to real world maneuver execution using deep reinforcement learning," in 2020 IEEE Intelligent Vehicles Symposium (IV), 2020, pp. 1570-1575: IEEE.

A. P. Capasso, P. Maramotti, A. Dell'Eva, and A. Broggi, "End-to-end intersection handling using multi-agent deep reinforcement learning," in 2021 IEEE Intelligent Vehicles Symposium (IV), 2021, pp. 443-450: IEEE.

E. W. Saad, D. V. Prokhorov, and D. C. Wunsch, "Comparative study of stock trend prediction using time delay, recurrent and probabilistic neural networks," vol. 9, no. 6, pp. 1456-1470, 1998.

Y. Deng, F. Bao, Y. Kong, Z. Ren, Q. Dai, and l. systems, "Deep direct reinforcement learning for financial signal representation and trading," vol. 28, no. 3, pp. 653-664, 2016.

P. N. Kolm and G. Ritter, "Modern perspectives on reinforcement learning in finance," vol. 1, no. 1, 2020.

X.Y. Liu, H. Yang, J. Gao, and C. D. Wang, "FinRL: Deep reinforcement learning framework to automate trading in quantitative finance," in Proceedings of the Second ACM International Conference on AI in Finance, 2021, pp. 1-9.

H. Buehler, L. Gonon, J. Teichmann, B. Wood, B. Mohan, and J. Kochems, “Deep hedging: Hedging derivatives under generic market frictions using reinforcement learning”, Swiss Finance Institute Research Paper 19-80, 2019.

X.-Y. Liu, Z. Xiong, S. Zhong, H. Yang, and A. Walid, “Practical deep reinforcement learning approach for stock trading”, NeurIPS Workshop (2018).

H. Yang, X.-Y. Liu, S. Zhong, and A. Walid, "Deep reinforcement learning for automated stock trading: An ensemble strategy," in Proceedings of the first ACM International Conference on AI in Finance, 2020, pp. 1-8.

N. Vadori, S. Ganesh, P. Reddy, and M. Veloso, "Risk-sensitive reinforcement learning: a martingale approach to reward uncertainty," in Proceedings of the First ACM International Conference on AI in Finance, 2020, pp. 1-9.

Z. Jiang, D. Xu, and J. Liang, "A deep reinforcement learning framework for the financial portfolio management problem," 2017.

S. Bekiros, "Fuzzy adaptive decision-making for boundedly rational traders in speculative stock markets," vol. 202, no. 1, pp. 285-293, 2010.

Y. Zhang and X. Yang, "Online portfolio selection strategy based on combining experts’ advice," vol. 50, pp. 141-159, 2017.

Z. Jiang and J. Liang, "Cryptocurrency portfolio management with deep reinforcement learning," in 2017 Intelligent Systems Conference (IntelliSys), 2017, pp. 905-913: IEEE.

Samuel, A. L. 1959. Some studies in machine learning using the game of checkers. IBM Journal of Research and Development 3:211–229. Reprinted in E. A. Feigenbaum and J. Feldman, editors, Computers and Thought, McGraw-Hill, New York 1963.

J. A. Boyan, Modular neural networks for learning context-dependent game strategies. University of Cambridge. Computer Laboratory, 1992.

G. J. Tesauro, D. Lippman, and S. Hanson, "Practical issues in temporal difference," pp. 259-266, 1992.

N. N. Schraudolph, P. Dayan, and T. J. Sejnowski, "Using the td (lambda) algorithm to learn an evaluation function for the game of go," vol. 6, 1994.

M. L. Littman, "Markov games as a framework for multi-agent reinforcement learning," in Machine learning proceedings 1994: Elsevier, 1994, pp. 157-163.

D. Silver, R. S. Sutton, and M. Müller, "Reinforcement Learning of Local Shape in the Game of Go," in IJCAI, 2007, vol. 7, pp. 1053-1058.

M. Campbell, A. Hoane, and F. Hsu. Deep Blue. Artificial Intelligence, 134:57–83, 2002.

J. Schaeffer, J. Culberson, N. Treloar, B. Knight, P. Lu, and D. Szafron, "A World Championship Caliber Checkers Program," vol. 53, no. 2-3, pp. 273-289, 1992.

B. Sheppard, "World-championship-caliber Scrabble," vol. 134, no. 1-2, pp. 241-275, 2002.

D. Silver et al., "Mastering the game of Go with deep neural networks and tree search," vol. 529, no. 7587, pp. 484-489, 2016.

D. Silver et al., "Mastering chess and shogi by self-play with a general reinforcement learning algorithm," 2017.

D. Wu, Y. Lei, M. He, C. Zhang, L. Ji, and M. Computing, "Deep reinforcement learning-based path control and optimization for unmanned ships," vol. 2022, pp. 1-8, 2022.

H. Xu, N. Wang, H. Zhao, and Z. J. C.-P. S. Zheng, "Deep reinforcement learning-based path planning of underactuated surface vessels," vol. 5, no. 1, pp. 1-17, 2019.

D.H. Chun, M.I. Roh, H.-W. Lee, J. Ha, and D. Yu, "Deep reinforcement learning-based collision avoidance for an autonomous ship," vol. 234, p. 109216, 2021.

K. Duan, S. Fong, and C. L. P. Chen, "Reinforcement learning based model-free optimized trajectory tracking strategy design for an AUV," vol. 469, pp. 289-297, 2022.

X. Lu, C. Zhai, V. Gopalakrishnan, and B. Buchanan, "Automatic annotation of protein motif function with Gene Ontology terms," vol. 5, pp. 1-11, 2004.

V. N. Sichkar, "Reinforcement learning algorithms in global path planning for mobile robot," in 2019 International Conference on Industrial Engineering, Applications and Manufacturing (ICIEAM), 2019, pp. 1-5: IEEE.

B. Wang, Z. Liu, Q. Li, A. J. I. R. Prorok, and A. Letters, "Mobile robot path planning in dynamic environments through globally guided reinforcement learning," vol. 5, no. 4, pp. 6932-6939, 2020.

R. Smierzchalski and Z. Michalewicz, "Path planning in dynamic environments," in Innovations in Robot Mobility and Control: Springer, 2005, pp. 135-153.

S. Carta, A. Corriga, A. Ferreira, A. S. Podda, and D. R. Recupero, "A multi-layer and multi-ensemble stock trader using deep learning and deep reinforcement learning," vol. 51, pp. 889-905, 2021.

S. Balhara, N. Gupta, A. Alkhayyat, I. Bharti, R.Q. Malik, S.N. Mahmood and F. Abedi, "A survey on deep reinforcement learning architectures, applications and emerging trend."IET Communications, pp: 1-16. 2022. doi: 10.1049/cmu2.12447.

M.-L. Li, S. Chen and J. Chen, "Adaptive Learning: A New Decentralized Reinforcement Learning Approach for Cooperative Multiagent Systems." IEEE Access, vol.8, pp: 99404-99421. 2020. doi: 10.1109/ACCESS.2020.2997899.

R. Upadhyay, R. Phlypo, R. Saini and M. Liwicki, "Sharing-to-learn and learning to share; Fitting together Meta, Multi-Task, and Transfer Learning: A meta review." Journal of IEEE Transactions on Artificial Intelligence, vol. 00, no. 0, pp: 1-21. 2023. doi: 10.48550/arXiv.2111.12146.

D. Yang, X. Qin, X. Xu, C. Li and G. Wei, "Sample Efficient Reinforcement Learning Method via High Efficient Episodic Memory." IEEE Access, vol. 8, pp: 129274-129284, 2020. doi: 10.1109/ACCESS.2020.3009329.

D.W. Jeong, S.J. Yoo and Y.H. Gu, "Safety AARL: Weight adjustment for reinforcement-learning-based safety dynamic asset allocation strategies." Expert Systems with Applications, vol. 227, pp: 1-13. 2023. doi: 10.1016/j.eswa.2023.120297.

Y. Yu, "Towards Sample Efficient Reinforcement Learning." Proceeding of the Twenty-Seventh International Joint Conference on Artificial Intelligence (IJCAI-18), pp: 5739-5743, 2018.

S.E. Ada, E. Ugur and H.L. Akin, "Generalization in Transfer Learning." arXiv preprint, pp: 1-19. 2019. doi: 10.48550/arXiv.1909.01331.

M. Xu, Z. Liu, P. Huang, W. Ding, Z. Cen, B. Li and D. Zhao, "Trustworthy Reinforcement Learning Against Intrinsic Vulnerabilities: Robustness, Safety and Generalizability." arXiv preprint, pp:1-36. 2022. doi: 10.48550/arXiv.2209.08025.

P. Ladosz, L. Weng, M. Kim and H. Oh, "Exploration in deep reinforcement learning: A survey." Information Fusion, vol. 85, pp: 1-22. 2022. doi: 10.1016/j.inffus.2022.03.003.

J. Hao, T. Yang, H. Tang, C. Bai, J. Liu, Z. Meng, P. Liu and Z. Wang, "Exploration in Deep Reinforcement Learning: From Single-Agent to Multi-Agent Domain." IEEE Transactions on Neural Networks and Learning Systems, pp: 1-24. 2023. doi: 10.1109/TNNLS.2023.3236361.

A. Plaat, W. Kosters and M. Preuss, "Model-Based Deep Reinforcement Learning for High-Dimensional Problems, a Survey." arXiv preprint, pp: 1-22. 2020. doi: 10.48550/arXiv.2008.05598.

Downloads

Published

2024-02-15

How to Cite

Kommey, B., Isaac, O. J., Tamakloe, E., & Opoku4, D. (2024). A Reinforcement Learning Review: Past Acts, Present Facts and Future Prospects . IT Journal Research and Development, 8(2), 120–142. https://doi.org/10.25299/itjrd.2023.13474

Issue

Section

Review Article