IRO Journal on Sustainable Wireless Systems
IRO Journals
Volume 4 — Issue 2 — June 2022

An Energy Efficient Routing Protocol based on Reinforcement Learning for WSN

https://doi.org/10.36548/jsws.2022.2.002
Judy Simon
Assistant Professor, Department of ECE, SRM Institute of Science and Technology, Ramapuram Campus, Chennai, India
PDF
PDF

How to Cite

Simon, Judy. 2022. “An Energy Efficient Routing Protocol Based on Reinforcement Learning for WSN”. IRO Journal on Sustainable Wireless Systems 4 (2): 79-89. https://doi.org/10.36548/jsws.2022.2.002.
ACM ACS APA ABNT Chicago Harvard IEEE MLA Turabian Vancouver AMA

Download Citation

Endnote/Zotero/Mendeley (RIS) BibTeX

Keywords

— Wireless sensor networks
— routing algorithm
— lifetime of the network and energy consumption
Published: 02-07-2022

Abstract

Wireless Sensor Network (WSN) seems to be critical because they are responsible for maintaining network routes, packet forwarding, and higher multi-hop connectivity. Clustering nodes is still a powerful technique for modelling routing protocol for WSNs, as it increases the range of communication services with energy efficiency. This paper focuses on the energy efficiency and improved lifetime of the network based on the reinforcement learning protocols. The system can adapt to network changes, such as energy efficiency, mobility and make better routing decisions attributable to Reinforcement Learning (RL). The legal restrictions on sensor nodes are taken into consideration and an energy-balancing routing model based upon reinforcement learning has been provided. The results show that the enhanced protocol outperforms the state of energy savings and network lifetime when compared to Q-learning and LARCMS energy-efficient routing protocols. The proposed protocol's effectiveness is analysed by end to end delivery and packet delivery.

References

  1. Kasim Al-Aubidy, A.W. Al Mutairi, and Ahmad Derbas. Real-time healthcare monitoring system using wireless sensor network. International Journal of Digital Signals and Smart Systems, 1:26, 01 2017. Jacques Bahi, Wiem Elghazel, Christophe Guyeux, M
  2. C. G. Cassandras, T. Wang, and S. Pourazarm. Optimal routing and energy allocation for lifetime maximization of wireless sensor networks with nonideal batteries. IEEE Transactions on Control of Network Systems, 1(1):86–98, March 2014
  3. H. Yetgin, K. T. K. Cheung, M. El-Hajjar, and L. H. Hanzo. A survey of network lifetime maximization techniques in wireless sensor networks. IEEE Communications Surveys Tutorials, 19(2):828–854, Secondquarter 2017.
  4. M. S. Obaidat and S. Misra, Inside a wireless sensor node: structure and operations, ch. 2, p. 14–29. Cambridge University Press, 2014.
  5. K. Akkaya and M. Younis, ‘‘A survey on routing protocols for wireless sensor networks,’’ Ad Hoc Netw., vol. 3, no. 3, pp. 325–349, May 2005, doi: 10.1016/j.adhoc.2003.09.010.
  6. A. Elwhishi, Pin-Han Ho, K. Naik, and B. Shihada. Arbr: Adaptive reinforcement-based routing for dtn. In 2010 IEEE 6th International Conference on Wireless and Mobile Computing, Networking and Communications, pages 376–385, Oct 20.
  7. Yau, KL.A., Goh, H.G., Chieng, D. et al. Application of reinforcement learning to wireless sensor networks: models and algorithms. Computing 97, 1045–1075 (2015).
  8. W. -K. Yun and S. -J. Yoo, "Q-Learning-Based Data-Aggregation-Aware Energy-Efficient Routing Protocol for Wireless Sensor Networks," in IEEE Access, vol. 9, pp. 10737-10750, 2021, doi: 10.1109/ACCESS.2021.3051360.
  9. Liang X, Balasingham, I, Byun SS. A multi-agent reinforcement learning based routing protocol for wireless sensor networks. Proceedings of IEEE International Symposium on Wireless Communication Systems. 2008 Oct; 552-557; Reykjavic, Iceland. DOI: 10.1109/ISWCS.2008.4726117.
  10. Oddi G, Pietrabissa A, Liberati F. Energy balancing in multi-hop Wireless Sensor Networks: an approach based on reinforcement learning. Proceedings of 2014 NASA/ESA Conference on Adaptive Hardware and Systems (AHS). 2014 July; 262-269; Leicester, UK. DOI: 10.1109/AHS.2014.6880186.
  11. Wenjing Guo, Cairong Yan, and Ting Lu. Optimizing the lifetime of wireless sensor networks via reinforcement-learning-based routing. International Journal of Distributed Sensor Networks, 15(2):1550147719833541, 2019.
  12. Arora VK, Sharma V, Sachdeva M (2019) A distributed, multihop, adaptive, tree-based energy-balanced routing approach. Int J Commun Syst 32(9)
  13. Bhola J, Soni S, Cheema GK (2020) Genetic algorithm based optimized leach protocol for energy efficient wireless sensor networks. J Ambient Intell Humaniz Comput 11(3):1281–1288
  14. Bendigeri KY, Mallapur JD, Kumbalavati SB (2021) Direction Based Node Placement in Wireless Sensor Network. In 2021, International Conference on Artificial Intelligence and Smart Systems (ICAIS), pp 1306–1313. IEEE
  15. Maheshwari P, Sharma AK, Verma K (2021) Energy efficient cluster based routing protocol for WSN using butterfly optimization algorithm and ant colony optimization. Ad Hoc Netwo 110:102317
  16. M. Najimi, A. Ebrahimzadeh, S. M. H. Andargoli, and A. Fallahi. Lifetime maximization in cognitive sensor networks based on the node selection. IEEE Sensors Journal, 14(7):2376–2383, July 2014.
  17. Soni S, Shrivastava M. Novel learning algorithms for efficient mobile sink data collection using reinforcement learning in wireless sensor network. Wireless Communications and Mobile Computing. 2018 Aug 16;2018.
  18. Chen H, Li X, Zhao F. A reinforcement learning-based sleep scheduling algorithm for desired area coverage in solar-powered wireless sensor networks. IEEE Sensors Journal. 2016 Jan 12;16(8):2763-74
  19. Birajdar DM, Solapure SS. LEACH: An energy efficient routing protocol using Omnet++ for Wireless Sensor Network. In2017 International Conference on Inventive Communication and Computational Technologies (ICICCT) 2017 Mar 10 (pp. 465-470)
  20. Hu Z, Wang Z, Wang J, Zeng T. Routing Protocol for Wireless Sensor Network Based on Automatic Cluster Optimization. International Journal of Online and Biomedical Engineering (iJOE). 2018 Dec 23;14(12):150-63.
  21. Kumar, Ashok. (2019). Improving reporting delay and lifetime of a WSN using controlled mobile sinks. Journal of Ambient Intelligence and Humanized Computing. 10. 1-9. 10.1007/s12652-018-0901-5..