Scalable Data Pipelines for Real-time Predictive Maintenance in Edge Computing Environments
DOI:
https://doi.org/10.63282/3050-922X.ICRCEDA25-130Keywords:
Predictive Maintenance, Edge Computing, Scalable Data Pipelines, Real-time Analytics, IoT, Stream Processing, Machine Learning, Industrial IoT (IIoT), Smart Manufacturing, Fault DetectionAbstract
Predictive maintenance leverages machine learning and real-time data analytics to anticipate equipment failures before they occur, thereby reducing downtime and optimizing operational efficiency. However, the deployment of such systems in edge computing environments introduces challenges related to latency, scalability, and resource constraints. This paper presents a scalable architecture for data pipelines that enables real-time predictive maintenance at the edge. We propose a modular pipeline design combining lightweight edge processing, efficient data streaming, and cloud-based model orchestration. The architecture is evaluated using industrial sensor data and edge devices in a simulated smart manufacturing environment. Our results demonstrate significant improvements in latency reduction, system scalability, and fault prediction accuracy, validating the effectiveness of the proposed approach for real-world edge deployments
References
[1] S. Zhang, L. Wang, and X. Zhang, "Predictive Maintenance for Industrial IoT Equipment Based on Machine Learning," IEEE Access, vol. 7, pp. 110110–110120, 2019.
[2] B. C. C. Marella and D. Kodi, “Generative AI for fraud prevention: A new frontier in productivity and green innovation,” In Advances in Environmental Engineering and Green Technologies, IGI Global, 2025, pp. 185–200
[3] Sahil Bucha, “Integrating Cloud-Based E-Commerce Logistics Platforms While Ensuring Data Privacy: A Technical Review,” Journal Of Critical Reviews, Vol 09, Issue 05 2022, Pages1256-1263.
[4] H. Yoon, Y. Lee, and J. Lee, "Toward Real-Time and Scalable Edge Computing for Industrial AI: Design and Implementation," IEEE Internet of Things Journal, vol. 8, no. 4, pp. 2345–2356, 2021.
[5] Kirti Vasdev. (2019). “GIS in Disaster Management: Real-Time Mapping and Risk Assessment”. International Journal on Science and Technology, 10(1), 1–8. https://doi.org/10.5281/zenodo.14288561
[6] Aragani, Venu Madhav and Maroju, Praveen Kumar and Mudunuri, Lakshmi Narasimha Raju, “Efficient Distributed Training through Gradient Compression with Sparsification and Quantization Techniques” (September 29, 2021). Available at SSRN: https://ssrn.com/abstract=5022841 or http://dx.doi.org/10.2139/ssrn.5022841
[7] A. Sultana et al., "A Survey on Edge Computing for the Industrial Internet of Things," IEEE Access, vol. 9, pp. 35791–35812, 2021.
[8] Anumolu, V. R., & Marella, B. C. C. (2025). Maximizing ROI: The Intersection of Productivity, Generative AI, and Social Equity. In Advancing Social Equity Through Accessible Green Innovation (pp. 373-386). IGI Global Scientific Publishing.
[9] Animesh Kumar, “Redefining Finance: The Influence of Artificial Intelligence (AI) and Machine Learning (ML)”, Transactions on Engineering and Computing Sciences, 12(4), 59-69. 2024.
[10] B. Yang, X. Jiang, and S. Wang, "Real-Time Anomaly Detection for IIoT Equipment Using Edge Intelligence," Sensors, vol. 20, no. 4, pp. 1122, 2020.
[11] Venu Madhav Aragani, Venkateswara Rao Anumolu, P. Selvakumar, “Democratization in the Age of Algorithms: Navigating Opportunities and Challenges,” in Democracy and Democratization in the Age of AI, IGI Global, USA, pp. 39-56, 2025.
[12] Divya K, “Efficient CI/CD Strategies: Integrating Git with automated testing and deployment”, World Journal of Advanced Research and Reviews: an International ISSN Approved Journal, vol.20, no.2, pp. 1517-1530, 2023.
[13] J. Gubbi, R. Buyya, S. Marusic, and M. Palaniswami, "Internet of Things (IoT): A Vision, Architectural Elements, and Future Directions," Future Generation Computer Systems, vol. 29, no. 7, pp. 1645–1660, 2013.
[14] Sudheer Panyaram, Muniraju Hullurappa, “Data-Driven Approaches to Equitable Green Innovation Bridging Sustainability and Inclusivity,” in Advancing Social Equity Through Accessible Green Innovation, IGI Global, USA, pp. 139-152, 2025.
[15] Puvvada, Ravi Kiran. "Industry-Specific Applications of SAP S/4HANA Finance: A Comprehensive Review." International Journal of Information Technology and Management Information Systems(IJITMIS) 16.2 (2025): 770-782.
[16] L. N. Raju Mudunuri, P. K. Maroju and V. M. Aragani, "Leveraging NLP-Driven Sentiment Analysis for Enhancing Decision-Making in Supply Chain Management," 2025 Fifth International Conference on Advances in Electrical, Computing, Communication and Sustainable Technologies (ICAECT), Bhilai, India, 2025, pp. 1-6, doi: 10.1109/ICAECT63952.2025.10958844.
[17] J. Xu, L. Liu, and Y. Zhang, "Design of Predictive Maintenance System Using Edge Analytics," Journal of Manufacturing Systems, vol. 55, pp. 268–278, 2020.
[18] P. Pulivarthy Enhancing Data Integration in Oracle Databases: Leveraging Machine Learning for Automated Data Cleansing, Transformation, and Enrichment International Journal of Holistic Management Perspectives, 4 (4) (2023), pp. 1-18
[19] Praveen Kumar Maroju, Venu Madhav Aragani (2025). Predictive Analytics in Education: Early Intervention and Proactive Support With Gen AI Cloud. Igi Global Scientific Publishing 1 (1):317-332.
[20] A. Ahmad et al., "Machine Learning Algorithms for Predictive Maintenance: A Review," Applied Sciences, vol. 10, no. 4, pp. 1484, 2020.
[21] Sahil Bucha, “Design And Implementation of An AI-Powered Shipping Tracking System For E-Commerce Platforms”, Journal of Critical Reviews, Vol 10, Issue 07, 2023, Pages. 588-596.
[22] Mohanarajesh, Kommineni (2024). Generative Models with Privacy Guarantees: Enhancing Data Utility while Minimizing Risk of Sensitive Data Exposure. International Journal of Intelligent Systems and Applications in Engineering 12 (23):1036-1044.
[23] P. Pierleoni, A. Belli, and L. Palma, "Edge-Cloud Architecture for Predictive Maintenance Using Industrial Sensors," IEEE Transactions on Industrial Informatics, vol. 17, no. 8, pp. 5462–5471, 2021.
[24] RK Puvvada . “SAP S/4HANA Finance on Cloud: AI-Powered Deployment and Extensibility” - IJSAT-International Journal on Science and …16.1 2025 :1-14.
[25] A High Gain DC-DC Converter with Maximum Power Point Tracking System for PV Applications - Sree Lakshmi Vineetha Bitragunta, Lakshmi Triveni Mallampati, Vijayavani Velagaleti - IJSAT Volume 10, Issue 2, PP- 1-2, April-June 2019. DOI 10.5281/zenodo.14473958
[26] C. Jiang, H. Liu, and J. Liu, "Lightweight Model Deployment for Edge Computing in Predictive Maintenance," IEEE Transactions on Industrial Electronics, vol. 69, no. 2, pp. 1835–1845, 2022.
[27] Kotte, K. R., & Panyaram, S. (2025). Supply Chain 4.0: Advancing Sustainable Business. Driving Business Success Through Eco-Friendly Strategies, 303.
[28] Bitragunta SLV. High Level Modeling of High-Voltage Gallium Nitride (GaN) Power Devices for Sophisticated Power Electronics Applications. J Artif Intell Mach Learn & Data Sci 2022, 1(1), 2011-2015. DOI: doi.org/10.51219/JAIMLD/sree- lakshmi-vineetha-bitragunta/442
[29] A. R. Sfar, E. Natalizio, Y. Challal, and Z. Chtourou, "A Roadmap for Security Challenges in the Industrial Internet of Things," Digital Communications and Networks, vol. 4, no. 2, pp. 113–131, 2018.
[30] Naga Ramesh Palakurti Vivek Chowdary Attaluri,Muniraju Hullurappa,comRavikumar Batchu,Lakshmi Narasimha Raju Mudunuri,Gopichand Vemulapalli, 2025, “Identity Access Management for Network Devices: Enhancing Security in Modern IT Infrastructure”, 2nd IEEE International Conference on Data Science And Business Systems.
[31] Praveen Kumar Maroju, "Assessing the Impact of AI and Virtual Reality on Strengthening Cybersecurity Resilience Through Data Techniques," Conference: 3rd International conference on Research in Multidisciplinary Studies Volume: 10, 2024.
[32] S. Panyaram, "Digital Transformation of EV Battery Cell Manufacturing Leveraging AI for Supply Chain and Logistics Optimization," International Journal of Innovations in Scientific Engineering, vol. 18, no. 1, pp. 78-87, 2023.
[33] Gopichand Vemulapalli, Padmaja Pulivarthy, “Integrating Green Infrastructure With AI-Driven Dynamic Workload Optimization: Focus on Network and Chip Design,” in Integrating Blue-Green Infrastructure Into Urban Development, IGI Global, USA, pp. 397-422, 2025.
[34] P. K. Maroju, "Empowering Data-Driven Decision Making: The Role of Self-Service Analytics and Data Analysts in Modern Organization Strategies," International Journal of Innovations in Applied Science and Engineering (IJIASE), vol. 7, Aug. 2021.
[35] Kommineni, M. "Explore Knowledge Representation, Reasoning, and Planning Techniques for Building Robust and Efficient Intelligent Systems." International Journal of Inventions in Engineering & Science Technology 7.2 (2021): 105- 114.
[36] Puvvada, R. K. (2025). Enterprise Revenue Analytics and Reporting in SAP S/4HANA Cloud. European Journal of Science, Innovation and Technology, 5(3), 25-40.
[37] Intelligent Power Feedback Control for Motor-Generator Pairs: A Machine Learning-Based Approach - Sree Lakshmi Vineetha Bitragunta - IJLRP Volume 5, Issue 12, December 2024, PP-1-9, DOI 10.5281/zenodo.14945799.
[38] R. Daruvuri, K. K. Patibandla, and P. Mannem, “Data Driven Retail Price Optimization Using XGBoost and Predictive Modeling”, in Proc. 2025 International Conference on Intelligent Computing and Control Systems (ICICCS), Chennai, India. 2025, pp. 838–843.
[39] Mohanarajesh Kommineni. (2023/6). Investigate Computational Intelligence Models Inspired By Natural Intelligence, Such As Evolutionary Algorithms And Artificial Neural Networks. Transactions On Latest Trends In Artificial Intelligence. 4. P30. Ijsdcs.
[40] P. K. Maroju, "Enhancing White Label ATM Network Efficiency: A Data Science Approach to Route Optimization with AI," FMDB Transactions on Sustainable Computer Letters, vol. 2, no. 1, pp. 40-51, 2024.
[41] Khan, S., Uddin, I., Noor, S. et al. “N6-methyladenine identification using deep learning and discriminative feature integration”. BMC Med Genomics 18, 58 (2025). https://doi.org/10.1186/s12920-025-02131-6.
[42] Vootkuri, C. Dynamic Threat Modeling For Internet-Facing Applications in Cloud Ecosystems.
[43] Venkata Krishna Reddy Kovvuri. (2024). Next-Generation Cloud Technologies: Emerging Trends In Automation And Data Engineering. International Journal Of Research In Computer Applications And Information Technology (Ijrcait),7(2),1499-1507.
[44] Singhal, S., Kothuru, S. K., Sethibathini, V. S. K., & Bammidi, T. R. (2024). ERP excellence a data governance approach to safeguarding financial transactions. Int. J. Manag. Educ. Sustain. Dev, 7(7), 1-18.