Enhancing Digital Twins With Deep Reinforcement Learning: A Use Case in Maintenance Prioritization
Paper i proceeding, 2024

This paper introduces an innovative framework that enhances digital twins with deep reinforcement learning (DRL) to support maintenance in manufacturing systems. Utilizing a sophisticated artificial intelligence (AI) layer, this framework integrates real-time and historical production data from a physical manufacturing system to a digital twin, enabling dynamic simulation and analysis. Maintenance decisions are informed by DRL algorithms that analyze this data, facilitating smart maintenance strategies that adaptively prioritize tasks based on predictive analytics. The effectiveness of this approach is demonstrated through a case study in a lab-scale drone factory, where maintenance tasks are prioritized using a proximal policy optimization. This integration not only refines maintenance decisions but also aligns with the broader goals of operational efficiency and sustainability in Industry 4.0. Our results highlight the potential of combining DRL with digital twins to significantly enhance decision-making in industrial maintenance, offering a novel approach to predictive and prescriptive maintenance practices.

Digital twins

Maitenance Prioritization

Predictive Maintenance

Deep Reinforcement Learning

Författare

Siyuan Chen

Chalmers, Industri- och materialvetenskap, Produktionssystem

Paulo Victor Lopes

Chalmers, Industri- och materialvetenskap, Produktionssystem

Silvan Marti

Chalmers, Industri- och materialvetenskap, Produktionssystem

Mohan Rajashekarappa

Chalmers, Industri- och materialvetenskap, Produktionssystem

Sunith Bandaru

Högskolan i Skövde

Christina Windmark

Lunds universitet

Jon Bokrantz

Chalmers, Industri- och materialvetenskap, Produktionssystem

Anders Skoogh

Maskinteknik, mekatronik och automatisering, teknisk design samt sjöfart och marin teknik

Proceedings - Winter Simulation Conference

08917736 (ISSN)

1611-1622 10838867
979-8-3315-3421-9 (ISBN)

2024 Winter Simulation Conference (WSC)
Orlando, USA,

Integrated Manufacturing Analytics Platform för Prediktivt Underhåll med IoT

VINNOVA (2021-02537), 2021-11-15 -- 2024-11-30.

Styrkeområden

Produktion

Infrastruktur

C3SE (-2020, Chalmers Centre for Computational Science and Engineering)

Ämneskategorier (SSIF 2025)

Maskinteknik

DOI

10.1109/WSC63780.2024.10838867

ISBN

9798331534202

Mer information

Senast uppdaterat

2025-02-21