UCL Discovery Stage
UCL home » Library Services » Electronic resources » UCL Discovery Stage

A novel carbon reduction engineering method-based deep Q-learning algorithm for energy-efficient scheduling on a single batch-processing machine in semiconductor manufacturing

Kong, Min; Wang, Weizhong; Deveci, Muhammet; Zhang, Yajing; Wu, Xuzhong; Coffman, D'Maris; (2024) A novel carbon reduction engineering method-based deep Q-learning algorithm for energy-efficient scheduling on a single batch-processing machine in semiconductor manufacturing. International Journal of Production Research , 62 (18) pp. 6449-6472. 10.1080/00207543.2023.2252932. Green open access

[thumbnail of Coffman_Carbon Reduction Engineering Paper_R1.pdf]
Preview
Text
Coffman_Carbon Reduction Engineering Paper_R1.pdf

Download (1MB) | Preview

Abstract

The semiconductor industry is a resource-intensive sector that heavily relies on energy, water, chemicals, and raw materials. Within the semiconductor manufacturing process, the diffusion furnace, ion implantation machine, and plasma etching machine exhibit high energy demands or operate at extremely high temperatures, resulting in significant electricity consumption, which is usually carbon-intensive. To address energy conservation concerns, the industry adopts batch production technology, which allows for the simultaneous processing of multiple products. The energy-efficient parallel batch scheduling problem arises from the need to optimise product grouping and sequencing. In contrast to existing heuristics, meta-heuristics, and exact algorithms, this paper introduces the Deep Q-Network (DQN) algorithm as a novel approach to address the proposed problem. The DQN algorithm is built upon the agent’s systematic learning of scheduling rules, thereby enabling it to offer guidance for online decision-making regarding the grouping and sequencing of products. The efficacy of the algorithm is substantiated through extensive computational experiments.

Type: Article
Title: A novel carbon reduction engineering method-based deep Q-learning algorithm for energy-efficient scheduling on a single batch-processing machine in semiconductor manufacturing
Open access status: An open access version is available from UCL Discovery
DOI: 10.1080/00207543.2023.2252932
Publisher version: https://doi.org/10.1080/00207543.2023.2252932
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Semiconductor manufacturing, Deep Reinforcement Learning, Parallel Batch Scheduling, Less is More, Carbon reduction engineering
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of the Built Environment
URI: https://discovery-pp.ucl.ac.uk/id/eprint/10176967
Downloads since deposit
1,440Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item