Advanced search
Start date
Betweenand


On the integration of reinforcement learning and simulated annealing for the parallel batch scheduling problem with setups

Full text
Author(s):
Rolim, Gustavo Alencar ; Tomazella, Caio Paziani ; Nagano, Marcelo Seido
Total Authors: 3
Document type: Journal article
Source: European Journal of Operational Research; v. 326, n. 2, p. 14-pg., 2025-10-16.
Abstract

Motivated by semiconductor applications, where wafer lots are grouped into families and processed on batch machines, this paper addresses a generalized unrelated parallel-batch scheduling problem. The goal is to minimize total completion time (flow time) while considering family-and machine-dependent setup times. We propose a mixed-integer programming formulation, establish a necessary condition for optimal schedules, and develop a polynomial-time heuristic for batching and sequencing. We also evaluate Q-Learning, a model-free reinforcement learning algorithm, for neighborhood selection within two Simulated Annealing-based metaheuristics: Stochastic Local Search (SLS) and Adaptive Large Neighborhood Search (ALNS). Results show that SLS and ALNS achieve better solutions and faster convergence compared to existing approaches. Finally, we conclude that while Q-Learning has the potential to improve solution quality in certain cases, it also increases the complexity of the algorithms, making them harder to configure and scale. (AU)

FAPESP's process: 19/10824-7 - Solving the integrated raw material procurement and lot-sizing problem with the aid of big data analytics tools
Grantee:Caio Paziani Tomazella
Support Opportunities: Scholarships in Brazil - Doctorate
FAPESP's process: 13/07375-0 - CeMEAI - Center for Mathematical Sciences Applied to Industry
Grantee:Francisco Louzada Neto
Support Opportunities: Research Grants - Research, Innovation and Dissemination Centers - RIDC