Advanced search
Start date
Betweenand


Random-Key Optimizer with reinforcement learning for the Capacitated Multi-period Cutting Stock Problem with setup cost

Full text
Author(s):
Silva, Eduardo M. ; Chaves, Antonio A. ; de Araujo, Silvio A. ; Jans, Raf
Total Authors: 4
Document type: Journal article
Source: Computers & Operations Research; v. 183, p. 18-pg., 2025-11-01.
Abstract

This paper introduces a Random-Key Optimizer (RKO) procedure incorporating reinforcement learning to solve the One-Dimensional Multi-Period Cutting Stock Problem (MPCSP) with setup costs and capacity constraints. The MPCSP involves determining cutting plans for each period to meet customer demands, where inventory variables link consecutive periods. The RKO represents solutions as random-key vectors, which are decoded into feasible solutions for the MPCSP through a decoder process. During the optimization process, the RKO dynamically adapts its parameters using reinforcement learning. This framework integrates Biased Random-Key Genetic Algorithm (BRKGA), Particle Swarm Optimization (PSO), and Simulated Annealing (SA), all utilizing a unified decoder function. A novel penalization mechanism is also introduced within the decoder to handle infeasibilities effectively. The proposed RKO is evaluated on benchmark instances from the literature and compared against state-of-the-art methods, including a hybrid column generation heuristic and a dynamic programming-based heuristic. In addition, a new set of large-scale instances is introduced for further evaluation. Computational experiments reveal that the RKO employed by BRKGA consistently outperforms other solution methods in benchmark instances, delivering superior average solution quality. A sensitivity analysis is also conducted, examining the impact of setup costs and production capacity. Moreover, the study includes a comparative analysis of the RKO framework with and without reinforcement learning. (AU)

FAPESP's process: 13/07375-0 - CeMEAI - Center for Mathematical Sciences Applied to Industry
Grantee:Francisco Louzada Neto
Support Opportunities: Research Grants - Research, Innovation and Dissemination Centers - RIDC
FAPESP's process: 22/05803-3 - Cutting, packing, lot-sizing, scheduling, routing and location problems and their integration in industrial and logistics settings
Grantee:Reinaldo Morabito Neto
Support Opportunities: Research Projects - Thematic Grants
FAPESP's process: 22/05803-3 - Cutting, packing, lot-sizing, scheduling, routing and location problems and their integration in industrial and logistics settings
Grantee:Reinaldo Morabito Neto
Support Opportunities: Research Projects - Thematic Grants
FAPESP's process: 23/04588-4 - Mathematical models and adaptive solution methods for the multi-period cutting stock problem with setups and capacity constraints
Grantee:Eduardo Machado Silva
Support Opportunities: Scholarships in Brazil - Post-Doctoral
FAPESP's process: 24/08848-3 - Full truckload pickup and delivery problem: optimization methods and practical constraints of the supply chain middle mile
Grantee:Antônio Augusto Chaves
Support Opportunities: Regular Research Grants
FAPESP's process: 24/01409-4 - LOT-SIZING AND ROUTING PROBLEMS: INDUSTRIAL AND LOGISTIC APPLICATIONS
Grantee:Silvio Alexandre de Araujo
Support Opportunities: Scholarships abroad - Research
FAPESP's process: 18/15417-8 - Development of a hybrid metaheuristic with adaptive control flow and parameters
Grantee:Antônio Augusto Chaves
Support Opportunities: Research Grants - Young Investigators Grants - Phase 2