Spinner: Enhancing HPC Experimentation with a Streamlined Parameter Sweep Tool

Autor(es)

Ceccato, Rodrigo ; Cleto, Jhonatan ; Leite, Gustavo ; Rigo, Sandro ; Monsalve Diaz, Jose M. ; Yviquel, Herve

• Tipo de documento: Artigo Científico
• Fonte: 2024 INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE AND HIGH PERFORMANCE COMPUTING WORKSHOPS, SBAC-PADW; v. N/A, p. 11-pg., 2024-01-01.

Resumo

We introduce Spinner, an open-source, parameterized sweep benchmark tool for high-performance computing (HPC). Spinner employs a YAML file format to facilitate the execution of applications, data collection, and metadata versioning and sharing. This setup simplifies version control and sharing of experimental configurations. By including dataframes that describe experiments and raw data, it allows readers and reviewers to gain a clearer understanding than summary statistics alone. Spinner's design is non-intrusive and efficient, executing user-supplied commands and dynamically replacing parameters in the command template. It also features the capability to rerun failed experiments, which is particularly useful for testing unstable applications or identifying unstable parameter combinations. We have demonstrated Spinner's functionality with minimal configuration by using it in tests with LAMMPS, GROMACS, Task Bench, XSBench, and RSBench on two different clusters. These tests measured wall time and captured application outputs, underscoring Spinner's practicality and adaptability. (AU)

• Processo FAPESP: 24/04232-8 - Implementação e Otimização de Task Offloading em Clusters Heterogêneos utilizando o OpenMP Cluster
• Beneficiário: Jhonatan Cléto
• Modalidade de apoio: Bolsas no Brasil - Mestrado
• Processo FAPESP: 19/17874-0 - EMU concedido no Proc. 2013/08293-7, KAHUNA upgrade - HPE Apollo Gen10 Supercomputer
• Beneficiário: Munir Salomao Skaf
• Modalidade de apoio: Auxílio à Pesquisa - Programa Equipamentos Multiusuários
• Processo FAPESP: 13/08293-7 - CECC - Centro de Engenharia e Ciências Computacionais
• Beneficiário: Munir Salomao Skaf
• Modalidade de apoio: Auxílio à Pesquisa - Centros de Pesquisa, Inovação e Difusão - CEPIDs
• Processo FAPESP: 20/08475-1 - Aumentando eficiência de paralelismo de tarefas em clusters de GPUs para aplicações científicas
• Beneficiário: Gustavo Leite
• Modalidade de apoio: Bolsas no Brasil - Doutorado