High-performance IO for seismic processing on the cloud

Autor(es)

Guimaraes, Antonio ^[1] ; Lacalle, Luis ^[1] ; Rodamilans, Charles B. ^[1] ; Borin, Edson ^[1]

Afiliação do(s) autor(es)

^[1] Univ Estadual Campinas, Inst Comp, Av Albert Einstein 1251, Campinas, SP - Brazil

• Tipo de documento: Artigo Científico
• Fonte: CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE; v. 33, n. 18, SI SEP 25 2021.
• Citações Web of Science: 2

Resumo

Most of the applications in the seismology field rely on the processing of up to hundreds of terabytes of data and their performance is strongly affected by IO operations. In this article, we analyze the main file structures currently used to store seismic data and propose a new intermediate data structure to improve IO performance while still complying with established standards. We show that, throughout a common workflow in seismic data analysis, our IO performance gain greatly surpasses the overhead of translating data to the intermediate structure. This approach enables a speedup of up to 208 times in reading time when using classical standards (e.g., SEG-Y) and our intermediate structure is up to 1.8 times more efficient than modern formats (e.g., ASDF). Considering cache-friendly applications, our speedups over the direct use of SEG-Y reach 8000 times. We also performed a cost analysis on the AWS cloud showing that, in our approach, HDDs can be 1.25 times more cost-effective than SSDs. (AU)

• Processo FAPESP: 13/08293-7 - CECC - Centro de Engenharia e Ciências Computacionais
• Beneficiário: Munir Salomao Skaf
• Modalidade de apoio: Auxílio à Pesquisa - Centros de Pesquisa, Inovação e Difusão - CEPIDs
• Processo FAPESP: 19/12783-6 - Migração eficiente de aplicações científicas e de engenharia de alto desempenho para a nuvem
• Beneficiário: Antonio Carlos Guimarães Junior
• Modalidade de apoio: Bolsas no Brasil - Doutorado