| Full text | |
| Author(s): |
Bernardino, Matheus Tavares
;
Goldman, Alfredo
;
IEEE Comp Soc
Total Authors: 3
|
| Document type: | Journal article |
| Source: | 2022 IEEE 34TH INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE AND HIGH PERFORMANCE COMPUTING (SBAC-PAD 2022); v. N/A, p. 12-pg., 2022-01-01. |
| Abstract | |
Version control systems (VCS) are tools used to track and manage the changes made to a set of files over time. Among the VCS tools available today, Git has become the most popular for software development. Being used in small personal projects of a few megabytes and massive corporate repositories with more than 300 GB and 3.5 million files, speed and scalability are among the top priorities for the tool. However, its performance sometimes falls short of what is desired on networked file systems (e.g. NFS), where input and output (I/O) operations tend to be more costly. In particular, that is the case for the checkout command, which is responsible for restoring files from specific versions of a project. Despite the optimizations implemented over the years, the sequential processing of files still carried a large time penalty for NFS, as well as being suboptimal for local file systems on SSDs. In this project, we worked to parallelize the Git checkout machinery, resulting in speedups of up to 4.5x on NFS and 3.6x on SSDs. We also studied how parallelism affects the I/O requests performed by checkout on different storage systems. The optimization was submitted upstream and made available to all Git users starting at version 2.32.0, from June 2021. (AU) | |
| FAPESP's process: | 19/26702-8 - Trends on high performance computing, from resource management to new computer architectures |
| Grantee: | Alfredo Goldman vel Lejbman |
| Support Opportunities: | Research Projects - Thematic Grants |