Scalable Design and Implementations for MPI Parallel Overlapping I/O
| Autor: | E. Russell, Lee Ward, N. Pundit, Alok Choudhary, Wei-keng Liao, Kenin Coloma |
|---|---|
| Rok vydání: | 2006 |
| Předmět: |
Computer science
Serialization Message Passing Interface Parallel computing computer.software_genre File locking File server Server Versioning file system File system fragmentation Input/output File system Atomicity File descriptor Message passing Device file Unix file types Memory-mapped file File Control Block Self-certifying File System Computational Theory and Mathematics Hardware and Architecture POSIX Signal Processing Asynchronous I/O Cache computer Cache coherence |
| Zdroj: | IEEE Transactions on Parallel and Distributed Systems. 17:1264-1276 |
| ISSN: | 1045-9219 |
| DOI: | 10.1109/tpds.2006.163 |
| Popis: | We investigate the message passing interface input/output (MPI I/O) implementation issues for two overlapping access patterns: the overlaps among processes within a single I/O operation and the overlaps across a sequence of I/O operations. The former case considers whether I/O atomicity can be obtained in the overlapping regions. The latter focuses on the file consistency problem on parallel machines with client-side file caching enabled. Traditional solutions for both overlapping I/O problems use whole file or byte-range file locking to ensure exclusive access to the overlapping regions and bypass the file system cache. Unfortunately, not only can file locking serialize I/O, but it can also increase the aggregate communication overhead between clients and I/O servers. For atomicity, we first differentiate MPI's requirements from the portable operating system interface (POSIX) standard and propose two scalable approaches, graph coloring and process-rank ordering, which can resolve access conflicts and maintain I/O parallelism. For solving the file consistency problem across multiple I/O operations, we propose a method called persistent file domains, which tackles cache coherency with additional information and coordination to guarantee safe cache access without using file locks |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|