Parallel Geospatial Raster Data I/O Using File View

Wei XIONG; Ye WU; Luo CHEN; Ning JING

doi:10.1587/transinf.2015PAL0001

Parallel Geospatial Raster Data I/O Using File View

Wei XIONG, Ye WU, Luo CHEN, Ning JING

Full Text Views

0

Cite this

Summary :

The challenges of providing a divide-and-conquer strategy for tackling large geospatial raster data input/output (I/O) are longstanding. Solutions need to change with advances in the technology and hardware. After analyzing the reason for the problems of traditional parallel raster I/O mode, a parallel I/O strategy using file view is proposed to solve these problems. Message Passing Interface I/O (MPI-IO) is used to implement this strategy. Experimental results show how a file view approach can be effectively married to General Parallel File System (GPFS). A suitable file view setting provides an efficient solution to parallel geospatial raster data I/O.

Publication: IEICE TRANSACTIONS on Information Vol.E98-D No.12 pp.2192-2195

Publication Date: 2015/12/01

Publicized: 2015/09/15

Online ISSN: 1745-1361

DOI: 10.1587/transinf.2015PAL0001

Type of Manuscript: Special Section LETTER (Special Section on Parallel and Distributed Computing and Networking)

Category: Storage System

Authors

Wei XIONG
  National University of Defense Technology
Ye WU
  National University of Defense Technology
Luo CHEN
  National University of Defense Technology
Ning JING
  National University of Defense Technology

Keyword

parallel I/O, geospatial raster, file view, MPI

Cite this

Copy

Wei XIONG, Ye WU, Luo CHEN, Ning JING, "Parallel Geospatial Raster Data I/O Using File View" in IEICE TRANSACTIONS on Information, vol. E98-D, no. 12, pp. 2192-2195, December 2015, doi: 10.1587/transinf.2015PAL0001.
Abstract: The challenges of providing a divide-and-conquer strategy for tackling large geospatial raster data input/output (I/O) are longstanding. Solutions need to change with advances in the technology and hardware. After analyzing the reason for the problems of traditional parallel raster I/O mode, a parallel I/O strategy using file view is proposed to solve these problems. Message Passing Interface I/O (MPI-IO) is used to implement this strategy. Experimental results show how a file view approach can be effectively married to General Parallel File System (GPFS). A suitable file view setting provides an efficient solution to parallel geospatial raster data I/O.
URL: https://global.ieice.org/en_transactions/information/10.1587/transinf.2015PAL0001/_p

Copy

@ARTICLE{e98-d_12_2192,
author={Wei XIONG, Ye WU, Luo CHEN, Ning JING, },
journal={IEICE TRANSACTIONS on Information},
title={Parallel Geospatial Raster Data I/O Using File View},
year={2015},
volume={E98-D},
number={12},
pages={2192-2195},
abstract={The challenges of providing a divide-and-conquer strategy for tackling large geospatial raster data input/output (I/O) are longstanding. Solutions need to change with advances in the technology and hardware. After analyzing the reason for the problems of traditional parallel raster I/O mode, a parallel I/O strategy using file view is proposed to solve these problems. Message Passing Interface I/O (MPI-IO) is used to implement this strategy. Experimental results show how a file view approach can be effectively married to General Parallel File System (GPFS). A suitable file view setting provides an efficient solution to parallel geospatial raster data I/O.},
keywords={},
doi={10.1587/transinf.2015PAL0001},
ISSN={1745-1361},
month={December},}

Copy

TY - JOUR
TI - Parallel Geospatial Raster Data I/O Using File View
T2 - IEICE TRANSACTIONS on Information
SP - 2192
EP - 2195
AU - Wei XIONG
AU - Ye WU
AU - Luo CHEN
AU - Ning JING
PY - 2015
DO - 10.1587/transinf.2015PAL0001
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E98-D
IS - 12
JA - IEICE TRANSACTIONS on Information
Y1 - December 2015
AB - The challenges of providing a divide-and-conquer strategy for tackling large geospatial raster data input/output (I/O) are longstanding. Solutions need to change with advances in the technology and hardware. After analyzing the reason for the problems of traditional parallel raster I/O mode, a parallel I/O strategy using file view is proposed to solve these problems. Message Passing Interface I/O (MPI-IO) is used to implement this strategy. Experimental results show how a file view approach can be effectively married to General Parallel File System (GPFS). A suitable file view setting provides an efficient solution to parallel geospatial raster data I/O.
ER -