IEICE TRANSACTIONS on Information
DiSC: A Distributed In-Storage Computing Platform Using Cost-Effective Hardware Devices
Summary :
The ability to efficiently process exponentially increasing data remains a challenging issue for computer platforms. In legacy computing platforms, large amounts of data can cause performance bottlenecks at the I/O interfaces between CPUs and storage devices. To overcome this problem, the in-storage computing (ISC) technique is introduced, which offloads some of the computations from the CPUs to the storage devices. In this paper, we propose DiSC, a distributed in-storage computing platform using cost-effective hardware. First, we designed a general-purpose ISC device, a so-called DiSC endpoint, by combining an inexpensive single-board computer (SBC) and a hard disk. Second, a Mesos-based resource manager is adapted into the DiSC platform to schedule the DiSC endpoint tasks. To draw comparisons to a general CPU-based platform, a DiSC testbed is constructed and experiments are carried out using essential applications. The experimental results show that DiSC attains cost-efficient performance advantages over a desktop, particularly for searching and filtering workloads.
- Publication
- IEICE TRANSACTIONS on Information Vol.E100-D No.12 pp.3018-3021
- Publication Date
- 2017/12/01
- Publicized
- 2017/08/23
- Online ISSN
- 1745-1361
- DOI
- 10.1587/transinf.2017EDL8104
- Type of Manuscript
- LETTER
- Category
- Computer System
Authors
Jaehwan LEE
Korea Aerospace University
Joohwan KIM
Korea Aerospace University
Ji Sun SHIN
Sejong University
Keyword
Latest Issue
Copyrights notice of machine-translated contents
The copyright of the original papers published on this site belongs to IEICE. Unauthorized use of the original or translated papers is prohibited. See IEICE Provisions on Copyright for details.
Cite this
Copy
Jaehwan LEE, Joohwan KIM, Ji Sun SHIN, "DiSC: A Distributed In-Storage Computing Platform Using Cost-Effective Hardware Devices" in IEICE TRANSACTIONS on Information,
vol. E100-D, no. 12, pp. 3018-3021, December 2017, doi: 10.1587/transinf.2017EDL8104.
Abstract: The ability to efficiently process exponentially increasing data remains a challenging issue for computer platforms. In legacy computing platforms, large amounts of data can cause performance bottlenecks at the I/O interfaces between CPUs and storage devices. To overcome this problem, the in-storage computing (ISC) technique is introduced, which offloads some of the computations from the CPUs to the storage devices. In this paper, we propose DiSC, a distributed in-storage computing platform using cost-effective hardware. First, we designed a general-purpose ISC device, a so-called DiSC endpoint, by combining an inexpensive single-board computer (SBC) and a hard disk. Second, a Mesos-based resource manager is adapted into the DiSC platform to schedule the DiSC endpoint tasks. To draw comparisons to a general CPU-based platform, a DiSC testbed is constructed and experiments are carried out using essential applications. The experimental results show that DiSC attains cost-efficient performance advantages over a desktop, particularly for searching and filtering workloads.
URL: https://global.ieice.org/en_transactions/information/10.1587/transinf.2017EDL8104/_p
Copy
@ARTICLE{e100-d_12_3018,
author={Jaehwan LEE, Joohwan KIM, Ji Sun SHIN, },
journal={IEICE TRANSACTIONS on Information},
title={DiSC: A Distributed In-Storage Computing Platform Using Cost-Effective Hardware Devices},
year={2017},
volume={E100-D},
number={12},
pages={3018-3021},
abstract={The ability to efficiently process exponentially increasing data remains a challenging issue for computer platforms. In legacy computing platforms, large amounts of data can cause performance bottlenecks at the I/O interfaces between CPUs and storage devices. To overcome this problem, the in-storage computing (ISC) technique is introduced, which offloads some of the computations from the CPUs to the storage devices. In this paper, we propose DiSC, a distributed in-storage computing platform using cost-effective hardware. First, we designed a general-purpose ISC device, a so-called DiSC endpoint, by combining an inexpensive single-board computer (SBC) and a hard disk. Second, a Mesos-based resource manager is adapted into the DiSC platform to schedule the DiSC endpoint tasks. To draw comparisons to a general CPU-based platform, a DiSC testbed is constructed and experiments are carried out using essential applications. The experimental results show that DiSC attains cost-efficient performance advantages over a desktop, particularly for searching and filtering workloads.},
keywords={},
doi={10.1587/transinf.2017EDL8104},
ISSN={1745-1361},
month={December},}
Copy
TY - JOUR
TI - DiSC: A Distributed In-Storage Computing Platform Using Cost-Effective Hardware Devices
T2 - IEICE TRANSACTIONS on Information
SP - 3018
EP - 3021
AU - Jaehwan LEE
AU - Joohwan KIM
AU - Ji Sun SHIN
PY - 2017
DO - 10.1587/transinf.2017EDL8104
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E100-D
IS - 12
JA - IEICE TRANSACTIONS on Information
Y1 - December 2017
AB - The ability to efficiently process exponentially increasing data remains a challenging issue for computer platforms. In legacy computing platforms, large amounts of data can cause performance bottlenecks at the I/O interfaces between CPUs and storage devices. To overcome this problem, the in-storage computing (ISC) technique is introduced, which offloads some of the computations from the CPUs to the storage devices. In this paper, we propose DiSC, a distributed in-storage computing platform using cost-effective hardware. First, we designed a general-purpose ISC device, a so-called DiSC endpoint, by combining an inexpensive single-board computer (SBC) and a hard disk. Second, a Mesos-based resource manager is adapted into the DiSC platform to schedule the DiSC endpoint tasks. To draw comparisons to a general CPU-based platform, a DiSC testbed is constructed and experiments are carried out using essential applications. The experimental results show that DiSC attains cost-efficient performance advantages over a desktop, particularly for searching and filtering workloads.
ER -
English
