IEICE TRANSACTIONS on Information
A Configuration Management Study to Fast Massive Writing for Distributed NoSQL System
Summary :
NoSQL systems have become vital components to deliver big data services due to their high horizontal scalability. However, existing NoSQL systems rely on experienced administrators to configure and tune the wide range of configurable parameters for optimized performance. In this work, we present a configuration management framework for NoSQL systems, called xConfig. With xConfig, its users can first identify performance sensitive parameters and capture the tuned parameters for different workloads as configuration policies. Next, based on tuned policies, xConfig can be implemented as the corresponding configuration optimiaztion system for the specific NoSQL system. Also it can be used to analyze the range of configurable parameters that may impact the runtime performance of NoSQL systems. We implement a prototype called HConfig based on HBase, and the parameter tuning strategies for HConfig can generate tuned policies and enable HBase to run much more efficiently on both individual worker node and entire cluster. The massive writing oriented evaluation results show that HBase under write-intensive policies outperforms both the default configuration and some existing configurations while offering significantly higher throughput.
- Publication
- IEICE TRANSACTIONS on Information Vol.E99-D No.9 pp.2269-2282
- Publication Date
- 2016/09/01
- Publicized
- 2016/06/20
- Online ISSN
- 1745-1361
- DOI
- 10.1587/transinf.2016EDP7104
- Type of Manuscript
- PAPER
- Category
- Data Engineering, Web Information Systems
Authors
Xianqiang BAO
National University of Defense Technology (NUDT)
Nong XIAO
National University of Defense Technology (NUDT)
Yutong LU
National University of Defense Technology (NUDT)
Zhiguang CHEN
National University of Defense Technology (NUDT)
Keyword
Latest Issue
Copyrights notice of machine-translated contents
The copyright of the original papers published on this site belongs to IEICE. Unauthorized use of the original or translated papers is prohibited. See IEICE Provisions on Copyright for details.
Cite this
Copy
Xianqiang BAO, Nong XIAO, Yutong LU, Zhiguang CHEN, "A Configuration Management Study to Fast Massive Writing for Distributed NoSQL System" in IEICE TRANSACTIONS on Information,
vol. E99-D, no. 9, pp. 2269-2282, September 2016, doi: 10.1587/transinf.2016EDP7104.
Abstract: NoSQL systems have become vital components to deliver big data services due to their high horizontal scalability. However, existing NoSQL systems rely on experienced administrators to configure and tune the wide range of configurable parameters for optimized performance. In this work, we present a configuration management framework for NoSQL systems, called xConfig. With xConfig, its users can first identify performance sensitive parameters and capture the tuned parameters for different workloads as configuration policies. Next, based on tuned policies, xConfig can be implemented as the corresponding configuration optimiaztion system for the specific NoSQL system. Also it can be used to analyze the range of configurable parameters that may impact the runtime performance of NoSQL systems. We implement a prototype called HConfig based on HBase, and the parameter tuning strategies for HConfig can generate tuned policies and enable HBase to run much more efficiently on both individual worker node and entire cluster. The massive writing oriented evaluation results show that HBase under write-intensive policies outperforms both the default configuration and some existing configurations while offering significantly higher throughput.
URL: https://global.ieice.org/en_transactions/information/10.1587/transinf.2016EDP7104/_p
Copy
@ARTICLE{e99-d_9_2269,
author={Xianqiang BAO, Nong XIAO, Yutong LU, Zhiguang CHEN, },
journal={IEICE TRANSACTIONS on Information},
title={A Configuration Management Study to Fast Massive Writing for Distributed NoSQL System},
year={2016},
volume={E99-D},
number={9},
pages={2269-2282},
abstract={NoSQL systems have become vital components to deliver big data services due to their high horizontal scalability. However, existing NoSQL systems rely on experienced administrators to configure and tune the wide range of configurable parameters for optimized performance. In this work, we present a configuration management framework for NoSQL systems, called xConfig. With xConfig, its users can first identify performance sensitive parameters and capture the tuned parameters for different workloads as configuration policies. Next, based on tuned policies, xConfig can be implemented as the corresponding configuration optimiaztion system for the specific NoSQL system. Also it can be used to analyze the range of configurable parameters that may impact the runtime performance of NoSQL systems. We implement a prototype called HConfig based on HBase, and the parameter tuning strategies for HConfig can generate tuned policies and enable HBase to run much more efficiently on both individual worker node and entire cluster. The massive writing oriented evaluation results show that HBase under write-intensive policies outperforms both the default configuration and some existing configurations while offering significantly higher throughput.},
keywords={},
doi={10.1587/transinf.2016EDP7104},
ISSN={1745-1361},
month={September},}
Copy
TY - JOUR
TI - A Configuration Management Study to Fast Massive Writing for Distributed NoSQL System
T2 - IEICE TRANSACTIONS on Information
SP - 2269
EP - 2282
AU - Xianqiang BAO
AU - Nong XIAO
AU - Yutong LU
AU - Zhiguang CHEN
PY - 2016
DO - 10.1587/transinf.2016EDP7104
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E99-D
IS - 9
JA - IEICE TRANSACTIONS on Information
Y1 - September 2016
AB - NoSQL systems have become vital components to deliver big data services due to their high horizontal scalability. However, existing NoSQL systems rely on experienced administrators to configure and tune the wide range of configurable parameters for optimized performance. In this work, we present a configuration management framework for NoSQL systems, called xConfig. With xConfig, its users can first identify performance sensitive parameters and capture the tuned parameters for different workloads as configuration policies. Next, based on tuned policies, xConfig can be implemented as the corresponding configuration optimiaztion system for the specific NoSQL system. Also it can be used to analyze the range of configurable parameters that may impact the runtime performance of NoSQL systems. We implement a prototype called HConfig based on HBase, and the parameter tuning strategies for HConfig can generate tuned policies and enable HBase to run much more efficiently on both individual worker node and entire cluster. The massive writing oriented evaluation results show that HBase under write-intensive policies outperforms both the default configuration and some existing configurations while offering significantly higher throughput.
ER -
English
