An Optimized Iterative Semantic Compression Algorithm And Parallel Processing for Large Scale Data.
KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS(2018)
摘要
With the continuous growth of data size and the use of compression technology, data reduction has great research value and practical significance. Aiming at the shortcomings of the existing semantic compression algorithm, this paper is based on the analysis of ItCompress algorithm, and designs a method of bidirectional order selection based on interval partitioning, which named An Optimized Iterative Semantic Compression Algorithm (Optimized ItCompress Algorithm). In order to further improve the speed of the algorithm, we propose a parallel optimization iterative semantic compression algorithm using GPU (POICAG) and an optimized iterative semantic compression algorithm using Spark (DOICAS). A lot of valid experiments are carried out on four kinds of datasets, which fully verified the efficiency of the proposed algorithm.
更多查看译文
关键词
Semantic Compression,Spark Computing Framework,GPU,Parallel Processing,Interval Partition
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络