Method of Data Reduction Effectiveness Evaluation Based on Users’ Interesting Degrees

Author(s): Lehong Fang , Wenning Hao* , Xiaohan Yu , Gang Chen , Hongmei Li .

Journal Name: Recent Advances in Electrical & Electronic Engineering

Volume 11 , Issue 4 , 2018

Become EABM
Become Reviewer

Graphical Abstract:


Abstract:

Objective: Effectiveness of data reduction directly influences the quality of reduced data, design of reduction process and selection of relevant algorithms or model, thus ultimately affecting flexibility and extension of the data reduction method and its implementation system. In view of the deficiencies of the data reduction effectiveness evaluation system including imperfection and weak applicability of index system, with lack of pertinence and neglecting the personalized needs of users, three evaluation indexes were put forward to comprehensively reflect the rate of data amount reduction, the rate of statistical difference and the rate of average information loss after data reduction.

Methods: On the basis of this, an evaluation method of data reduction effectiveness based on users’ interesting degrees was proposed.

Results: Through this method, subspace of the weight of indexes described users’ preference of index, and it was accessed according to historical data.

Conclusion: The acceptable degree of reduction effectiveness is calculated approximately using the Monte Carlo simulation, which implements the method of effectiveness evaluation of data reduction geared towards different users and provides a quantitative basis for recommending data reduction method for system users focusing on different aspects.

Keywords: Data reduction, effectiveness evaluation index system, Monte carlo simulation, personalized needs of users, users’ interesting degrees, weight subspace of indexes.

Rights & PermissionsPrintExport Cite as

Article Details

VOLUME: 11
ISSUE: 4
Year: 2018
Page: [434 - 442]
Pages: 9
DOI: 10.2174/2352096511666180213110615
Price: $58

Article Metrics

PDF: 6
HTML: 3
PRC: 2