Amazing technological breakthrough possible @S-Logix pro@slogix.in

Office Address

  • #5, First Floor, 4th Street Dr. Subbarayan Nagar Kodambakkam, Chennai-600 024 Landmark : Samiyar Madam
  • pro@slogix.in
  • +91- 81240 01111

Social List

Missing-Value Imputation of Continuous Missing Based on Deep Imputation Network Using Correlations among Multiple IoT Data Streams in a Smart Space - 2018

Missing-Value Imputation Of Continuous Missing Based On Deep Imputation Network Using Correlations Among Multiple Iot Data Streams In A Smart Space

Research Paper on Missing-Value Imputation Of Continuous Missing Based On Deep Imputation Network Using Correlations Among Multiple Iot Data Streams In A Smart Space

Research Area:  Machine Learning

Abstract:

Data generated from the Internet of Things (IoT) devices in smart spaces are utilized in a variety of fields such as context recognition, service recommendation, and anomaly detection. However, the missing values in the data streams of the IoT devices remain a challenging problem owing to various missing patterns and heterogeneous data types from many different data streams. In this regard, while we were analyzing the dataset collected from a smart space with multiple IoT devices, we found a continuous missing pattern that is quite different from the existing missing-value patterns. The pattern has blocks of consecutive missing values over a few seconds and up to a few hours. Therefore, the pattern is a vital factor to the availability and reliability of IoT applications; yet, it cannot be solved by the existing missing-value imputation methods. Therefore, a novel approach for missing-value imputation of the continuous missing pattern is required. We deliberate that even if the missing values of the continuous missing pattern occur in one data stream, missing-values imputation is possible through learning other data streams correlated with this data stream. To solve the missing values of the continuous missing pattern problem, we analyzed multiple IoT data streams in a smart space and figured out the correlations between them that are the interdependencies among the data streams of the IoT devices in a smart space. To impute missing values of the continuous missing pattern, we propose a deep learning-based missing-value imputation model exploiting correlation information, namely, the deep imputation network (DeepIN), in a smart space. The DeepIN uses that multiple long short-term memories are constructed according to the correlation information of each IoT data stream. We evaluated the DeepIN on a real dataset from our campus IoT testbed, and the experimental results show that our proposed approach improves the imputation performance by 57.36 percent over the state-of-the-art missing-value imputation algorithm. Thus, our approach can be a promising methodology that enables IoT applications and services with a reasonable missing-value imputation accuracy (80∼85 percent) on average, even if a long-term block of values is missing in IoT environments.

Keywords:  
Missing-Value Imputation Of Continuous Missing
Deep Imputation Network Correlations
Iot Data Streams
Machine Learning
Deep Learning

Author(s) Name:  Minseok LEE, Jihoon AN, Younghee LEE

Journal name:  IEICE Transactions on Information and Systems

Conferrence name:  

Publisher name:  J-STAGE

DOI:  https://doi.org/10.1587/transinf.2018EDP7257

Volume Information:  Volume E102.D Issue 2 Pages 289-298