Research Area:  Machine Learning

Abstract:

The deep convolutional computation model (DCCM) enabled remarkable progress in feature learning of industrial big data in Internet of Things. However, as a typical static deep learning model, it is difficult to learn features for incremental industrial big data. To solve this problem, we propose an incremental DCCM by developing two incremental algorithms, i.e., parameter-incremental algorithm and structure-incremental algorithm. The parameter-incremental algorithm aims to incrementally train the fully connected layers together with fine tuning for incorporating the new knowledge into the prior one. Then, the structure-incremental algorithm is used to transfer the previous knowledge by introducing an updating rule of the tensor convolutional, pooling, and fully connected layers. Furthermore, the dropout strategy is extended into the tensor fully connected layer to improve the robustness of the proposed model. Finally, extensive experiments are carried out on the representative datasets including CIFRA and CUAVE to justify the proposed model in terms of adaption, preservation, and convergence efficiency.

Keywords:  

Author(s) Name:  Peng Li; Zhikui Chen; Laurence Tianruo Yang; Jing Gao; Qingchen Zhang; M. Jamal Deen

Publisher name:  IEEE

DOI:  10.1109/TII.2018.2871084

Volume Information:  ( Volume: 15, Issue: 3, March 2019) Page(s): 1341 - 1349

Paper Link:   https://ieeexplore.ieee.org/abstract/document/8468087