Research Area: Machine Learning
The age of online data stream and dynamic environments results in the increasing demand of advanced machine learning techniques to deal with concept drifts in large data streams. Evolving fuzzy systems (EFS) are one of recent initiatives from the fuzzy system community to resolve the issue. Existing EFSs are not robust against data uncertainty, temporal system dynamics, and the absence of system order, because a vast majority of EFSs are designed in the type-1 feedforward network architecture. This paper aims to solve the issue of data uncertainty, temporal behavior, and the absence of system order by developing a novel evolving recurrent fuzzy neural network, called evolving type-2 recurrent fuzzy neural network (eT2RFNN). eT2RFNN is constructed in a new recurrent network architecture, featuring double recurrent layers. The new recurrent network architecture evolves a generalized interval type-2 fuzzy rule, where the rule premise is built upon the interval type-2 multivariate Gaussian function, whereas the rule consequent is crafted by the nonlinear wavelet function. The eT2RFNN adopts a holistic concept of evolving systems, where the fuzzy rule can be automatically generated, pruned, merged, and recalled in the single-pass learning mode. eT2RFNN is capable of coping with the problem of high dimensionality because it is equipped with online feature selection technology. The efficacy of eT2RFNN was experimentally validated using artificial and real-world data streams and compared with prominent learning algorithms. eT2RFNN produced more reliable predictive accuracy, while retaining lower complexity than its counterparts.
Keywords:
Incremental Learning
Concept Drifts
Evolving fuzzy systems
Recurrent Neural Networks
Machine Learning
Deep Learning
Author(s) Name: Mahardhika Pratama; Jie Lu; Edwin Lughofer; Guangquan Zhang; Meng Joo Er
Journal name: IEEE Transactions on Fuzzy Systems
Conferrence name:
Publisher name: IEEE
DOI: 10.1109/TFUZZ.2016.2599855
Volume Information: ( Volume: 25, Issue: 5, Oct. 2017) Page(s): 1175 - 1192
