Research Area:  Machine Learning

Abstract:

Most environments change over time. Being able to adapt to such non-stationary environments is vital for real-world applications of many machine learning algorithms. In this work, we propose CORAL, a computationally efficient regression algorithm capable of adapting to a non-stationary target. CORAL is based on Bayesian linear regression with a sliding window and offline/online meta-learning. The sliding window makes our model focus on the recently received data and ignores older observations. The meta-learning approach allows us to learn the prior distribution of the model parameters. It speeds up the model adaptation, complements the sliding windows drawback, and enhances the performance. We evaluate CORAL on two tasks: a toy problem and a more complex blood glucose level prediction task. Our approach improves the prediction accuracy for the non-stationary target significantly while also performing well for the stationary target. We show that the two components of our method work in a complementary fashion to achieve this.

Keywords:  
Bayesian meta-learning
concept drift adaptation
linear regression

Author(s) Name:  Taku Yamagata,Raul Santos-Rodriguez,Peter Flach

Publisher name:  MDPI

DOI:  10.3390/signals3010006

Volume Information:  Volume 3

Paper Link:   https://www.mdpi.com/2624-6120/3/1/6