Research Area:  Machine Learning

Abstract:

As a pivotal technique in intelligent education systems, cognitive diagnosis (CD) serves to reveal students’ knowledge proficiency for better tackling subsequent tasks. Unfortunately, due to pursuing high model interpretability, existing manually designed models for CD often hold simplistic architectures, which cannot cope with intricate data in modern education platforms. Furthermore, the bias of human design limits the emergence of novel and effective CD models. To develop interpretable and more effective models, thus this paper proposes an evolutionary multi-objective neural architecture search (NAS) approach for CD. Specifically, we first adopt a comprehensive search space for the NAS task of CD: all candidate models can be encompassed by a general model that deals with three distinct types of inputs. Then, an innovative model interpretability objective is devised to formulate the architecture search task as a bi-objective optimization problem (BOP). To solve the BOP, we employ a multi-objective genetic programming (MOGP) as the search strategy to explore the search space. To make the employed MOGP search well, all architectures are first encoded by trees for easy optimization, and we devise a genetic operation and a population initialization strategy to expedite its convergence. Finally, the proposed approach is actually a MOGP-based NAS approach for CD. Extensive experiments show that CD models searched by the proposed approach exhibit significantly better performance than existing models and hold as good interpretability as handcrafted models. Besides, the effectiveness of the proposed MOGP search strategy, the devised objective, and tailored strategies are validated.

Keywords:  

Author(s) Name:  Shangshang Yang; Haiping Ma; Ying Bi; Ye Tian; Limiao Zhang; Yaochu Jin

Publisher name:  IEEE

DOI:  10.1109/TEVC.2024.3429180

Volume Information:  Volume 2, (2024)

Paper Link:   https://ieeexplore.ieee.org/document/10599558