Research Area:  Machine Learning

Abstract:

Natural language processing (NLP) allows a computer program to understand human language as it is spoken, and has been increasingly deployed in a growing number of applications, such as machine translation, sentiment analysis, and electronic voice assistant. While information obtained from different sources can enhance the accuracy of NLP models, there are also privacy implications in the collection of such massive data. Thus, in this paper, we design a privacy-preserving system SecureNLP, focusing on the instance of recurrent neural network (RNN)based sequence-to-sequence with attention model for neural machine translation. Specifically, for non-linear functions such as sigmoid and tanh, we design two efficient distributed protocols using secure multi-party computation (MPC), which are used to carry out the respective tasks in the SecureNLP. We also prove the security of these two protocols (i.e., privacy-preserving long short-term memory network PrivLSTM, and privacy-preserving sequence to sequence transformation PrivSEQ2SEQ) in the semi-honest adversary model, in the sense that any honest-butcurious adversary cannot learn anything else from the messages they receive from other parties. The proposed system is implemented in C++ and Python, and the findings from the evaluation demonstrate the utility of the protocols in cross-domain NLP.

Keywords:  
Secure multi-party computation
natural language processing
seq2seq with attention
long short-term memory

Author(s) Name:   Qi Feng; Debiao He; Zhe Liu; Huaqun Wang; Kim-Kwang Raymond Choo

Publisher name:  IEEE

DOI:  10.1109/TIFS.2020.2997134

Volume Information:  Volume: 15, Page(s): 3709 - 3721

Paper Link:   https://ieeexplore.ieee.org/abstract/document/9099258