Multi-Task Learning for Authorship Attribution via Topic Approximation and Competitive Attention

Abstract

Separating content from style is a fundamental problem in authorship attribution to represent topic independent personal style of authors. Previous work often ignores this problem by imposing strong but unrealistic assumptions or artificially determines a set of predefined stylistic structures. This paper proposes to separate topic and style based on neural multi-task learning. Our target is to learn separate representations for topic and style respectively. In addition to authorship attribution as the main task, we introduce a novel auxiliary task topic approximation to guide the learning of topic representations with the topic distributions inferred by topic models, which are trained from external corpus. Moreover, we propose a competitive attention mechanism and a separation-reconstruction constraint to assign different and competitive attentions to two tasks in order to separate topic and style as much as possible. Evaluation results demonstrate that the proposed multi-task learning based method is promising, especially on cross-topic settings. We found that topic approximation can help capture topical content and the competitive attentions benefit topic-style separation. It is encouraging since our model separates topic and style in a probabilistic way and doesn’t require human intervention.