2017-02-15 (水) 09:04:50 (9d) | Topic path: Top / SIG-FIN-018-07


Cross-lingual news article comparison using bi-graph clustering and Siamese-LSTM


Enda Liu (The University of Tokyo), Kiyoshi Izumi (The University of Tokyo), Kota Tsubouchi (Yahoo! JAPAN), Tatsuo Yamashita (Yahoo! JAPAN)


Calculating similarity score for monolingual text is a popular task since it could be used for various text mining system. However seldom research is focusing on multilingual text resources. On the other hand, machine learning based algorithms such as CBOW word embedding and clustering are widely used in extracting features of text. In this research, we develop and train a model that could calculate the similarity of the two finance news reports, by utilizing CBOW, spherical clustering, bi-graph extraction as well as the Siamese-LSTM deep learning model. It performs well even though the training news data are closely related in the financial domain and also helps us to analyze the relationship among news reports written in different languages.

Key Words

text mining, cross-lingual text similarity, natural language processing, machine learning, recurrent neural network, clustering



トップ   編集 凍結 差分 バックアップ 添付 複製 名前変更 リロード   新規 一覧 単語検索 最終更新   ヘルプ   最終更新のRSS