Computation and Language

Authors and titles for February 2020

[151] arXiv:2002.07591 [pdf, other]

Title: Text Classification with Lexicon from PreAttention Mechanism

QingBiao LI (Beijing University of Posts and Telecommunications), Chunhua Wu (Beijing University of Posts and Telecommunications), Kangfeng Zheng (Beijing University of Posts and Telecommunications)

Comments: 11 pages

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[152] arXiv:2002.07715 [pdf, other]

Title: Neural Relation Prediction for Simple Question Answering over Knowledge Graph

Amin Abolghasemi, Saeedeh Momtazi

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[153] arXiv:2002.07725 [pdf, other]

Title: Gradient-Based Adversarial Training on Transformer Networks for Detecting Check-Worthy Factual Claims

Kevin Meng, Damian Jimenez, Fatma Arslan, Jacob Daniel Devasier, Daniel Obembe, Chengkai Li

Comments: 11 pages, 4 figures, 6 tables

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[154] arXiv:2002.07767 [pdf, other]

Title: Learning by Semantic Similarity Makes Abstractive Summarization Better

Wonjin Yoon, Yoon Sun Yeo, Minbyul Jeong, Bong-Jun Yi, Jaewoo Kang

Comments: The initial version of the manuscript includes a model design (semsim), experimental results, and discussions on the results. We found that our model has flaws in its implementation and design. This final version of the manuscript is from the rest of the initial paper; we included our findings on the benchmark dataset, BART generated results and human evaluations, and we excluded our model semsim

Subjects: Computation and Language (cs.CL)

[155] arXiv:2002.07775 [pdf, other]

Title: An enhanced Tree-LSTM architecture for sentence semantic modeling using typed dependencies

Jeena Kleenankandy, K. A. Abdul Nazeer (Department of Computer Science and Engineering, National Institute of Technology Calicut, Kerala, India)

Comments: Accepted manuscript submitted to Journal of Information Processing and Management ( Elsevier ) on June 11, 2020

Journal-ref: Information Processing & Management, Elsevier (2020)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[156] arXiv:2002.07845 [pdf, other]

Title: Interpretable Multi-Headed Attention for Abstractive Summarization at Controllable Lengths

Ritesh Sarkhel, Moniba Keymanesh, Arnab Nandi, Srinivasan Parthasarathy

Comments: 9 pages, 5 figures

Journal-ref: International Conference on Computational Linguistics (COLING) 2020

Subjects: Computation and Language (cs.CL)

[157] arXiv:2002.07927 [pdf, other]

Title: Studying the Effects of Cognitive Biases in Evaluation of Conversational Agents

Sashank Santhanam, Alireza Karduni, Samira Shaikh

Comments: Accepted at CHI 2020

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[158] arXiv:2002.07972 [pdf, other]

Title: The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding

Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao

Comments: 9 pages, 3 figures and 3 tables

Journal-ref: ACL 2020 demo

Subjects: Computation and Language (cs.CL)

[159] arXiv:2002.07982 [pdf, other]

Title: Towards Making the Most of Context in Neural Machine Translation

Zaixiang Zheng, Xiang Yue, Shujian Huang, Jiajun Chen, Alexandra Birch

Comments: Accepted by IJCAI'20. One-sentence summary: A general-purpose NMT model that's supposed to deal with any-length text, e.g., an entire document or a single sentence

Subjects: Computation and Language (cs.CL)

[160] arXiv:2002.08024 [pdf, other]

Title: Non-Autoregressive Dialog State Tracking

Hung Le, Richard Socher, Steven C.H. Hoi

Comments: Accepted at ICLR 2020. International Conference on Learning Representations (2020)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[161] arXiv:2002.08087 [pdf, other]

Title: LAMBERT: Layout-Aware (Language) Modeling for information extraction

Łukasz Garncarek, Rafał Powalski, Tomasz Stanisławek, Bartosz Topolski, Piotr Halama, Michał Turski, Filip Graliński

Comments: accepted to ICDAR 2021

Journal-ref: In: Llad\'os J., Lopresti D., Uchida S. (eds) Document Analysis and Recognition - ICDAR 2021. ICDAR 2021. Lecture Notes in Computer Science, vol 12821. Springer, Cham

Subjects: Computation and Language (cs.CL)

[162] arXiv:2002.08126 [pdf, other]

Title: Rnn-transducer with language bias for end-to-end Mandarin-English code-switching speech recognition

Shuai Zhang, Jiangyan Yi, Zhengkun Tian, Jianhua Tao, Ye Bai

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[163] arXiv:2002.08131 [pdf, other]

Title: A Systematic Comparison of Architectures for Document-Level Sentiment Classification

Jeremy Barnes, Vinit Ravishankar, Lilja Øvrelid, Erik Velldal

Comments: 5 pages, 2 figures

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[164] arXiv:2002.08155 [pdf, other]

Title: CodeBERT: A Pre-Trained Model for Programming and Natural Languages

Zhangyin Feng, Daya Guo, Duyu Tang, Nan Duan, Xiaocheng Feng, Ming Gong, Linjun Shou, Bing Qin, Ting Liu, Daxin Jiang, Ming Zhou

Comments: Accepted to Findings of EMNLP 2020. 12 pages

Subjects: Computation and Language (cs.CL); Programming Languages (cs.PL)

[165] arXiv:2002.08267 [pdf, other]

Title: Multilogue-Net: A Context Aware RNN for Multi-modal Emotion Detection and Sentiment Analysis in Conversation

Aman Shenoy, Ashish Sardana

Comments: 10 pages, 3 figures, 5 tables; Published in Proceedings of the Second Grand Challenge and Workshop on Multimodal Language (Challenge-HML) in the 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020)

Journal-ref: Challenge-HML, ACL 2020, 19-28

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[166] arXiv:2002.08307 [pdf, other]

Title: Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning

Mitchell A. Gordon, Kevin Duh, Nicholas Andrews

Comments: Accepted to Rep4NLP 2020 Workshop at ACL 2020 Conference

Subjects: Computation and Language (cs.CL)

[167] arXiv:2002.08562 [pdf, other]

Title: Federated pretraining and fine tuning of BERT using clinical notes from multiple silos

Dianbo Liu, Tim Miller

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[168] arXiv:2002.08608 [pdf, other]

Title: FrameAxis: Characterizing Microframe Bias and Intensity with Word Embedding

Haewoon Kwak, Jisun An, Elise Jing, Yong-Yeol Ahn

Comments: 24 pages; published in PeerJ CS

Journal-ref: PeerJ Computer Science 7:e644, 2021

Subjects: Computation and Language (cs.CL); Computers and Society (cs.CY)

[169] arXiv:2002.08614 [pdf, other]

Title: Balancing Cost and Benefit with Tied-Multi Transformers

Raj Dabre, Raphael Rubino, Atsushi Fujita

Comments: Extended version of our previous manuscript available at arXiv:1908.10118

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[170] arXiv:2002.08801 [pdf, other]

Title: Guiding attention in Sequence-to-sequence models for Dialogue Act prediction

Pierre Colombo, Emile Chapuis, Matteo Manica, Emmanuel Vignon, Giovanna Varni, Chloe Clavel

Journal-ref: AAAI 2020

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[171] arXiv:2002.08866 [pdf, other]

Title: Contextual Lensing of Universal Sentence Representations

Jamie Kiros

Comments: 10 pages

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[172] arXiv:2002.08880 [pdf, other]

Title: The Fluidity of Concept Representations in Human Brain Signals

Eva Hendrikx (1), Lisa Beinborn (1) ((1) University of Amsterdam)

Comments: 12 pages, 5 figures, 1 table

Subjects: Computation and Language (cs.CL)

[173] arXiv:2002.08898 [pdf, other]

Title: MA-DST: Multi-Attention Based Scalable Dialog State Tracking

Adarsh Kumar, Peter Ku, Anuj Kumar Goyal, Angeliki Metallinou, Dilek Hakkani-Tur

Comments: Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI 2020)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[174] arXiv:2002.08899 [pdf, other]

Title: Compositional Neural Machine Translation by Removing the Lexicon from Syntax

Tristan Thrush

Comments: natural language processing; adversarial neural networks; machine translation; aphasia; neural attention

Subjects: Computation and Language (cs.CL)

[175] arXiv:2002.08901 [pdf, other]

Title: Identifying physical health comorbidities in a cohort of individuals with severe mental illness: An application of SemEHR

Rebecca Bendayan, Honghan Wu, Zeljko Kraljevic, Robert Stewart, Tom Searle, Jaya Chaturvedi, Jayati Das-Munshi, Zina Ibrahim, Aurelie Mascio, Angus Roberts, Daniel Bean, Richard Dobson

Comments: 4 pages, 2 tables

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[176] arXiv:2002.08902 [pdf, other]

Title: Application of Pre-training Models in Named Entity Recognition

Yu Wang, Yining Sun, Zuchang Ma, Lisheng Gao, Yang Xu, Ting Sun

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[177] arXiv:2002.08909 [pdf, other]

Title: REALM: Retrieval-Augmented Language Model Pre-Training

Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, Ming-Wei Chang

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[178] arXiv:2002.08910 [pdf, other]

Title: How Much Knowledge Can You Pack Into the Parameters of a Language Model?

Adam Roberts, Colin Raffel, Noam Shazeer

Comments: Camera-ready version for EMNLP

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[179] arXiv:2002.08911 [pdf, other]

Title: Measuring Social Biases in Grounded Vision and Language Embeddings

Candace Ross, Boris Katz, Andrei Barbu

Comments: Camera-ready from NAACL 2021. Previous arXiv version was from before conference and was not the most recent version

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[180] arXiv:2002.09084 [pdf, other]

Title: On the impressive performance of randomly weighted encoders in summarization tasks

Jonathan Pilault, Jaehong Park, Christopher Pal

Comments: Accepted to ACL 2019 SRW. First two authors contributed equally

Subjects: Computation and Language (cs.CL)

[181] arXiv:2002.09127 [pdf, other]

Title: Learning Dynamic Belief Graphs to Generalize on Text-Based Games

Ashutosh Adhikari, Xingdi Yuan, Marc-Alexandre Côté, Mikuláš Zelinka, Marc-Antoine Rondeau, Romain Laroche, Pascal Poupart, Jian Tang, Adam Trischler, William L. Hamilton

Comments: Bug fixed in Table 1

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[182] arXiv:2002.09213 [pdf, other]

Title: Refinement of Unsupervised Cross-Lingual Word Embeddings

Magdalena Biesialska, Marta R. Costa-jussà

Comments: Accepted at the 24th European Conference on Artificial Intelligence (ECAI 2020)

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[183] arXiv:2002.09247 [pdf, other]

Title: Is Aligning Embedding Spaces a Challenging Task? A Study on Heterogeneous Embedding Alignment Methods

Russa Biswas, Mehwish Alam, Harald Sack

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[184] arXiv:2002.09419 [pdf, other]

Title: Guider l'attention dans les modeles de sequence a sequence pour la prediction des actes de dialogue

Pierre Colombo, Emile Chapuis, Matteo Manica, Emmanuel Vignon, Giovanna Varni, Chloe Clavel

Comments: in French

Journal-ref: WACAI 2020

Subjects: Computation and Language (cs.CL)

[185] arXiv:2002.09543 [pdf, other]

Title: Modelling Latent Skills for Multitask Language Generation

Kris Cao, Dani Yogatama

Subjects: Computation and Language (cs.CL)

[186] arXiv:2002.09581 [pdf, other]

Title: Extracting and Validating Explanatory Word Archipelagoes using Dual Entropy

Yukio Ohsawa

Comments: 7 pages, 2 figures, 2 columns

Subjects: Computation and Language (cs.CL)

[187] arXiv:2002.09599 [pdf, other]

Title: Training Question Answering Models From Synthetic Data

Raul Puri, Ryan Spring, Mostofa Patwary, Mohammad Shoeybi, Bryan Catanzaro

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[188] arXiv:2002.09604 [pdf, other]

Title: Emergent Communication with World Models

Alexander I. Cowen-Rivers, Jason Naradowsky

Comments: NeurIPS Workshop on Emergent Communication

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[189] arXiv:2002.09616 [pdf, other]

Title: "Wait, I'm Still Talking!" Predicting the Dialogue Interaction Behavior Using Imagine-Then-Arbitrate Model

Zehao Lin, Shaobo Cui, Guodun Li, Xiaoming Kang, Feng Ji, Fenglin Li, Zhongzhou Zhao, Haiqing Chen, Yin Zhang

Comments: This is an outdated version of "Predict-then-Decide: A Predictive Approach for Wait or Answer Task in Dialogue Systems," in IEEE/ACM Transactions on Audio, Speech, and Language Processing, doi: https://doi.org/10.1109/TASLP.2021.3110145

Subjects: Computation and Language (cs.CL)

[190] arXiv:2002.09620 [pdf, other]

Title: Efficient Sentence Embedding via Semantic Subspace Analysis

Bin Wang, Fenxiao Chen, Yuncheng Wang, C.-C. Jay Kuo

Comments: 7 pages, 2 figures

Subjects: Computation and Language (cs.CL)

[191] arXiv:2002.09634 [pdf, other]

Title: Data Augmentation for Copy-Mechanism in Dialogue State Tracking

Xiaohui Song, Liangjun Zang, Yipeng Su, Xing Wu, Jizhong Han, Songlin Hu

Subjects: Computation and Language (cs.CL)

[192] arXiv:2002.09637 [pdf, other]

Title: Markov Chain Monte-Carlo Phylogenetic Inference Construction in Computational Historical Linguistics

Tianyi Ni

Subjects: Computation and Language (cs.CL)

[193] arXiv:2002.09646 [pdf, other]

Title: Machine Translation System Selection from Bandit Feedback

Jason Naradowsky, Xuan Zhang, Kevin Duh

Comments: Accepted to AMTA 2020

Subjects: Computation and Language (cs.CL)

[194] arXiv:2002.09673 [pdf, other]

Title: Incorporating Effective Global Information via Adaptive Gate Attention for Text Classification

Xianming Li, Zongxi Li, Yingbin Zhao, Haoran Xie, Qing Li

Subjects: Computation and Language (cs.CL)

[195] arXiv:2002.09685 [pdf, other]

Title: Investigating Typed Syntactic Dependencies for Targeted Sentiment Classification Using Graph Attention Neural Network

Xuefeng Bai, Pengbo Liu, Yue Zhang

Comments: Accepted by IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP). See this https URL for final version

Journal-ref: IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP),2020

Subjects: Computation and Language (cs.CL)

[196] arXiv:2002.09758 [pdf, other]

Title: Unsupervised Question Decomposition for Question Answering

Ethan Perez, Patrick Lewis, Wen-tau Yih, Kyunghyun Cho, Douwe Kiela

Comments: EMNLP 2020 Camera-Ready. Code available at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[197] arXiv:2002.09836 [pdf, other]

Title: Fill in the BLANC: Human-free quality estimation of document summaries

Oleg Vasilyev, Vedant Dharnidharka, John Bohannon

Comments: 10 pages, 9 figures, 3 tables. In: Proceedings of the First Workshop on Evaluation and Comparison of NLP Systems (Eval4NLP, Nov. 2020) p.11-20, ACL

Journal-ref: Proceedings of the First Workshop on Evaluation and Comparison of NLP Systems (Nov.2020) 11-20

Subjects: Computation and Language (cs.CL)

[198] arXiv:2002.09901 [pdf, other]

Title: A Nepali Rule Based Stemmer and its performance on different NLP applications

Pravesh Koirala, Aman Shakya

Comments: 5 pages, 2 figures, 3 tables

Journal-ref: Proceedings of the 4th International IT Conference on ICT with Smart Computing and 9th National Students' Conference on Information Technology, (NaSCoIT 2018), Kathmandu, Nepal, ISSN No 2505-1075, pp. 16 (December 2018)

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[199] arXiv:2002.09919 [pdf, other]

Title: Do Multi-Hop Question Answering Systems Know How to Answer the Single-Hop Sub-Questions?

Yixuan Tang, Hwee Tou Ng, Anthony K.H. Tung

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[200] arXiv:2002.10101 [pdf, other]

Title: GRET: Global Representation Enhanced Transformer

Rongxiang Weng, Haoran Wei, Shujian Huang, Heng Yu, Lidong Bing, Weihua Luo, Jiajun Chen

Comments: Accepted by AAAI 2020

Subjects: Computation and Language (cs.CL)