Computation and Language

Authors and titles for December 2020

[401] arXiv:2012.14271 [pdf, other]

Title: Towards Fully Automated Manga Translation

Ryota Hinami, Shonosuke Ishiwatari, Kazuhiko Yasuda, Yusuke Matsui

Comments: Accepted to AAAI 2021

Subjects: Computation and Language (cs.CL)

[402] arXiv:2012.14312 [pdf, other]

Title: Panarchy: ripples of a boundary concept

Juan Rocha, Linda Luvuno, Jesse Rieb, Erin Crockett, Katja Malmborg, Michael Schoon, Garry Peterson

Comments: 11 pages, 5 figures

Subjects: Computation and Language (cs.CL)

[403] arXiv:2012.14320 [pdf, other]

Title: BURT: BERT-inspired Universal Representation from Learning Meaningful Segment

Yian Li, Hai Zhao

Comments: arXiv admin note: text overlap with arXiv:2009.04656

Subjects: Computation and Language (cs.CL)

[404] arXiv:2012.14353 [pdf, other]

Title: DeepHateExplainer: Explainable Hate Speech Detection in Under-resourced Bengali Language

Md. Rezaul Karim, Sumon Kanti Dey, Tanhim Islam, Sagor Sarker, Mehadi Hasan Menon, Kabir Hossain, Bharathi Raja Chakravarthi, Md. Azam Hossain, Stefan Decker

Comments: Proceeding of IEEE International Conference on Data Science and Advanced Analytics (DSAA'2021), October 6-9, 2021, Porto, Portugal

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[405] arXiv:2012.14388 [pdf, other]

Title: Universal Sentence Representation Learning with Conditional Masked Language Model

Ziyi Yang, Yinfei Yang, Daniel Cer, Jax Law, Eric Darve

Comments: Accepted to the 2021 Conference on Empirical Methods in Natural Language Processing

Subjects: Computation and Language (cs.CL)

[406] arXiv:2012.14500 [pdf, other]

Title: A Paragraph-level Multi-task Learning Model for Scientific Fact-Verification

Xiangci Li, Gully Burns, Nanyun Peng

Comments: 5 pages; The AAAI-21 Workshop on Scientific Document Understanding

Subjects: Computation and Language (cs.CL)

[407] arXiv:2012.14535 [pdf, other]

Title: Robust Dialogue Utterance Rewriting as Sequence Tagging

Jie Hao, Linfeng Song, Liwei Wang, Kun Xu, Zhaopeng Tu, Dong Yu

Comments: 11 pages

Subjects: Computation and Language (cs.CL)

[408] arXiv:2012.14541 [pdf, other]

Title: YASO: A Targeted Sentiment Analysis Evaluation Dataset for Open-Domain Reviews

Matan Orbach, Orith Toledo-Ronen, Artem Spector, Ranit Aharonov, Yoav Katz, Noam Slonim

Comments: Accepted to EMNLP 2021 (long paper). To download YASO, see this https URL

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[409] arXiv:2012.14583 [pdf, other]

Title: Understanding and Improving Lexical Choice in Non-Autoregressive Translation

Liang Ding, Longyue Wang, Xuebo Liu, Derek F. Wong, Dacheng Tao, Zhaopeng Tu

Comments: ICLR 2021

Subjects: Computation and Language (cs.CL)

[410] arXiv:2012.14602 [pdf, other]

Title: Is human scoring the best criteria for summary evaluation?

Oleg Vasilyev, John Bohannon

Comments: 7 pages, 5 figures, 1 table

Subjects: Computation and Language (cs.CL)

[411] arXiv:2012.14610 [pdf, other]

Title: UniK-QA: Unified Representations of Structured and Unstructured Knowledge for Open-Domain Question Answering

Barlas Oguz, Xilun Chen, Vladimir Karpukhin, Stan Peshterliev, Dmytro Okhonko, Michael Schlichtkrull, Sonal Gupta, Yashar Mehdad, Scott Yih

Comments: NAACL-HLT 2022 Findings

Subjects: Computation and Language (cs.CL)

[412] arXiv:2012.14642 [pdf, other]

Title: Multiple Structural Priors Guided Self Attention Network for Language Understanding

Le Qi, Yu Zhang, Qingyu Yin, Ting Liu

Subjects: Computation and Language (cs.CL)

[413] arXiv:2012.14645 [pdf, other]

Title: Interpretable NLG for Task-oriented Dialogue Systems with Heterogeneous Rendering Machines

Yangming Li, Kaisheng Yao

Comments: Accepted as a conference paper at AAAI 2021

Subjects: Computation and Language (cs.CL)

[414] arXiv:2012.14653 [pdf, other]

Title: Can You be More Social? Injecting Politeness and Positivity into Task-Oriented Conversational Agents

Yi-Chia Wang, Alexandros Papangelis, Runze Wang, Zhaleh Feizollahi, Gokhan Tur, Robert Kraut

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[415] arXiv:2012.14660 [pdf, other]

Title: A Theoretical Analysis of the Repetition Problem in Text Generation

Zihao Fu, Wai Lam, Anthony Man-Cho So, Bei Shi

Comments: AAAI 21 Paper with Appendix

Subjects: Computation and Language (cs.CL)

[416] arXiv:2012.14666 [pdf, other]

Title: RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems

Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao

Comments: 12 pages; Project website at this http URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[417] arXiv:2012.14681 [pdf, other]

Title: Faster Re-translation Using Non-Autoregressive Model For Simultaneous Neural Machine Translation

Hyojung Han, Sathish Indurthi, Mohd Abbas Zaidi, Nikhil Kumar Lakumarapu, Beomseok Lee, Sangha Kim, Chanwoo Kim, Inchul Hwang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[418] arXiv:2012.14682 [pdf, other]

Title: CascadeBERT: Accelerating Inference of Pre-trained Language Models via Calibrated Complete Models Cascade

Lei Li, Yankai Lin, Deli Chen, Shuhuai Ren, Peng Li, Jie Zhou, Xu Sun

Comments: Findings of EMNLP 2021

Subjects: Computation and Language (cs.CL)

[419] arXiv:2012.14710 [pdf, other]

Title: Code Summarization with Structure-induced Transformer

Hongqiu Wu, Hai Zhao, Min Zhang

Comments: Findings of ACL2021

Subjects: Computation and Language (cs.CL)

[420] arXiv:2012.14740 [pdf, other]

Title: LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding

Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou

Comments: ACL 2021 main conference

Subjects: Computation and Language (cs.CL)

[421] arXiv:2012.14756 [pdf, other]

Title: Dialogue Response Selection with Hierarchical Curriculum Learning

Yixuan Su, Deng Cai, Qingyu Zhou, Zibo Lin, Simon Baker, Yunbo Cao, Shuming Shi, Nigel Collier, Yan Wang

Comments: Accepted as long paper to the main conference of ACL2021

Subjects: Computation and Language (cs.CL)

[422] arXiv:2012.14763 [pdf, other]

Title: CMV-BERT: Contrastive multi-vocab pretraining of BERT

Wei Zhu, Daniel Cheung

Comments: will add more detailed technical contents, and more detailed experiments

Subjects: Computation and Language (cs.CL)

[423] arXiv:2012.14768 [pdf, other]

Title: Understanding and Improving Encoder Layer Fusion in Sequence-to-Sequence Learning

Xuebo Liu, Longyue Wang, Derek F. Wong, Liang Ding, Lidia S. Chao, Zhaopeng Tu

Comments: Accepted to ICLR 2021

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[424] arXiv:2012.14769 [pdf, other]

Title: Generating Adversarial Examples in Chinese Texts Using Sentence-Pieces

Linyang Li, Yunfan Shao, Demin Song, Xipeng Qiu, Xuanjing Huang

Comments: pre-print

Subjects: Computation and Language (cs.CL)

[425] arXiv:2012.14774 [pdf, other]

Title: Generating Query Focused Summaries from Query-Free Resources

Yumo Xu, Mirella Lapata

Comments: ACL 2021

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[426] arXiv:2012.14778 [pdf, other]

Title: Combining Semilattices and Semimodules

Filippo Bonchi, Alessio Santamaria

Journal-ref: Foundations of Software Science and Computation Structures. FOSSACS 2021. Lecture Notes in Computer Science, vol 12650 (2021), pp 102-123. Springer, Cham

Subjects: Computation and Language (cs.CL); Logic (math.LO)

[427] arXiv:2012.14781 [pdf, other]

Title: A Hierarchical Transformer with Speaker Modeling for Emotion Recognition in Conversation

Jiangnan Li, Zheng Lin, Peng Fu, Qingyi Si, Weiping Wang

Subjects: Computation and Language (cs.CL)

[428] arXiv:2012.14827 [pdf, other]

Title: Dialogue Graph Modeling for Conversational Machine Reading

Siru Ouyang, Zhuosheng Zhang, Hai Zhao

Comments: Findings of ACL: ACL 2021

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[429] arXiv:2012.14837 [pdf, other]

Title: DRS at MRP 2020: Dressing up Discourse Representation Structures as Graphs

Lasha Abzianidze, Johan Bos, Stephan Oepen

Comments: 10 pages, 4 figures, 4 tables, CoNLL 2020 Shared Task

Subjects: Computation and Language (cs.CL)

[430] arXiv:2012.14854 [pdf, other]

Title: The Parallel Meaning Bank: A Framework for Semantically Annotating Multiple Languages

Lasha Abzianidze, Rik van Noord, Chunliu Wang, Johan Bos

Comments: 13 pages, 5 figures, 1 table

Subjects: Computation and Language (cs.CL)

[431] arXiv:2012.14913 [pdf, other]

Title: Transformer Feed-Forward Layers Are Key-Value Memories

Mor Geva, Roei Schuster, Jonathan Berant, Omer Levy

Comments: EMNLP 2021

Subjects: Computation and Language (cs.CL)

[432] arXiv:2012.14919 [pdf, other]

Title: WikiTableT: A Large-Scale Data-to-Text Dataset for Generating Wikipedia Article Sections

Mingda Chen, Sam Wiseman, Kevin Gimpel

Comments: Findings of ACL 2021, camera-ready version

Subjects: Computation and Language (cs.CL)

[433] arXiv:2012.14956 [pdf, other]

Title: Generating Natural Language Attacks in a Hard Label Black Box Setting

Rishabh Maheshwary, Saket Maheshwary, Vikram Pudi

Comments: Accepted at AAAI 2021 (Main Conference)

Subjects: Computation and Language (cs.CL)

[434] arXiv:2012.14978 [pdf, other]

Title: Few-Shot Named Entity Recognition: A Comprehensive Study

Jiaxin Huang, Chunyuan Li, Krishan Subudhi, Damien Jose, Shobana Balakrishnan, Weizhu Chen, Baolin Peng, Jianfeng Gao, Jiawei Han

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[435] arXiv:2012.14983 [pdf, other]

Title: Reducing conversational agents' overconfidence through linguistic calibration

Sabrina J. Mielke, Arthur Szlam, Emily Dinan, Y-Lan Boureau

Comments: Accepted in TACL, to be presented at NAACL 2022

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[436] arXiv:2012.15015 [pdf, other]

Title: OpenViDial: A Large-Scale, Open-Domain Dialogue Dataset with Visual Contexts

Yuxian Meng, Shuhe Wang, Qinghong Han, Xiaofei Sun, Fei Wu, Rui Yan, Jiwei Li

Comments: Dataset, visual features and code are found at this https URL

Subjects: Computation and Language (cs.CL)

[437] arXiv:2012.15022 [pdf, other]

Title: ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning

Yujia Qin, Yankai Lin, Ryuichi Takanobu, Zhiyuan Liu, Peng Li, Heng Ji, Minlie Huang, Maosong Sun, Jie Zhou

Comments: Accepted by ACL-IJCNLP 2021 main conference

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[438] arXiv:2012.15023 [pdf, other]

Title: Language Identification of Devanagari Poems

Priyankit Acharya, Aditya Ku. Pathak, Rakesh Ch. Balabantaray, Anil Ku. Singh

Subjects: Computation and Language (cs.CL)

[439] arXiv:2012.15045 [pdf, other]

Title: Reservoir Transformers

Sheng Shen, Alexei Baevski, Ari S. Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela

Comments: ACL 2021

Subjects: Computation and Language (cs.CL)

[440] arXiv:2012.15070 [pdf, other]

Title: Enhancing Pre-trained Language Model with Lexical Simplification

Rongzhou Bao, Jiayi Wang, Zhuosheng Zhang, Hai Zhao

Subjects: Computation and Language (cs.CL)

[441] arXiv:2012.15075 [pdf, other]

Title: Human Evaluation of Spoken vs. Visual Explanations for Open-Domain QA

Ana Valeria Gonzalez, Gagan Bansal, Angela Fan, Robin Jia, Yashar Mehdad, Srinivasan Iyer

Comments: pre-print

Subjects: Computation and Language (cs.CL)

[442] arXiv:2012.15079 [pdf, html, other]

Title: Enhancing Sindhi Word Segmentation using Subword Representation Learning and Position-aware Self-attention

Wazir Ali, Jay Kumar, Saifullah Tumrani, Redhwan Nour, Adeeb Noor, Zenglin Xu

Comments: Journal Paper, 14 pages

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[443] arXiv:2012.15086 [pdf, other]

Title: Accurate Word Representations with Universal Visual Guidance

Zhuosheng Zhang, Haojie Yu, Hai Zhao, Rui Wang, Masao Utiyama

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[444] arXiv:2012.15115 [pdf, other]

Title: Joint Verification and Reranking for Open Fact Checking Over Tables

Michael Schlichtkrull, Vladimir Karpukhin, Barlas Oğuz, Mike Lewis, Wen-tau Yih, Sebastian Riedel

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[445] arXiv:2012.15127 [pdf, other]

Title: Improving Zero-Shot Translation by Disentangling Positional Information

Danni Liu, Jan Niehues, James Cross, Francisco Guzmán, Xian Li

Comments: ACL 2021

Subjects: Computation and Language (cs.CL)

[446] arXiv:2012.15150 [pdf, other]

Title: Improving BERT with Syntax-aware Local Attention

Zhongli Li, Qingyu Zhou, Chao Li, Ke Xu, Yunbo Cao

Comments: In ACL Findings 2021

Subjects: Computation and Language (cs.CL)

[447] arXiv:2012.15156 [pdf, other]

Title: A Memory Efficient Baseline for Open Domain Question Answering

Gautier Izacard, Fabio Petroni, Lucas Hosseini, Nicola De Cao, Sebastian Riedel, Edouard Grave

Subjects: Computation and Language (cs.CL)

[448] arXiv:2012.15178 [pdf, other]

Title: Synthetic Source Language Augmentation for Colloquial Neural Machine Translation

Asrul Sani Ariesandy, Mukhlis Amien, Alham Fikri Aji, Radityo Eko Prasojo

Comments: 5 pages

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[449] arXiv:2012.15180 [pdf, other]

Title: Out of Order: How Important Is The Sequential Order of Words in a Sentence in Natural Language Understanding Tasks?

Thang M. Pham, Trung Bui, Long Mai, Anh Nguyen

Comments: 9+7 pages, 4+4 figures. Findings of ACL 2021 (long paper)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[450] arXiv:2012.15197 [pdf, other]

Title: SemGloVe: Semantic Co-occurrences for GloVe from BERT

Leilei Gan, Zhiyang Teng, Yue Zhang, Linchao Zhu, Fei Wu, Yi Yang

Comments: 10 pages, 3 figures, 5 tables

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[451] arXiv:2012.15228 [pdf, other]

Title: Introducing Orthogonal Constraint in Structural Probes

Tomasz Limisiewicz, David Mareček

Subjects: Computation and Language (cs.CL)

[452] arXiv:2012.15229 [pdf, other]

Title: Can Sequence-to-Sequence Models Crack Substitution Ciphers?

Nada Aldarrab, Jonathan May

Comments: ACL 2021 main conference

Subjects: Computation and Language (cs.CL)

[453] arXiv:2012.15243 [pdf, other]

Title: Unsupervised Label-aware Event Trigger and Argument Classification

Hongming Zhang, Haoyu Wang, Dan Roth

Comments: ACL 2021 Findings

Subjects: Computation and Language (cs.CL)

[454] arXiv:2012.15262 [pdf, other]

Title: Robustness Testing of Language Understanding in Task-Oriented Dialog

Jiexi Liu, Ryuichi Takanobu, Jiaxin Wen, Dazhen Wan, Hongguang Li, Weiran Nie, Cheng Li, Wei Peng, Minlie Huang

Comments: ACL 2021 long paper

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[455] arXiv:2012.15263 [pdf, other]

Title: Predicting cross-linguistic adjective order with information gain

William Dyer, Richard Futrell, Zoey Liu, Gregory Scontras

Comments: 10 pages, 2 figures

Subjects: Computation and Language (cs.CL)

[456] arXiv:2012.15283 [pdf, other]

Title: ECONET: Effective Continual Pretraining of Language Models for Event Temporal Reasoning

Rujun Han, Xiang Ren, Nanyun Peng

Comments: This paper has been accepted by EMNLP'21 main conference

Subjects: Computation and Language (cs.CL)

[457] arXiv:2012.15329 [pdf, other]

Title: Generating Landmark Navigation Instructions from Maps as a Graph-to-Text Problem

Raphael Schumann, Stefan Riezler

Comments: Accepted at ACL 2021

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[458] arXiv:2012.15332 [pdf, other]

Title: Corrected CBOW Performs as well as Skip-gram

Ozan İrsoy, Adrian Benton, Karl Stratos

Comments: Presented at WINR at EMNLP 2021, added discussion about FastText, more discussion about findings, additional results on C4 data, wording changes

Subjects: Computation and Language (cs.CL); Machine Learning (stat.ML)

[459] arXiv:2012.15349 [pdf, other]

Title: DynaSent: A Dynamic Benchmark for Sentiment Analysis

Christopher Potts, Zhengxuan Wu, Atticus Geiger, Douwe Kiela

Subjects: Computation and Language (cs.CL)

[460] arXiv:2012.15353 [pdf, other]

Title: Deriving Contextualised Semantic Features from BERT (and Other Transformer Model) Embeddings

Jacob Turton, David Vinson, Robert Elliott Smith

Subjects: Computation and Language (cs.CL)

[461] arXiv:2012.15355 [pdf, other]

Title: Optimizing Deeper Transformers on Small Datasets

Peng Xu, Dhruv Kumar, Wei Yang, Wenjie Zi, Keyi Tang, Chenyang Huang, Jackie Chi Kit Cheung, Simon J.D. Prince, Yanshuai Cao

Comments: Accepted at ACL 2021 main conference

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[462] arXiv:2012.15375 [pdf, other]

Title: Refine and Imitate: Reducing Repetition and Inconsistency in Persuasion Dialogues via Reinforcement Learning and Human Demonstration

Weiyan Shi, Yu Li, Saurav Sahay, Zhou Yu

Comments: EMNLP 2021 Findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[463] arXiv:2012.15409 [pdf, other]

Title: UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning

Wei Li, Can Gao, Guocheng Niu, Xinyan Xiao, Hao Liu, Jiachen Liu, Hua Wu, Haifeng Wang

Comments: The paper has been accepted by the main conference of ACL2021 as a long paper

Subjects: Computation and Language (cs.CL)

[464] arXiv:2012.15416 [pdf, other]

Title: Directed Beam Search: Plug-and-Play Lexically Constrained Language Generation

Damian Pascual, Beni Egressy, Florian Bolli, Roger Wattenhofer

Comments: Preprint. Work in progress

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[465] arXiv:2012.15419 [pdf, other]

Title: An Experimental Evaluation of Transformer-based Language Models in the Biomedical Domain

Paul Grouchy, Shobhit Jain, Michael Liu, Kuhan Wang, Max Tian, Nidhi Arora, Hillary Ngai, Faiza Khan Khattak, Elham Dolatabadi, Sedef Akinli Kocak

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[466] arXiv:2012.15421 [pdf, other]

Title: Verb Knowledge Injection for Multilingual Event Processing

Olga Majewska, Ivan Vulić, Goran Glavaš, Edoardo M. Ponti, Anna Korhonen

Comments: 19 pages, 1 figure, 8 tables

Journal-ref: Proceedings of ACL-IJCNLP 2021 Volume 1 Long Papers 6952-6969

Subjects: Computation and Language (cs.CL)

[467] arXiv:2012.15425 [pdf, other]

Title: The jsRealB Text Realizer: Organization and Use Cases -- Revised version

Guy Lapalme

Comments: Revision that presents the new dependency notation and the Python implementation of the approach. It updates the bibliography and discusses new demonstrations and applications developed since the previous version of this paper. 31 pages, 11 figures

Subjects: Computation and Language (cs.CL)

[468] arXiv:2012.15454 [pdf, other]

Title: Text-Free Image-to-Speech Synthesis Using Learned Segmental Units

Wei-Ning Hsu, David Harwath, Christopher Song, James Glass

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[469] arXiv:2012.15455 [pdf, other]

Title: Fully Synthetic Data Improves Neural Machine Translation with Knowledge Distillation

Alham Fikri Aji, Kenneth Heafield

Subjects: Computation and Language (cs.CL)

[470] arXiv:2012.15466 [pdf, other]

Title: CLEAR: Contrastive Learning for Sentence Representation

Zhuofeng Wu, Sinong Wang, Jiatao Gu, Madian Khabsa, Fei Sun, Hao Ma

Comments: 10 pages, 2 figures

Subjects: Computation and Language (cs.CL)

[471] arXiv:2012.15482 [pdf, other]

Title: FiD-Ex: Improving Sequence-to-Sequence Models for Extractive Rationale Generation

Kushal Lakhotia, Bhargavi Paranjape, Asish Ghoshal, Wen-tau Yih, Yashar Mehdad, Srinivasan Iyer

Subjects: Computation and Language (cs.CL)

[472] arXiv:2012.15484 [pdf, other]

Title: Seeing is Knowing! Fact-based Visual Question Answering using Knowledge Graph Embeddings

Kiran Ramnath, Mark Hasegawa-Johnson

Comments: 17 pages

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[473] arXiv:2012.15495 [pdf, other]

Title: Towards Zero-Shot Knowledge Distillation for Natural Language Processing

Ahmad Rashid, Vasileios Lioutas, Abbas Ghaddar, Mehdi Rezagholizadeh

Comments: 13 pages, 8 tables, 2 algorithms and 1 figure

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[474] arXiv:2012.15504 [pdf, other]

Title: Continual Learning in Task-Oriented Dialogue Systems

Andrea Madotto, Zhaojiang Lin, Zhenpeng Zhou, Seungwhan Moon, Paul Crook, Bing Liu, Zhou Yu, Eunjoon Cho, Zhiguang Wang

Comments: 9 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[475] arXiv:2012.15515 [pdf, other]

Title: Neural Machine Translation: A Review of Methods, Resources, and Tools

Zhixing Tan, Shuo Wang, Zonghan Yang, Gang Chen, Xuancheng Huang, Maosong Sun, Yang Liu

Comments: Accepted by AI Open

Subjects: Computation and Language (cs.CL)

[476] arXiv:2012.15516 [pdf, other]

Title: AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understanding

Wissam Antoun, Fady Baly, Hazem Hajj

Subjects: Computation and Language (cs.CL)

[477] arXiv:2012.15520 [pdf, other]

Title: AraGPT2: Pre-Trained Transformer for Arabic Language Generation

Wissam Antoun, Fady Baly, Hazem Hajj

Subjects: Computation and Language (cs.CL)

[478] arXiv:2012.15524 [pdf, other]

Title: Fast WordPiece Tokenization

Xinying Song, Alex Salcianu, Yang Song, Dave Dopson, Denny Zhou

Comments: Accepted to EMNLP 2021 as an oral paper

Subjects: Computation and Language (cs.CL)

[479] arXiv:2012.15525 [pdf, other]

Title: BANG: Bridging Autoregressive and Non-autoregressive Generation with Large Scale Pretraining

Weizhen Qi, Yeyun Gong, Jian Jiao, Yu Yan, Weizhu Chen, Dayiheng Liu, Kewen Tang, Houqiang Li, Jiusheng Chen, Ruofei Zhang, Ming Zhou, Nan Duan

Comments: Accepted by ICML 2021

Subjects: Computation and Language (cs.CL)

[480] arXiv:2012.15534 [pdf, other]

Title: HopRetriever: Retrieve Hops over Wikipedia to Answer Complex Questions

Shaobo Li, Xiaoguang Li, Lifeng Shang, Xin Jiang, Qun Liu, Chengjie Sun, Zhenzhou Ji, Bingquan Liu

Comments: Accepted at AAAI 2021

Subjects: Computation and Language (cs.CL)

[481] arXiv:2012.15547 [pdf, other]

Title: XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders

Shuming Ma, Jian Yang, Haoyang Huang, Zewen Chi, Li Dong, Dongdong Zhang, Hany Hassan Awadalla, Alexandre Muzio, Akiko Eriguchi, Saksham Singhal, Xia Song, Arul Menezes, Furu Wei

Subjects: Computation and Language (cs.CL)

[482] arXiv:2012.15562 [pdf, other]

Title: UNKs Everywhere: Adapting Multilingual Language Models to New Scripts

Jonas Pfeiffer, Ivan Vulić, Iryna Gurevych, Sebastian Ruder

Comments: EMNLP 2021

Subjects: Computation and Language (cs.CL)

[483] arXiv:2012.15573 [pdf, other]

Title: Coreference Reasoning in Machine Reading Comprehension

Mingzhu Wu, Nafise Sadat Moosavi, Dan Roth, Iryna Gurevych

Comments: Accepted at ACL-IJCNLP 2021

Subjects: Computation and Language (cs.CL)

[484] arXiv:2012.15606 [pdf, other]

Title: HateCheck: Functional Tests for Hate Speech Detection Models

Paul Röttger, Bertram Vidgen, Dong Nguyen, Zeerak Waseem, Helen Margetts, Janet B. Pierrehumbert

Comments: Accepted at ACL 2021 (Main Conference)

Subjects: Computation and Language (cs.CL)

[485] arXiv:2012.15613 [pdf, other]

Title: How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models

Phillip Rust, Jonas Pfeiffer, Ivan Vulić, Sebastian Ruder, Iryna Gurevych

Comments: ACL 2021

Subjects: Computation and Language (cs.CL)

[486] arXiv:2012.15621 [pdf, other]

Title: Open Korean Corpora: A Practical Report

Won Ik Cho, Sangwhan Moon, Youngsook Song

Comments: Published in NLP-OSS @EMNLP2020; May 2023 version added with new datasets

Subjects: Computation and Language (cs.CL)

[487] arXiv:2012.15639 [pdf, other]

Title: TexSmart: A Text Understanding System for Fine-Grained NER and Enhanced Semantic Analysis

Haisong Zhang, Lemao Liu, Haiyun Jiang, Yangming Li, Enbo Zhao, Kun Xu, Linfeng Song, Suncong Zheng, Botong Zhou, Jianchen Zhu, Xiao Feng, Tao Chen, Tao Yang, Dong Yu, Feng Zhang, Zhanhui Kang, Shuming Shi

Subjects: Computation and Language (cs.CL)

[488] arXiv:2012.15643 [pdf, other]

Title: CoCoLM: COmplex COmmonsense Enhanced Language Model with Discourse Relations

Changlong Yu, Hongming Zhang, Yangqiu Song, Wilfred Ng

Subjects: Computation and Language (cs.CL)

[489] arXiv:2012.15671 [pdf, other]

Title: Vocabulary Learning via Optimal Transport for Neural Machine Translation

Jingjing Xu, Hao Zhou, Chun Gan, Zaixiang Zheng, Lei Li

Comments: Accepted by ACL 2021

Subjects: Computation and Language (cs.CL)

[490] arXiv:2012.15674 [pdf, other]

Title: ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora

Xuan Ouyang, Shuohuan Wang, Chao Pang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang

Comments: Accepted by EMNLP 2021 (main conference, long paper)

Subjects: Computation and Language (cs.CL)

[491] arXiv:2012.15682 [pdf, other]

Title: A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matters

Mengjie Zhao, Yi Zhu, Ehsan Shareghi, Ivan Vulić, Roi Reichart, Anna Korhonen, Hinrich Schütze

Comments: ACL-IJCNLP 2021

Subjects: Computation and Language (cs.CL)

[492] arXiv:2012.15688 [pdf, other]

Title: ERNIE-Doc: A Retrospective Long-Document Modeling Transformer

Siyu Ding, Junyuan Shang, Shuohuan Wang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang

Comments: Accepted by ACL 2021 (main conference, long paper)

Subjects: Computation and Language (cs.CL)

[493] arXiv:2012.15699 [pdf, other]

Title: Better Robustness by More Coverage: Adversarial Training with Mixup Augmentation for Robust Fine-tuning

Chenglei Si, Zhengyan Zhang, Fanchao Qi, Zhiyuan Liu, Yasheng Wang, Qun Liu, Maosong Sun

Comments: ACL 2021 (Findings)

Subjects: Computation and Language (cs.CL)

[494] arXiv:2012.15701 [pdf, other]

Title: BinaryBERT: Pushing the Limit of BERT Quantization

Haoli Bai, Wei Zhang, Lu Hou, Lifeng Shang, Jing Jin, Xin Jiang, Qun Liu, Michael Lyu, Irwin King

Subjects: Computation and Language (cs.CL)

[495] arXiv:2012.15710 [pdf, other]

Title: Revisiting Robust Neural Machine Translation: A Transformer Case Study

Peyman Passban, Puneeth S.M. Saladi, Qun Liu

Comments: EMNLP (findings). The first two authors contributed equally

Subjects: Computation and Language (cs.CL)

[496] arXiv:2012.15715 [pdf, other]

Title: Beyond Offline Mapping: Learning Cross Lingual Word Embeddings through Context Anchoring

Aitor Ormazabal, Mikel Artetxe, Aitor Soroa, Gorka Labaka, Eneko Agirre

Comments: ACL 2021

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[497] arXiv:2012.15717 [pdf, other]

Title: FGraDA: A Dataset and Benchmark for Fine-Grained Domain Adaptation in Machine Translation

Wenhao Zhu, Shujian Huang, Tong Pu, Pingxuan Huang, Xu Zhang, Jian Yu, Wei Chen, Yanfeng Wang, Jiajun Chen

Subjects: Computation and Language (cs.CL)

[498] arXiv:2012.15723 [pdf, other]

Title: Making Pre-trained Language Models Better Few-shot Learners

Tianyu Gao, Adam Fisch, Danqi Chen

Comments: Accepted to ACL 2021. The code is publicly available at this https URL

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[499] arXiv:2012.15738 [pdf, other]

Title: Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequences

Denis Emelin, Ronan Le Bras, Jena D. Hwang, Maxwell Forbes, Yejin Choi

Comments: For the 'Moral Stories' dataset, see this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[500] arXiv:2012.15761 [pdf, other]

Title: Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detection

Bertie Vidgen, Tristan Thrush, Zeerak Waseem, Douwe Kiela

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)