Computation and Language

Authors and titles for March 2022

[801] arXiv:2203.13696 (cross-list from cs.SD) [pdf, other]

Title: Speech-enhanced and Noise-aware Networks for Robust Speech Recognition

Hung-Shin Lee, Pin-Yuan Chen, Yao-Fei Cheng, Yu Tsao, Hsin-Min Wang

Comments: Published in ISCSLP 2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[802] arXiv:2203.13838 (cross-list from cs.CV) [pdf, other]

Title: Analyzing Generalization of Vision and Language Navigation to Unseen Outdoor Areas

Raphael Schumann, Stefan Riezler

Comments: accepted at ACL 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[803] arXiv:2203.13972 (cross-list from cs.CR) [pdf, other]

Title: Autoregressive Linguistic Steganography Based on BERT and Consistency Coding

Xiaoyan Zheng, Hanzhou Wu

Journal-ref: Security and Communication Networks (2022) Open Access

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[804] arXiv:2203.14049 (cross-list from cs.LG) [pdf, other]

Title: Joint Transformer/RNN Architecture for Gesture Typing in Indic Languages

Emil Biju, Anirudh Sriram, Mitesh M. Khapra, Pratyush Kumar

Comments: Published at COLING 2020, 12 pages, 4 Tables and 5 Figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[805] arXiv:2203.14101 (cross-list from cs.LG) [pdf, other]

Title: A Roadmap for Big Model

Sha Yuan, Hanyu Zhao, Shuai Zhao, Jiahong Leng, Yangxiao Liang, Xiaozhi Wang, Jifan Yu, Xin Lv, Zhou Shao, Jiaao He, Yankai Lin, Xu Han, Zhenghao Liu, Ning Ding, Yongming Rao, Yizhao Gao, Liang Zhang, Ming Ding, Cong Fang, Yisen Wang, Mingsheng Long, Jing Zhang, Yinpeng Dong, Tianyu Pang, Peng Cui, Lingxiao Huang, Zheng Liang, Huawei Shen, Hui Zhang, Quanshi Zhang, Qingxiu Dong, Zhixing Tan, Mingxuan Wang, Shuo Wang, Long Zhou, Haoran Li, Junwei Bao, Yingwei Pan, Weinan Zhang, Zhou Yu, Rui Yan, Chence Shi, Minghao Xu, Zuobai Zhang, Guoqiang Wang, Xiang Pan, Mengjie Li, Xiaoyu Chu, Zijun Yao, Fangwei Zhu, Shulin Cao, Weicheng Xue, Zixuan Ma, Zhengyan Zhang, Shengding Hu, Yujia Qin, Chaojun Xiao, Zheni Zeng, Ganqu Cui, Weize Chen, Weilin Zhao, Yuan Yao, Peng Li, Wenzhao Zheng, Wenliang Zhao, Ziyi Wang, Borui Zhang, Nanyi Fei, Anwen Hu, Zenan Ling, Haoyang Li, Boxi Cao, Xianpei Han, Weidong Zhan, Baobao Chang, Hao Sun, Jiawen Deng, Chujie Zheng, Juanzi Li, Lei Hou, Xigang Cao, Jidong Zhai, Zhiyuan Liu, Maosong Sun, Jiwen Lu, Zhiwu Lu, Qin Jin, Ruihua Song, Ji-Rong Wen, Zhouchen Lin, Liwei Wang, Hang Su, Jun Zhu, Zhifang Sui, Jiajun Zhang, Yang Liu, Xiaodong He, Minlie Huang, Jian Tang, Jie Tang

Comments: This report has been withdrawn by the authors due to critical issues in Section 2.3.1 of Article 2

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[806] arXiv:2203.14132 (cross-list from cs.LG) [pdf, other]

Title: A comparative analysis of Graph Neural Networks and commonly used machine learning algorithms on fake news detection

Fahim Belal Mahmud, Mahi Md. Sadek Rayhan, Mahdi Hasan Shuvo, Islam Sadia, Md.Kishor Morol

Comments: Accepted for publication in the 7th IEEE International Conference on Data Science and Machine Learning Applications (CDMA 2022)

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Social and Information Networks (cs.SI)

[807] arXiv:2203.14144 (cross-list from cs.DB) [pdf, other]

Title: Demonstrating CAT: Synthesizing Data-Aware Conversational Agents for Transactional Databases

Marius Gassen, Benjamin Hättasch, Benjamin Hilprecht, Nadja Geisler, Alexander Fraser, Carsten Binnig

Comments: Submitted as demonstration proposal to VLDB 2022

Subjects: Databases (cs.DB); Computation and Language (cs.CL)

[808] arXiv:2203.14222 (cross-list from eess.AS) [pdf, other]

Title: Listen, Adapt, Better WER: Source-free Single-utterance Test-time Adaptation for Automatic Speech Recognition

Guan-Ting Lin, Shang-Wen Li, Hung-yi Lee

Comments: Accepted by Interspeech 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[809] arXiv:2203.14260 (cross-list from cs.CV) [pdf, other]

Title: Unsupervised Vision-Language Parsing: Seamlessly Bridging Visual Scene Graphs with Language Structures via Dependency Relationships

Chao Lou, Wenjuan Han, Yuhuan Lin, Zilong Zheng

Comments: Updated

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[810] arXiv:2203.14343 (cross-list from cs.LG) [pdf, other]

Title: Diagonal State Spaces are as Effective as Structured State Spaces

Ankit Gupta, Albert Gu, Jonathan Berant

Comments: updated version with simpler DSS variants, RNN view for autoregressive decoding, ablation analysis, analysis of trained model parameters and kernels

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[811] arXiv:2203.14463 (cross-list from cs.CV) [pdf, other]

Title: Large-scale Bilingual Language-Image Contrastive Learning

Byungsoo Ko, Geonmo Gu

Comments: Accepted by ICLRW2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[812] arXiv:2203.14465 (cross-list from cs.LG) [pdf, other]

Title: STaR: Bootstrapping Reasoning With Reasoning

Eric Zelikman, Yuhuai Wu, Jesse Mu, Noah D. Goodman

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[813] arXiv:2203.14541 (cross-list from cs.IR) [pdf, other]

Title: Specialized Document Embeddings for Aspect-based Similarity of Research Papers

Malte Ostendorff, Till Blume, Terry Ruas, Bela Gipp, Georg Rehm

Comments: Accepted for publication at JCDL 2022

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[814] arXiv:2203.14757 (cross-list from cs.SD) [pdf, other]

Title: STUDIES: Corpus of Japanese Empathetic Dialogue Speech Towards Friendly Voice Agent

Yuki Saito, Yuto Nishimura, Shinnosuke Takamichi, Kentaro Tachibana, Hiroshi Saruwatari

Comments: 5 pages, 2 figures, Accepted for INTERSPEECH2022, project page: this http URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[815] arXiv:2203.14936 (cross-list from cs.AI) [pdf, other]

Title: FedVLN: Privacy-preserving Federated Vision-and-Language Navigation

Kaiwen Zhou, Xin Eric Wang

Comments: Accepted by ECCV 2022

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[816] arXiv:2203.14987 (cross-list from cs.AI) [pdf, other]

Title: Multilingual Knowledge Graph Completion with Self-Supervised Adaptive Graph Alignment

Zijie Huang, Zheng Li, Haoming Jiang, Tianyu Cao, Hanqing Lu, Bing Yin, Karthik Subbian, Yizhou Sun, Wei Wang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[817] arXiv:2203.15081 (cross-list from eess.AS) [pdf, other]

Title: Word Discovery in Visually Grounded, Self-Supervised Speech Models

Puyuan Peng, David Harwath

Comments: Interspeech 2022 Oral. Update Table 5

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)

[818] arXiv:2203.15125 (cross-list from cs.CV) [pdf, other]

Title: Text2Pos: Text-to-Point-Cloud Cross-Modal Localization

Manuel Kolmet, Qunjie Zhou, Aljosa Osep, Laura Leal-Taixe

Comments: CVPR2022 Camera Ready Version

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[819] arXiv:2203.15147 (cross-list from eess.AS) [pdf, other]

Title: Separate What You Describe: Language-Queried Audio Source Separation

Xubo Liu, Haohe Liu, Qiuqiang Kong, Xinhao Mei, Jinzheng Zhao, Qiushi Huang, Mark D. Plumbley, Wenwu Wang

Comments: Submitted to INTERSPEECH 2022, 5 pages, 3 figures

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD); Signal Processing (eess.SP)

[820] arXiv:2203.15183 (cross-list from eess.AS) [pdf, other]

Title: Visualizations of Complex Sequences of Family-Infant Vocalizations Using Bag-of-Audio-Words Approach Based on Wav2vec 2.0 Features

Jialu Li, Mark Hasegawa-Johnson, Nancy L. McElwain

Comments: Submitted to Interspeech 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[821] arXiv:2203.15206 (cross-list from cs.SD) [pdf, other]

Title: Shifted Chunk Encoder for Transformer Based Streaming End-to-End ASR

Fangyuan Wang, Bo Xu

Comments: This paper has been accepted by iconip 2022, update the latest version

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[822] arXiv:2203.15250 (cross-list from eess.SP) [pdf, other]

Title: Analysis of EEG frequency bands for Envisioned Speech Recognition

Ayush Tripathi

Subjects: Signal Processing (eess.SP); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS); Neurons and Cognition (q-bio.NC)

[823] arXiv:2203.15276 (cross-list from cs.SD) [pdf, other]

Title: Applying Syntax$\unicode{x2013}$Prosody Mapping Hypothesis and Prosodic Well-Formedness Constraints to Neural Sequence-to-Sequence Speech Synthesis

Kei Furukawa, Takeshi Kishiyama, Satoshi Nakamura

Comments: Submitted to INTERSPEECH 2022

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[824] arXiv:2203.15321 (cross-list from cs.SD) [pdf, other]

Title: Noise-robust Speech Recognition with 10 Minutes Unparalleled In-domain Data

Chen Chen, Nana Hou, Yuchen Hu, Shashank Shirol, Eng Siong Chng

Comments: Accepted by ICASSP2022

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[825] arXiv:2203.15364 (cross-list from cs.IR) [pdf, other]

Title: The Inefficiency of Language Models in Scholarly Retrieval: An Experimental Walk-through

Shruti Singh, Mayank Singh

Comments: 21 pages. To appear in Findings of ACL 2022

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[826] arXiv:2203.15414 (cross-list from cs.SE) [pdf, other]

Title: Quality Assurance of Generative Dialog Models in an Evolving Conversational Agent Used for Swedish Language Practice

Markus Borg, Johan Bengtsson, Harald Österling, Alexander Hagelborn, Isabella Gagner, Piotr Tomaszewski

Comments: Accepted for publication in the Proc. of the 1st International Conference on AI Engineering, 2022

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[827] arXiv:2203.15455 (cross-list from cs.SD) [pdf, other]

Title: WeNet 2.0: More Productive End-to-End Speech Recognition Toolkit

Binbin Zhang, Di Wu, Zhendong Peng, Xingchen Song, Zhuoyuan Yao, Hang Lv, Lei Xie, Chao Yang, Fuping Pan, Jianwei Niu

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[828] arXiv:2203.15526 (cross-list from cs.SD) [pdf, other]

Title: Interactive Audio-text Representation for Automated Audio Captioning with Contrastive Learning

Chen Chen, Nana Hou, Yuchen Hu, Heqing Zou, Xiaofeng Qi, Eng Siong Chng

Comments: Submitted to Interspeech 2022

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[829] arXiv:2203.15568 (cross-list from cs.SD) [pdf, other]

Title: A Dataset for Speech Emotion Recognition in Greek Theatrical Plays

Maria Moutti, Sofia Eleftheriou, Panagiotis Koromilas, Theodoros Giannakopoulos

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG)

[830] arXiv:2203.15576 (cross-list from cs.SD) [pdf, other]

Title: Subspace-based Representation and Learning for Phonotactic Spoken Language Recognition

Hung-Shin Lee, Yu Tsao, Shyh-Kang Jeng, Hsin-Min Wang

Comments: Published in IEEE/ACM Trans. Audio, Speech, Lang. Process., 2020, vol. 28, pp. 3065-3079

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[831] arXiv:2203.15610 (cross-list from eess.AS) [pdf, other]

Title: LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT

Rui Wang, Qibing Bai, Junyi Ao, Long Zhou, Zhixiang Xiong, Zhihua Wei, Yu Zhang, Tom Ko, Haizhou Li

Comments: 5 pages, 2 figures, accepted to Insterspeech 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[832] arXiv:2203.15613 (cross-list from cs.SD) [pdf, other]

Title: Dynamic Latency for CTC-Based Streaming Automatic Speech Recognition With Emformer

Jingyu Sun, Guiping Zhong, Dinghao Zhou, Baoxiang Li

Comments: 5 pages, 2 figures, submitted to interspeech 2022

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[833] arXiv:2203.15643 (cross-list from cs.SD) [pdf, other]

Title: Nix-TTS: Lightweight and End-to-End Text-to-Speech via Module-wise Distillation

Rendi Chevi, Radityo Eko Prasojo, Alham Fikri Aji, Andros Tjandra, Sakriani Sakti

Comments: Accepted at SLT 2022 (this https URL). Associated materials can be seen in this https URL

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)

[834] arXiv:2203.15685 (cross-list from cs.CV) [pdf, other]

Title: EnvEdit: Environment Editing for Vision-and-Language Navigation

Jialu Li, Hao Tan, Mohit Bansal

Comments: CVPR 2022 (17 pages)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[835] arXiv:2203.15686 (cross-list from cs.CE) [pdf, other]

Title: Forecasting with Economic News

Luca Barbaglia, Sergio Consoli, Sebastiano Manzan

Comments: 46 pages, 11 figures, to be published in Journal of Business & Economic Statistics

Subjects: Computational Engineering, Finance, and Science (cs.CE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Applications (stat.AP)

[836] arXiv:2203.15863 (cross-list from eess.AS) [pdf, other]

Title: WAVPROMPT: Towards Few-Shot Spoken Language Understanding with Frozen Language Models

Heting Gao, Junrui Ni, Kaizhi Qian, Yang Zhang, Shiyu Chang, Mark Hasegawa-Johnson

Comments: submitted to INTERSPEECH 2022

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[837] arXiv:2203.15867 (cross-list from cs.CV) [pdf, other]

Title: Image Retrieval from Contextual Descriptions

Benno Krojer, Vaibhav Adlakha, Vibhav Vineet, Yash Goyal, Edoardo Ponti, Siva Reddy

Comments: accepted to ACL 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[838] arXiv:2203.15937 (cross-list from eess.AS) [pdf, other]

Title: Improving Mispronunciation Detection with Wav2vec2-based Momentum Pseudo-Labeling for Accentedness and Intelligibility Assessment

Mu Yang, Kevin Hirschi, Stephen D. Looney, Okim Kang, John H. L. Hansen

Comments: Accepted to Interspeech 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[839] arXiv:2203.15966 (cross-list from cs.SD) [pdf, other]

Title: Federated Domain Adaptation for ASR with Full Self-Supervision

Junteng Jia, Jay Mahadeokar, Weiyi Zheng, Yuan Shangguan, Ozlem Kalinli, Frank Seide

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[840] arXiv:2203.15974 (cross-list from eess.AS) [pdf, other]

Title: Multi-scale Speaker Diarization with Dynamic Scale Weighting

Tae Jin Park, Nithin Rao Koluguri, Jagadeesh Balam, Boris Ginsburg

Comments: Submitted to Interspeech 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[841] arXiv:2203.16040 (cross-list from cs.SD) [pdf, other]

Title: Disentangling the Impacts of Language and Channel Variability on Speech Separation Networks

Fan-Lin Wang, Hung-Shin Lee, Yu Tsao, Hsin-Min Wang

Comments: Published in Interspeech 2022

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[842] arXiv:2203.16361 (cross-list from cs.SD) [pdf, other]

Title: Rainbow Keywords: Efficient Incremental Learning for Online Spoken Keyword Spotting

Yang Xiao, Nana Hou, Eng Siong Chng

Comments: Accepted to Interspeech 2022

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[843] arXiv:2203.16434 (cross-list from cs.CV) [pdf, other]

Title: TubeDETR: Spatio-Temporal Video Grounding with Transformers

Antoine Yang, Antoine Miech, Josef Sivic, Ivan Laptev, Cordelia Schmid

Comments: Updated vIoU results compared to the CVPR'22 camera-ready version; 17 pages; 8 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[844] arXiv:2203.16639 (cross-list from cs.CV) [pdf, other]

Title: FALCON: Fast Visual Concept Learning by Integrating Images, Linguistic descriptions, and Conceptual Relations

Lingjie Mei, Jiayuan Mao, Ziqi Wang, Chuang Gan, Joshua B. Tenenbaum

Comments: First two authors contributed equally. Project page: this http URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[845] arXiv:2203.16646 (cross-list from cs.SD) [pdf, other]

Title: Generation of Speaker Representations Using Heterogeneous Training Batch Assembly

Yu-Huai Peng, Hung-Shin Lee, Pin-Tuan Huang, Hsin-Min Wang

Comments: Published in APSIPA ASC 2021

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[846] arXiv:2203.16682 (cross-list from cs.CV) [pdf, other]

Title: To Find Waldo You Need Contextual Cues: Debiasing Who's Waldo

Yiran Luo, Pratyay Banerjee, Tejas Gokhale, Yezhou Yang, Chitta Baral

Comments: Accepted at ACL 2022 (Short Paper)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[847] arXiv:2203.16685 (cross-list from eess.AS) [pdf, other]

Title: Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings

Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka

Comments: Accepted for presentation at Interspeech 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[848] arXiv:2203.16691 (cross-list from eess.AS) [pdf, other]

Title: MAE-AST: Masked Autoencoding Audio Spectrogram Transformer

Alan Baade, Puyuan Peng, David Harwath

Comments: Submitted to INTERSPEECH. 5 pages, 2 figures, 5 tables

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[849] arXiv:2203.16705 (cross-list from eess.AS) [pdf, other]

Title: Robust Disentangled Variational Speech Representation Learning for Zero-shot Voice Conversion

Jiachen Lian, Chunlei Zhang, Dong Yu

Comments: Accepted to 2022 ICASSP

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Signal Processing (eess.SP)

[850] arXiv:2203.16738 (cross-list from cs.SD) [pdf, other]

Title: Improving speaker de-identification with functional data analysis of f0 trajectories

Lauri Tavi, Tomi Kinnunen, Rosa González Hautamäki

Comments: Accepted to Speech Communication. March 2022

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)