Web: http://arxiv.org/abs/2103.06459

Sept. 16, 2022, 1:16 a.m. | Linlin Liu, Thien Hai Nguyen, Shafiq Joty, Lidong Bing, Luo Si

cs.CL updates on arXiv.org arxiv.org

Cross-lingual word embeddings (CLWE) have been proven useful in many
cross-lingual tasks. However, most existing approaches to learn CLWE including
the ones with contextual embeddings are sense agnostic. In this work, we
propose a novel framework to align contextual embeddings at the sense level by
leveraging cross-lingual signal from bilingual dictionaries only. We
operationalize our framework by first proposing a novel sense-aware cross
entropy loss to model word senses explicitly. The monolingual ELMo and BERT
models pretrained with our sense-aware …

alignment arxiv cross-lingual sense

Research Scientists

@ ODU Research Foundation | Norfolk, Virginia

Embedded Systems Engineer (Robotics)

@ Neo Cybernetica | Bedford, New Hampshire

2023 Luis J. Alvarez and Admiral Grace M. Hopper Postdoc Fellowship in Computing Sciences

@ Lawrence Berkeley National Lab | San Francisco, CA

Senior Manager Data Scientist

@ NAV | Remote, US

Senior AI Research Scientist

@ Earth Species Project | Remote anywhere

Research Fellow- Center for Security and Emerging Technology (Multiple Opportunities)

@ University of California Davis | Washington, DC

Staff Fellow - Data Scientist

@ U.S. FDA/Center for Devices and Radiological Health | Silver Spring, Maryland

Staff Fellow - Senior Data Engineer

@ U.S. FDA/Center for Devices and Radiological Health | Silver Spring, Maryland

Data Scientist (Analytics) - Singapore

@ Momos | Singapore, Central, Singapore

Machine Learning Scientist, Drug Discovery

@ Flagship Pioneering, Inc. | Cambridge, MA

Applied Scientist - Computer Vision

@ Flawless | Los Angeles, California, United States

Sr. Data Engineer, Customer Service

@ Wayfair Inc. | Boston, MA