Détail du document
Identifiant

oai:arXiv.org:2406.01919

Sujet
Computer Science - Computation and...
Auteur
Huang, Chenyang Ghaddar, Abbas Kobyzev, Ivan Rezagholizadeh, Mehdi Zaiane, Osmar R. Chen, Boxing
Catégorie

Computer Science

Année

2024

Date de référencement

12/06/2024

Mots clés
mt
Métrique

Résumé

Recently, there has been considerable attention on detecting hallucinations and omissions in Machine Translation (MT) systems.

The two dominant approaches to tackle this task involve analyzing the MT system's internal states or relying on the output of external tools, such as sentence similarity or MT quality estimators.

In this work, we introduce OTTAWA, a novel Optimal Transport (OT)-based word aligner specifically designed to enhance the detection of hallucinations and omissions in MT systems.

Our approach explicitly models the missing alignments by introducing a "null" vector, for which we propose a novel one-side constrained OT setting to allow an adaptive null alignment.

Our approach yields competitive results compared to state-of-the-art methods across 18 language pairs on the HalOmi benchmark.

In addition, it shows promising features, such as the ability to distinguish between both error types and perform word-level detection without accessing the MT system's internal states.

;Comment: Accepted by ACL 2024 Findings

Huang, Chenyang,Ghaddar, Abbas,Kobyzev, Ivan,Rezagholizadeh, Mehdi,Zaiane, Osmar R.,Chen, Boxing, 2024, OTTAWA: Optimal TransporT Adaptive Word Aligner for Hallucination and Omission Translation Errors Detection

Document

Ouvrir

Partager

Source

Articles recommandés par ES/IODE IA

High-Frequency Repetitive Magnetic Stimulation at the Sacrum Alleviates Chronic Constipation in Parkinson’s Patients
magnetic stimulation parkinson’s significant patients scale sacrum pd hf-rms chronic constipation scores
The mechanism of PFK-1 in the occurrence and development of bladder cancer by regulating ZEB1 lactylation
bladder cancer pfk-1 zeb1 lactylation glycolysis inhibits lactate glucose bc pfk-1 cancer lactylation cells bladder