PulseAugur
LIVE 04:08:50
research · [3 sources] ·
0
research

LLM code translation evaluation moves beyond BLEU to semantic correctness

A new paper analyzes cross-lingual text simplification (CLTS) strategies for English and French using large language models. The study compared five prompting systems, including direct, composition, and decomposition approaches, to see if translating then simplifying or simplifying then translating yielded better results. While direct prompting maintained meaning fidelity, the "Translate-then-Simplify" method produced the simplest output according to linguistic features. AI

Summary written by gemini-2.5-flash-lite from 3 sources. How we write summaries →

IMPACT Identifies optimal prompting strategies for cross-lingual text simplification, potentially improving accessibility of information across languages.

RANK_REASON Academic paper analyzing LLM prompting strategies for cross-lingual text simplification.

Read on arXiv cs.CL →

COVERAGE [3]

  1. arXiv cs.CL TIER_1 · Julius N\"aumann, Sven Keidel, Amir Molzam Sharifloo, Mira Mezini ·

    Beyond BLEU: A Semantic Evaluation Method for Code Translation

    arXiv:2605.05282v1 Announce Type: cross Abstract: Code translation is one of the core capabilities of LLMs. However, evaluating the correctness of translations remains difficult, as commonly used metrics such as BLEU measure only syntactic similarity, disregarding program semanti…

  2. arXiv cs.CL TIER_1 · Ido Dahan, Omer Toledano, Roey J. Gafter, Sharon Pardo, Oren Tsur, Hila Zahavi, Elior Sulem ·

    Translate or Simplify First: An Analysis of Cross-lingual Text Simplification in English and French

    arXiv:2604.23844v1 Announce Type: new Abstract: Cross-Lingual Text Simplification (CLTS) aims to make content more accessible across languages by simultaneously addressing both linguistic complexity and translation. This study investigates the effectiveness of different prompting…

  3. arXiv cs.CL TIER_1 · Elior Sulem ·

    Translate or Simplify First: An Analysis of Cross-lingual Text Simplification in English and French

    Cross-Lingual Text Simplification (CLTS) aims to make content more accessible across languages by simultaneously addressing both linguistic complexity and translation. This study investigates the effectiveness of different prompting strategies for CLTS between English and French …