[GALA Valencia 2024] Failing Is Not an Option: Language Quality Management in the Age of LLMs and Gen AI
Localization quality management is undergoing a profound transformation, driven by the integration of cutting-edge AI technologies. Specifically, Large Language Models (LLMs), Quality Estimation (QE) features, and Gen AI tools have emerged as game-changers, raising two captivating questions: 1) How can we assess and maintain the quality of AI-generated content within the localization industry? 2) Can we leverage the potential of these innovative technologies to automate certain translation quality management tasks? Our panel brings together well-respected subject matter experts in localization quality and localization technologies, each representing various client-side companies. The goal is to facilitate a comprehensive discussion aimed at exploring these pivotal inquiries and sharing best practices.
Throughout our dialogue, we will address four fundamental themes:
• We will discuss strategies and present real-world examples that illustrate the integration of AI into existing quality evaluation frameworks.
• We will explore how LLMs are fundamentally reshaping the evaluation of translation quality.
• We will review the advantages of AI-driven automation in quality evaluation processes, as well as their potential applications and limitations in streamlining operations and ensuring efficiency and precision.
• Finally, we will focus on the intricate dynamics of human localization versus an AI-driven multilingual content generation era, offering insights on maintaining cultural relevance while adapting to transformative technologies.
Drawing from the hands-on experiences of each panellist, we will take the first step towards charting the course for the future of localization quality management in an AI-driven world.
Host organization: Globalization and Localization Association
Event Speakers
Jennifer Vela-Valido
Spotify
Jennifer is a Localization Strategist with over 10 years of experience in the industry. She works as a Localization Quality Program Manager at Spotify. Jennifer recently completed her PhD in Localization Quality Management and she also works as a researcher specializing in localization strategies, vendor management and linguistic quality management. She is an active member of Subcommittee F43.03 on Language Translation at ASTM International and the ISO/TC 37/SC 5/WG 1 – Translation group at ISO.
Katerina Gasova
Argos Multilingual
Katerina has over 25 years of experience in the industry, predominantly in quality management. In 2004, she founded Moravia Linguistic Services, a team of linguistic experts located around the globe. Under her leadership, the team designed and successfully implemented numerous customized and often complex quality management programs for both top industry brands and start-ups. In 2022, Katerina joined Argos Multilingual, a global language solutions provider with clients in the high-tech, life sciences, human resources, and financial industries. As the Global Quality Solutions Strategist, Katerina focuses on transforming the traditional approach to quality management seen as a set of separate quality-control tasks into client-centric quality programs. The shift involves engaging, empowering, and holding accountable key linguistic stakeholders throughout the project life cycle, while leveraging the cutting-edge technologies and innovations. Katerina actively engages in various initiatives aimed at exploring AI-assisted solutions in quality management, scrutinizing NMT and GenAI output quality and (auto-)post-editing data in relation to client-defined quality expectations. Her regular presentations and webinars are dedicated to sharing best practices in dynamic, use-case-driven quality management and advocating for user-focused quality principles. Katerina is a member of the MQM Council, an active member of Subcommittee F43.03 on Language Translation at ASTM International, and a regular contributor to various GALA's expert groups.
Lucía Guerrero
Expedia Group, Inc.
Lucía Guerrero is Machine Translation Manager at Expedia Group and also part of the collaborative teaching staff at the Universitat Oberta de Catalunya. In the translation industry since 1998, she has been Machine Translation Specialist and Translation Project Manager at CPSL, managed localization projects for Apple Computer and translated children’s and art books.