GPT and other Text Transformers: Who's Leading Whom.. and to Where?

13 May 2021
08:00 AM to 09:00 AM
Pacific Standard Time (Mexico) (UTC-08:00)

This event has expired, video available

A webinar on black swans and stochastic parrots.

Over the last year, we see increasingly more performant Text Transformers models, such as GPT-3 from OpenAI, Turing from Microsoft, and T5 from Google. They are capable of transforming the text in very creative and unexpected ways, like generating a summary of an article, explaining complex concepts in a simple language, or synthesizing realistic datasets for AI training. Unlike more traditional Machine Learning models, they do not require vast training datasets and can start based on just a few examples.

In this talk, Konstantin Savenkov and Grigory Sapunov make a short overview of such models, share the first experimental results and ask questions about the future of the content creation process. Are those models ready for prime time? What will happen to the professional content creators? Will they be able to compete against such powerful models? Will we see GPT post-editing similar to MT post-editing? The speakers will share some answers based on the extensive experimenting and the first production projects that employ this new technology.

Host organization: Intento, Inc.

Event Speakers

Konstantin Savenkov
Intento, Inc.

After getting a PhD in 2008, Konstantin Savenkov led research and development efforts for online content services, then worked as CTO at Zvooq and as a chief operating officer at Bookmate. In 2016, he contributed his experience in artificial intelligence (AI), tech and operations to found Intento, Inc., where they build tools to source, evaluate and use machine translation and other cognitive AI services.

Grigory Sapunov

CTO and co-founder of Intento. Prior to Intento Grigory worked in industry (Yandex) and academia (Higher School of Economics). He spent more than 20 years in software engineering, of which about 15 years in data analysis, artificial intelligence, and machine learning. Since 2011, he has been engaged in deep learning. Grigory is Google Developer Expert in Machine Learning and Ph.D. in Artificial Intelligence.