Skip to content

AI Live Streaming Overview

Clevercast lets you add AI-generated closed captions and synthetic speech translations to your live stream in multiple languages.

Notes:

Introduction

If you are a first-time user, we encourage you to read our introduction to live streams with AI closed captions and speech translations.

Getting Started

Both guides assume that you embed our video player. For other ways to deliver the live stream or subtitles, see 'Delivery options' below.

Management

The event page

In Clevercast, an 'Event' refers to the configuration and management of a live stream. Our manual on creating and managing AI events gives you in-depth information on:

The vocabulary

To improve the accuracy of AI captions and speech, Clevercast lets you create Vocabularies. Our vocabulary guide explains how to add terms (names, acronyms, jargon) to the vocabulary, so they will be correctly detected, displayed and pronounced.

The real-time correction room

Real-time Correction is an optional feature, that allows human editors to correct the AI speech-to-text conversion in real-time, so the AI-generated closed captions and speech translation will be 100% accurate.

The real-time management room

The Real-time Management room lets you watch the incoming stream without delay, pause AI captions and speech, change the speech-to-text language (manually or automatically) and communicate with real-time correctors through text chat.

Delivery options

Live streaming in embedded player

Clevercast is designed for customers to embed our video player on their site or third-party platform. This lets you to take full advantage of the integration of our platform and video player. Under the hood, Clevercast does adaptive live streaming with global delivery (using Akamai). Your viewers can select their preferred closed captions and/or speech translations in the player.

Delivering the live stream yourself

The live stream, including subtitles and audio translations, is delivered through the HTTP Live Streaming (HLS) protocol. It is therefore possible to retrieve the streams, deliver them yourself and use your own player. Contact us if you wish to do so. Keep in mind that you'll lose all features related to the integration of our video player and platform (e.g. event status switching with poster images, showing custom messages in the player, analytics data).

Real-time transcription for on-site users

Clevercast lets event organizers make the AI text transcript and its translations available in the form of a real-time scrolling text page. On-site participants can use it to read the speech-to-text conversion without any delay, for example on a big screen or on their smartphone. It can also be used by remote participants in virtual events. For more info, see using real-time transcription.

Simulcasting

Clevercast supports simulcasting of live streams with AI generated subtitles that are burned into the video stream. By using this feature, you can send a live stream to YouTube (or other social media) with accurate subtitles in any language, perfectly in-sync with the video.

Cloud recording & Video on-Demand

Clevercast automatically makes cloud recordings of live streams, including AI-generated closed captions and speech translations. All recordings can be downloaded and/or converted to multilingual VoD items, which can be embedded or used as the source for simulive streaming.

You can also upload a single-language video, and add AI-generated closed captions and speech translations to it.