Skip to main content

Documentation Index

Fetch the complete documentation index at: https://mintlify.com/anil-matcha/open-generative-ai/llms.txt

Use this file to discover all available pages before exploring further.

Lip Sync Studio animates speech onto faces using audio as the driving signal. It supports two fundamentally different workflows: in Portrait Image mode you supply a still portrait photograph plus an audio file and the studio generates a talking-head video from scratch; in Video mode you supply an existing video alongside a new audio track and the studio re-syncs the lip movements to match the new audio. Nine dedicated models are spread across both modes, covering a range of resolutions, motion quality levels, and output styles.

Mode Toggle

Switch between the two input modes using the toggle at the top of the studio:
ModeInputOutput
Portrait ImageStill portrait image + audio fileAnimated talking-head video
VideoExisting video + audio fileLipsync video with re-synced lip movements

Image-based Models

These models take a portrait image and an audio file and produce a talking video. A text prompt is accepted as an optional parameter to guide the motion style.
ModelEndpointResolutionsPrompt
Infinite Talkinfinitetalk-image-to-video480p, 720pOptional
Wan 2.2 Speech to Videowan2.2-speech-to-video480p, 720pOptional
LTX 2.3 Lipsyncltx-2.3-lipsync480p, 720p, 1080pOptional
LTX 2 19B Lipsyncltx-2-19b-lipsync480p, 720p, 1080pOptional

Video-based Models

These models accept an existing video and an audio file, replacing the original speech with the new audio track by resynthesising the lip movements.
ModelEndpoint
Sync Lipsyncsync-lipsync
LatentSynclatentsync-video
Creatify Lipsynccreatify-lipsync
Veed Lipsyncveed-lipsync
Infinite Talk V2Vinfinitetalk-video-to-video
Infinite Talk V2V also accepts an optional resolution picker (480p, 720p) and an optional prompt, making it the most flexible of the video-based models.

How It Works

1

Select a mode

Use the Portrait Image / Video toggle at the top of the studio to choose whether you are starting from a still image or an existing video.
2

Upload your portrait or video

Click the image upload button (Portrait Image mode) or the video upload button (Video mode) and select your source file. The file is uploaded to the Muapi file store and its URL is passed directly to the model.
3

Upload your audio

Click the audio upload button and select the audio file you want to use as the speech source. Supported formats include common audio types (MP3, WAV, etc.).
4

Enter an optional prompt

For models that support it, you can type a prompt to influence motion style or expression. Leave the field blank to let the model infer the motion from the audio alone.
5

Select a model and resolution

Choose the model that best fits your use case from the model picker. If the selected model exposes a resolution option, choose your preferred output resolution (480p, 720p, or 1080p where available).
6

Generate

Click Generate. The job is submitted to the Muapi API using the processLipSync() function, which polls until the output video URL is ready.

Generation History

Lip sync generations are saved separately from other studio outputs in a dedicated lipsync_history key in localStorage. If a generation is still pending when you close or reload the page, it resumes automatically on the next page load — you will not lose in-progress jobs.
For the cleanest results in Portrait Image mode, use a front-facing portrait with even lighting and a neutral expression as your source image. Avoid images where the subject’s mouth is obscured or the face is at a steep angle.

Build docs developers (and LLMs) love