跳到正文
DEV Community· Magic Hour·· 14 天前AI 評分47

已有錄音時的對嘴 API 比較

Lip-sync APIs when you already have the voice recording

AI 導讀

這篇比較按已有錄音選擇對嘴 API 的路線:現有影片可評估 Magic Hour Lip Sync,靜態人像可評估 Magic Hour AI Talking Photo,多位説話者的影片則可評估 Sync Labs。各路線的輸入欄位和説話者、片段控制各有不同,應先核對所選模型支援的選項。內容比較的是文件所述輸入方式,沒有提供渲染測試或準確度分數。

正文

Magic Hour

Magic Hour publishes this comparison and provides two of the routes below. AI generated the writing from the cited documentation. The examples compare input contracts. They do not report render tests or accuracy scores.

If you already have a voice track, start by checking the visual input. Existing footage needs video lip sync. A still portrait needs a talking-photo workflow. A scene with multiple speakers may also need an API that lets you specify who speaks and when.

Input and job Route to evaluate What to verify
Existing video plus a replacement recording Magic Hour Lip Sync, POST /v1/lip-sync Send video_file_path and audio_file_path in assets. The request's start and end times select the video clip.
A still portrait plus a recording Magic Hour AI Talking Photo, POST /v1/ai-talking-photo Send image_file_path and audio_file_path in assets. Start with one visible face.
Existing footage where you need speaker or segment controls Sync Labs, POST /v2/generate Its documentation covers typed video and audio inputs, speaker selection and segment controls. Check the options for your chosen model before building the UI.

Magic Hour Lip Sync schema · Magic Hour Talking Photo schema · Sync Labs generation schema · Sync Labs segment controls

One input change switches the workflow

This five-second example uses Magic Hour's video lip-sync route. Replace the example paths with files uploaded for your account.

{
  "start_seconds": 0,
  "end_seconds": 5,
  "assets": {
    "video_source": "file",
    "video_file_path": "api-assets/id/speaker.mp4",
    "audio_file_path": "api-assets/id/new-voice.wav"
  }
}

If you have a portrait instead of footage, send image_file_path and audio_file_path to the talking-photo endpoint. Dropping an image into the video field would ask the wrong route to do the job. Magic Hour upload flow

Decide what counts as usable

  • Try an authorized five-second excerpt with a clear view of the speaker's mouth and a clean recording. Compare mouth motion at the first word, the hardest phrase and the last word.
  • In a multi-speaker scene, check the people who should remain unchanged. Confirm whether the documented controls apply to your model before promising automatic speaker selection.
  • Download the completed artifact and check the actual audio duration and alignment. Keep API completion separate from your review result. One passing clip is a starting point for testing harder footage.

Magic Hour video status and downloads · Sync Labs speaker selection

來源:DEV Community · dev.to