做影片描述時,最易出錯唔係句子寫得唔夠長,而係講到某個人、物件或角度時,無法交代文字究竟對應邊張參考圖。RefCaptioner屬於影片字幕生成模型項目,集中處理 multi-reference image-grounded video captioning:一邊保留細節與事實準確度,一邊將局部描述同候選參考圖明確綁定。
Prompt:
4 NFE PDD on Wan2.1 14B: A joyful child,
with a big smile and arms spread wide,
swings energetically on a rusty old swing set in a sunlit backyard. The swing set, with peeling paint and creaking chains,
contrasts against the vibrant green grass and blooming flowers surrounding it.
The child's laughter echoes as they swing higher and higher,
their feet barely touching the ground at the bottom of each arc.
The scene is captured from a low angle,
emphasizing the height of the swings,
with the sun casting a warm glow over everything.
Medium shot focusing on the child and the swing set.
訓練部分用了 Mixture-of-Students 設計,並以 GAN Control Regularization 處理蒸餾時的 camera drift,目標是同時保住控制能力同長期一致性。現階段公開資訊以示範與技術報告為主,Code 同 HuggingFace 尚未釋出;不過單看定位,Wonder已經清楚指向一類更接近「可互動世界」而唔係「一次性影片生成」的世界模型方向。