Skip to content

feat: Add VideoCaptioner CLI — AI video captioning with styled subtitles#166

Merged
yuh-yang merged 4 commits intoHKUDS:mainfrom
WEIFENG2333:feat/videocaptioner-harness
Apr 1, 2026
Merged

feat: Add VideoCaptioner CLI — AI video captioning with styled subtitles#166
yuh-yang merged 4 commits intoHKUDS:mainfrom
WEIFENG2333:feat/videocaptioner-harness

Conversation

@WEIFENG2333
Copy link
Copy Markdown

@WEIFENG2333 WEIFENG2333 commented Mar 29, 2026

Summary

Adds cli-anything-videocaptioner, an agent-native CLI harness for VideoCaptioner — AI-powered video captioning tool (13.7k+ ⭐, PyPI).

PixPin_2026-03-29_21-32-10 PixPin_2026-03-29_21-33-37

Full pipeline: speech transcription → subtitle optimization → translation (38 languages) → video synthesis with styled subtitles. Free ASR and translation included, zero API key needed for basic usage.

Command Groups

Group Commands Description
transcribe 4 ASR engines Speech → subtitles (bijian/jianying free, whisper-api, whisper-cpp)
subtitle 3 translators Optimize + translate subtitles (LLM, Bing free, Google free)
synthesize 5 style presets Burn styled subtitles into video (ASS outline + rounded background)
process full pipeline One command: transcribe → optimize → translate → synthesize
styles List all subtitle style presets with parameters
config show, set Manage configuration
download Download online video (YouTube, Bilibili, etc.)
session status Version and state info

Architecture

videocaptioner/agent-harness/
├── VIDEOCAPTIONER.md
├── setup.py
└── cli_anything/videocaptioner/
    ├── videocaptioner_cli.py       # Click CLI (9 commands + REPL)
    ├── core/                        # transcribe, subtitle, synthesize, pipeline
    ├── utils/vc_backend.py          # subprocess wrapper for videocaptioner CLI
    ├── skills/SKILL.md
    └── tests/                       # 14 unit + 12 e2e (26/26 passing)

Install

pip install videocaptioner          # the underlying tool
pip install -e videocaptioner/agent-harness   # the CLI-Anything harness

Type of Change

  • New Software CLI — adds a CLI harness for a new application

For New Software CLIs

  • VIDEOCAPTIONER.md SOP document exists at videocaptioner/agent-harness/VIDEOCAPTIONER.md
  • SKILL.md exists inside the Python package
  • Unit tests at tests/test_core.py are present and pass without backend (14 tests)
  • E2E tests at tests/test_full_e2e.py are present (12 tests)
  • README.md inside the package
  • registry.json includes an entry for the new software
  • README.md updated with new software entry (table + directory tree)
  • repl_skin.py in utils/ is a copy from the plugin

General Checklist

  • Code follows existing patterns and conventions
  • --json flag is supported on all commands
  • Commit messages follow conventional format
  • Tested locally — 26/26 tests passing, real transcription/translation/synthesis verified

Add agent-harness for VideoCaptioner, an AI-powered video captioning tool.

Pipeline: Speech transcription → Subtitle optimization → Translation → Video synthesis with styled subtitles.

Key features:
- 4 ASR engines (bijian/jianying free, whisper-api, whisper-cpp)
- 3 translation services (LLM, Bing free, Google free), 38 languages
- Beautiful subtitle styles (ASS outline + rounded background)
- Full pipeline in one command
- 26 tests (14 unit + 12 e2e), all passing
@WEIFENG2333 WEIFENG2333 changed the title feat: Add VideoCaptioner — AI video captioning with styled subtitles feat: Add VideoCaptioner CLI — AI video captioning with styled subtitles Mar 29, 2026
@WEIFENG2333 WEIFENG2333 force-pushed the feat/videocaptioner-harness branch from 0e7bd3a to e410f56 Compare March 29, 2026 13:39
@yuh-yang yuh-yang added the community-contrib-CLI Community-contributed CLI or harness label Mar 30, 2026
@yuh-yang
Copy link
Copy Markdown
Collaborator

yuh-yang commented Apr 1, 2026

Thanks! The test results and examples look great.

@yuh-yang yuh-yang merged commit 9d463de into HKUDS:main Apr 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

community-contrib-CLI Community-contributed CLI or harness

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants