Subtitle/caption generation in Studio Mode recordings

[richiemcilroy]

In the editor, make it an option to download a local transcription AI model, and add captions to the Studio Mode recording.

This will bake the captions directly into the video frames.

This should be in the form of a new tab in the editor.

If the local transcription AI model has not been downloaded yet, prompt the user to download it first.

In the new captions tab, if the model exists and the video has audio, add a "Generate captions" button.

The caption transcription should be editable, including the design/how the text looks on the video.

Rendering the text on the GPU would probably be best achieved with glyphon

[richiemcilroy]

/bounty $500

[algora-pbc]

💎 $500 bounty • Cap

Steps to solve:

1. Start working: Comment /attempt #361 with your implementation plan
2. Submit work: Create a pull request including /claim #361 in the PR body to claim the bounty
3. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

Thank you for contributing to CapSoftware/Cap!

Add a bounty • Share on socials

Attempt	Started (GMT+0)	Solution
🟢 @benya7	Mar 12, 2025, 6:41:34 AM	WIP
🟢 @onyedikachi-david		#364
🟢 @Harsh9485		#402

[benya7]

/attempt #361

Algora profile	Completed bounties	Tech	Active attempts	Options
@benya7	2 bounties from 2 projects	TypeScript, JavaScript, Vue & more		Cancel attempt

[algora-pbc]

💡 @onyedikachi-david submitted a pull request that claims the bounty. You can visit your bounty board to reward.

[Harsh9485]

this issue is still open

[Harsh9485]

if this issue is open then I have some good steps to make this feature

• make a script to download AI model and setup in the local machine
• give some sample style to user easily choose one like major professional software did to enhance user experience also we give customize text feature using glyphon library
• now other steps is easy to implement like generate subtitle button and any more

[richiemcilroy]

Hey thanks for this. We still have a PR that has been submitted as a claim that we're still checking through :)

[Harsh9485]

ok good I'm work on this feature

[algora-pbc]

💡 @Harsh9485 submitted a pull request that claims the bounty. You can visit your bounty board to reward.