Skip to content

AI Companion for Videos using Captions text & User API Keys #12802

@Siddiq2772

Description

@Siddiq2772

Checklist

  • I made sure that there are no existing issues - open or closed - which I could contribute my information to.
  • I have read the FAQ and my problem isn't listed.
  • I'm aware that this is a request for NewPipe itself and that requests for adding a new service need to be made at NewPipeExtractor.
  • I have taken the time to fill in all the required details. I understand that the feature request will be dismissed otherwise.
  • This issue contains only one feature request.
  • I have read and understood the contribution guidelines.

Feature description

The Logic:

Source: The system extracts the text from the video's caption/subtitle file (like .srt or .vtt).
Context: This text is cleaned and pre-loaded into the AI as context.
Interface: The user gets a chat window where they can ask questions about the video, ask for summaries, or translate content.

API Key Handling (Cost Solution): To avoid high server costs for the project maintainers, we can implement a "Bring Your Own Key" (BYOK) system.

  • The user enters their own OpenAI/Gemini/Anthropic API Key in the settings.
  • The app uses this key to make the request.
  • This makes the feature free for the platform and flexible for the user.

Why do you want this feature?

Sometimes videos are very long, and it is difficult to find specific information or get a quick summary without watching the whole thing. Users often want to ask specific questions about the video content (e.g., "What was said about X?" or "Summarize the introduction").

Additional information

if you reject this feature pls give me a reason for it.
similer feature is already implemented in a open source browser ' via '.

Metadata

Metadata

Assignees

No one assigned

    Labels

    feature requestIssue is related to a feature in the appneeds triageIssue is not yet ready for PR authors to take up

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions