frogbase

Python

Transform audio-visual content into navigable knowledge.

Last updated Jun 17, 2026

774

Stars

Forks

Issues

Stars/day

Attention Score

View on GitHub ↗ Open in github.dev

Topics

#embeddings #package #python #search #semantic-search #speech-to-text #streamlit #ui

Language breakdown

No language data available.

▸ Files click to expand

README

🐸 FrogBase

Create navigable knowledge from multi-media content

FrogBase (previously whisper-ui) simplifies the download-transcribe-embed-index workflow for multi-media content. It does so by linking content from various platforms (ytdlp) with speech-to-text models (OpenAI's Whisper), image & text encoders (SentenceTransformers), and embedding stores (hnswlib).

⚠️ Warning: This is currently a pre-release version and is known to be very unstable. For stable releases, please use any 1.x versions.

from frogbase import FrogBase
fb = FrogBase()
fb.demo()
fb.search("What is the name of the squeaky frog?")

Full Documentation (WIP).

FrogBase also comes with a ready-to-use UI for non-technical users!

https://user-images.githubusercontent.com/6735526/216852681-53b6c3db-3e74-4c86-806f-6f6774a9003a.mp4

[ PyPI ][pypi_] [ Status ][status] [][python version] [ License ][license]

[pypi_]: https://pypi.org/project/frogbase/ [status]: https://pypi.org/project/frogbase/ [python version]: https://pypi.org/project/frogbase [license]: https://github.com/hayabhay/frogbase/blob/main/LICENSE

Features

FrogBase currently provides functionality to:

Download media files from a wide range of platforms (YouTube, TikTok, Vimeo, etc.) using ytdlp
Transcribe audio streams for downloaded & local files using OpenAI's Whisper
Embed transcribed text from corresponding video segments using Sentence Transformers
Index & search the embedded content using hnswlib

FrogBase also includes a Streamlit UI to provide a simple GUI for the above functionality enabling a locally hosted, interactive experience.

Software Developers

This section is for software developers who want to use FrogBase as a python package.

Install ffmpeg and FrogBase

sudo apt install ffmpeg
   pip install frogbase

Import FrogBase and use it as follows -

from frogbase import FrogBase
fb = FrogBase()
sources = [       "https://www.youtube.com/watch?v=HBxn56l9WcU",       "https://www.youtube.com/@hayabhay"    ]
fb.add(sources)
fb.search("What is the name of the squeaky frog?")

Non-technical Users

This section is for non-technical users who want to use FrogBase primarily through the accompanying Streamlit UI.

Download the latest release of FrogBase from here and unzip it.

Or, you can also clone the repository

console
git clone https://github.com/hayabhay/frogbase.git

Install FrogBase dependencies manually and run the UI.

> Note: This also requires ffmpeg to be installed on your system. You can install it using sudo apt install ffmpeg on Ubuntu.

1. Using pip

pip install frogbase streamlit
      streamlit run ui/01🏠Home.py

[Coming soon] Instructions, environment for installation using Docker & Anaconda

Links

🔗 More in this category