Skip to main content

Welcome to OpenShorts 🎬

OpenShorts is an all-in-one open-source solution to automate the creation and distribution of viral vertical content. Transform long YouTube videos or local files into high-potential short clips optimized for TikTok, Instagram Reels, and YouTube Shorts.

What Makes OpenShorts Special?

OpenShorts leverages state-of-the-art AI to handle the entire content lifecycle—from viral moment detection to social media distribution—all in one automated pipeline.

AI-Powered Intelligence

  • Viral Moment Detection: Google Gemini 2.0 Flash analyzes your video transcript to identify 3-15 of the most engaging moments based on hooks and engagement potential
  • Automatic Copywriting: Generates SEO-optimized titles and descriptions for all platforms
  • Smart Scene Analysis: Pre-scans every scene to determine the optimal framing strategy

Advanced Video Processing

  • Dual-Mode AI Cropping: Automatically detects scene composition and applies the best strategy:
    • TRACK Mode: MediaPipe face detection + YOLOv8 for single-subject tracking with “Heavy Tripod” stabilization that eliminates jitter
    • GENERAL Mode: Professional blurred-background layout for groups or landscapes
  • Speaker Identification: Sticks to the active speaker and avoids erratic switching
  • High-Speed Transcription: Faster-Whisper provides CPU-optimized transcription with word-level timestamps

Professional Publishing Tools

  • YouTube Studio Integration: Complete publishing pipeline with AI-generated titles, thumbnails, descriptions with chapters, and direct YouTube upload
  • AI Voice Dubbing: ElevenLabs integration for translating clips to 30+ languages with voice cloning
  • Direct Social Posting: Share clips to TikTok, Instagram, and YouTube with a single click via Upload-Post integration
  • Automated S3 Backup: Silent background upload of generated clips to AWS S3

Modern Dashboard Experience

  • Real-time Progress: Watch clips appear as they’re generated with live results feed
  • Log Streaming: Follow the technical process with real-time updates
  • Dark Mode Interface: Premium glassmorphism design with responsive layout
  • Profile Management: Manage multiple social accounts easily

How It Works

OpenShorts implements a complete 10-stage processing pipeline:
1

Ingestion

Downloads YouTube videos via yt-dlp or handles local file uploads
2

Transcription

Faster-Whisper converts audio to text with word-level timestamps in seconds
3

Scene Detection

PySceneDetect identifies segment boundaries for precise clip extraction
4

AI Analysis

Gemini 2.0 Flash reads the transcript and selects 3-15 viral moments (15-60 seconds each)
5

Extraction

FFmpeg precisely cuts the selected segments from the original video
6

Reframing

AI-powered visual tracking crops clips to 9:16 vertical format with intelligent stabilization
7

Effects & Subtitles

Optional AI-generated FFmpeg filters and subtitle burning
8

Hook Overlay

Text overlays with styled fonts to maximize engagement
9

S3 Backup

Automated silent upload of clips and metadata to AWS S3
10

Distribution

One-click posting to TikTok, Instagram, and YouTube via Upload-Post API

Get Started in Minutes

Quickstart

Get OpenShorts running with Docker in under 5 minutes

Installation Guide

Detailed setup instructions and environment configuration

API Reference

Explore the REST API endpoints and integration options

YouTube Studio

Learn how to use AI-powered title and thumbnail generation

Real-World Use Cases

Content Creators

Automatically extract the best moments from podcasts and interviews for social media growth

Marketing Teams

Repurpose webinars and presentations into bite-sized promotional clips

Educators

Transform long lectures into engaging vertical clips for student engagement

News Outlets

Quickly create shareable clips from live streams and broadcasts

Agencies

Scale social media content production for multiple clients

Influencers

Multiply your content reach by posting to TikTok, Instagram, and YouTube simultaneously

Open Source & MIT Licensed

OpenShorts is completely open source under the MIT License. Use it, modify it, and scale it for your needs—whether you’re an individual creator or running a content production agency.
Ready to create viral content? Head over to the Quickstart guide to get OpenShorts running in minutes.

Build docs developers (and LLMs) love