Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,14 +1,109 @@
|
|
| 1 |
-
|
| 2 |
-
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
---
|
| 13 |
|
| 14 |
-
|
|
|
|
| 1 |
+
# π¬ AI Video Clipper
|
| 2 |
+
|
| 3 |
+
Transform your long-form videos into viral short clips automatically using AI! This application mimics the core functionality of OpusClip with open-source technologies.
|
| 4 |
+
|
| 5 |
+
## β¨ Features
|
| 6 |
+
|
| 7 |
+
### π€ AI-Powered Analysis
|
| 8 |
+
- **Smart Moment Detection**: Uses advanced NLP to identify the most engaging parts of your video
|
| 9 |
+
- **Virality Scoring**: Predicts which clips have the highest potential for social media success
|
| 10 |
+
- **Multi-Modal Analysis**: Combines audio features, sentiment analysis, and content understanding
|
| 11 |
+
|
| 12 |
+
### π± Social Media Optimization
|
| 13 |
+
- **Auto 9:16 Conversion**: Automatically converts to vertical format perfect for TikTok, Instagram Reels, YouTube Shorts
|
| 14 |
+
- **Smart Cropping**: Intelligently crops and scales video content
|
| 15 |
+
- **Background Blur**: Creates cinematic background when needed
|
| 16 |
+
|
| 17 |
+
### π Auto-Captioning
|
| 18 |
+
- **High-Accuracy Transcription**: Uses OpenAI Whisper for precise speech-to-text
|
| 19 |
+
- **Emoji Enhancement**: Automatically adds relevant emojis to increase engagement
|
| 20 |
+
- **Multi-Language Support**: Works with videos in multiple languages
|
| 21 |
+
|
| 22 |
+
### π― Content Intelligence
|
| 23 |
+
- **Hook Detection**: Identifies compelling opening statements and cliffhangers
|
| 24 |
+
- **Emotional Analysis**: Detects high-engagement emotional moments
|
| 25 |
+
- **Keyword Optimization**: Recognizes viral keywords and phrases
|
| 26 |
+
|
| 27 |
+
## π How It Works
|
| 28 |
+
|
| 29 |
+
1. **Upload**: Drop your video file (MP4, AVI, MOV, MKV, WebM)
|
| 30 |
+
2. **Configure**: Set clip duration (15-90 seconds) and number of clips (1-5)
|
| 31 |
+
3. **Process**: AI analyzes your video for the best moments
|
| 32 |
+
4. **Download**: Get optimized clips ready for social media
|
| 33 |
+
|
| 34 |
+
## π Virality Scoring Algorithm
|
| 35 |
+
|
| 36 |
+
The AI evaluates clips based on:
|
| 37 |
+
- **Sentiment Analysis**: Positive/negative emotional impact
|
| 38 |
+
- **Emotional Intensity**: Surprise, excitement, engagement levels
|
| 39 |
+
- **Viral Keywords**: Money, secrets, transformations, reactions
|
| 40 |
+
- **Hook Patterns**: "You won't believe", "This will change", etc.
|
| 41 |
+
- **Audio Features**: Tempo, energy, vocal dynamics
|
| 42 |
+
- **Optimal Length**: 30-60 second sweet spot for maximum retention
|
| 43 |
+
|
| 44 |
+
## π₯ Best Practices
|
| 45 |
+
|
| 46 |
+
### Ideal Content Types:
|
| 47 |
+
- **Podcasts & Interviews**: Great for extracting key insights and memorable quotes
|
| 48 |
+
- **Educational Content**: Tutorial highlights and "aha moments"
|
| 49 |
+
- **Webinars & Presentations**: Key takeaways and surprising statistics
|
| 50 |
+
- **Product Reviews**: Before/after comparisons and reactions
|
| 51 |
+
- **Storytelling**: Climactic moments and emotional peaks
|
| 52 |
+
|
| 53 |
+
### Tips for Best Results:
|
| 54 |
+
- β
Upload videos with clear, audible speech
|
| 55 |
+
- β
Longer videos (5+ minutes) provide more clip opportunities
|
| 56 |
+
- β
Content with emotional moments scores higher
|
| 57 |
+
- β
Good lighting and stable footage improve final quality
|
| 58 |
+
- β Avoid videos with background music louder than speech
|
| 59 |
+
- β Very quiet or poor audio quality may affect transcription
|
| 60 |
+
|
| 61 |
+
## π§ Technical Details
|
| 62 |
+
|
| 63 |
+
### AI Models Used:
|
| 64 |
+
- **Whisper Base**: For speech transcription and timestamp alignment
|
| 65 |
+
- **RoBERTa Sentiment**: For emotional analysis and engagement prediction
|
| 66 |
+
- **DistilRoBERTa Emotion**: For detecting surprise, excitement, and other high-engagement emotions
|
| 67 |
+
|
| 68 |
+
### Processing Pipeline:
|
| 69 |
+
1. **Audio Extraction**: Separates audio track for analysis
|
| 70 |
+
2. **Transcription**: Generates timestamped text with word-level precision
|
| 71 |
+
3. **Feature Analysis**: Extracts tempo, energy, and acoustic features
|
| 72 |
+
4. **Content Scoring**: Evaluates each segment for viral potential
|
| 73 |
+
5. **Clip Generation**: Creates optimized vertical videos with subtitles
|
| 74 |
+
6. **Quality Enhancement**: Applies blur backgrounds and text styling
|
| 75 |
+
|
| 76 |
+
## π Performance Optimizations
|
| 77 |
+
|
| 78 |
+
- **Efficient Processing**: Uses base models optimized for speed
|
| 79 |
+
- **Smart Batching**: Processes multiple segments simultaneously
|
| 80 |
+
- **Memory Management**: Automatic cleanup prevents memory leaks
|
| 81 |
+
- **Fast Encoding**: Uses ultrafast presets for quick turnaround
|
| 82 |
+
|
| 83 |
+
## π¨ Customization Options
|
| 84 |
+
|
| 85 |
+
- **Clip Duration**: 15-90 seconds (30-60s recommended)
|
| 86 |
+
- **Number of Clips**: 1-5 clips per video
|
| 87 |
+
- **Subtitle Toggle**: Enable/disable auto-generated captions
|
| 88 |
+
- **Emoji Integration**: Automatic contextual emoji insertion
|
| 89 |
+
|
| 90 |
+
## π Privacy & Security
|
| 91 |
+
|
| 92 |
+
- **No Data Storage**: Videos are processed temporarily and automatically deleted
|
| 93 |
+
- **Local Processing**: All AI analysis happens on the server without external API calls
|
| 94 |
+
- **Secure Upload**: Files are handled securely with temporary storage only
|
| 95 |
+
|
| 96 |
+
## π Getting Started
|
| 97 |
+
|
| 98 |
+
This application is designed to run on Hugging Face Spaces with the free tier. Simply upload your video and let the AI work its magic!
|
| 99 |
+
|
| 100 |
+
Perfect for:
|
| 101 |
+
- π± Content creators looking to repurpose long-form content
|
| 102 |
+
- π¬ Marketers creating social media campaigns
|
| 103 |
+
- π Educators extracting key teaching moments
|
| 104 |
+
- πΌ Businesses showcasing product highlights
|
| 105 |
+
- ποΈ Podcasters creating promotional clips
|
| 106 |
+
|
| 107 |
---
|
| 108 |
|
| 109 |
+
*Built with β€οΈ using open-source AI technologies. Transform your content strategy today!*
|