Skill_Seekers

yusufkaraaslan/Skill_Seekers
14,264 starsMITCommunity

Install to Claude Code

This server doesn't publish a one-line install command. Follow the setup in the source repository.

Summary

yusufkaraaslan/Skill_Seekers MCP server](https://glama.ai/mcp/servers/yusufkaraaslan/Skill_Seekers/badges/score.svg)](https://glama.ai/mcp/servers/yusufkaraaslan/Skill_Seekers) ๐Ÿ ๐Ÿ  ๐ŸŽ ๐ŸชŸ ๐Ÿง - Transform 17 source types (docs, GitHub repos, PDFs, videos,...

README.md

<p align="center"> <img src="docs/assets/logo.png" alt="Skill Seekers" width="200"/> </p>

Skill Seekers

English | ็ฎ€ไฝ“ไธญๆ–‡ | ๆ—ฅๆœฌ่ชž | ํ•œ๊ตญ์–ด | Espaรฑol | Franรงais | Deutsch | Portuguรชs | Tรผrkรงe | ุงู„ุนุฑุจูŠุฉ | เคนเคฟเคจเฅเคฆเฅ€ | ะ ัƒััะบะธะน

![Version](https://github.com/yusufkaraaslan/Skill_Seekers/releases) ![License: MIT](https://opensource.org/licenses/MIT) ![Python 3.10+](https://www.python.org/downloads/) ![MCP Integration](https://modelcontextprotocol.io) ![Tested](tests/) ![Project Board](https://github.com/users/yusufkaraaslan/projects/2) ![PyPI version](https://pypi.org/project/skill-seekers/) ![PyPI - Downloads](https://pypi.org/project/skill-seekers/) ![PyPI - Python Version](https://pypi.org/project/skill-seekers/) ![Website](https://skillseekersweb.com/) ![Twitter Follow](https://x.com/_yUSyUS_) ![GitHub Repo stars](https://github.com/yusufkaraaslan/Skill_Seekers) ![PyPI Downloads](https://pepy.tech/projects/skill-seekers)

<a href="https://trendshift.io/repositories/18329" target="_blank"><img src="https://trendshift.io/api/badge/repositories/18329" alt="yusufkaraaslan%2FSkill_Seekers | Trendshift" style="width: 250px; height: 55px;" width="250" height="55"/></a>

๐Ÿง  The data layer for AI systems. Skill Seekers turns documentation sites, GitHub repos, PDFs, videos, notebooks, wikis, and 10+ more source types into structured knowledge assetsโ€”ready to power AI Skills (Claude, Gemini, OpenAI), RAG pipelines (LangChain, LlamaIndex, Pinecone), and AI coding assistants (Cursor, Windsurf, Cline) in minutes, not hours.

๐ŸŒ Visit SkillSeekersWeb.com - Browse 24+ preset configs, share your configs, and access complete documentation!

๐Ÿ“‹ View Development Roadmap & Tasks - 134 tasks across 10 categories, pick any to contribute!

๐ŸŒ Ecosystem

Skill Seekers is a multi-repo project. Here's where everything lives:

| Repository | Description | Links | |-----------|-------------|-------| | Skill_Seekers | Core CLI & MCP server (this repo) | PyPI | | skillseekersweb | Website & documentation | Live | | skill-seekers-configs | Community config repository | | | skill-seekers-action | GitHub Action for CI/CD | | | skill-seekers-plugin | Claude Code plugin | | | homebrew-skill-seekers | Homebrew tap for macOS | |

Want to contribute? The website and configs repos are great starting points for new contributors!

๐Ÿง  The Data Layer for AI Systems

Skill Seekers is the universal preprocessing layer that sits between raw documentation and every AI system that consumes it. Whether you are building Claude skills, a LangChain RAG pipeline, or a Cursor .cursorrules file โ€” the data preparation is identical. You do it once, and export to all targets.

# One command โ†’ structured knowledge asset
skill-seekers create https://docs.react.dev/
# or: skill-seekers create facebook/react
# or: skill-seekers create ./my-project

# Export to any AI system
skill-seekers package output/react --target claude      # โ†’ Claude AI Skill (ZIP)
skill-seekers package output/react --target langchain   # โ†’ LangChain Documents
skill-seekers package output/react --target llama-index # โ†’ LlamaIndex TextNodes
skill-seekers package output/react --target cursor      # โ†’ .cursorrules
skill-seekers package output/react --target ibm-bob     # โ†’ IBM Bob skill directory

What gets built

| Output | Target | What it powers | |--------|--------|---------------| | Claude Skill (ZIP + YAML) | --target claude | Claude Code, Claude API | | Gemini Skill (tar.gz) | --target gemini | Google Gemini | | OpenAI / Custom GPT (ZIP) | --target openai | GPT-4o, custom assistants | | LangChain Documents | --target langchain | QA chains, agents, retrievers | | LlamaIndex TextNodes | --target llama-index | Query engines, chat engines | | Haystack Documents | --target haystack | Enterprise RAG pipelines | | Pinecone-ready (Markdown) | --target markdown | Vector upsert | | ChromaDB / FAISS / Qdrant | --target chroma/faiss/qdrant | Local vector DBs | | IBM Bob Skill (directory) | --target ibm-bob | IBM Bob project/global skills | | Cursor .cursorrules | --target markdown โ†’ copy SKILL.md | Cursor IDE .cursorrules | | Windsurf / Cline / Continue | --target claude โ†’ copy | VS Code, IntelliJ, Vim |

Why it matters

  • โšก 99% faster โ€” Days of manual data prep โ†’ 15โ€“45 minutes
  • ๐ŸŽฏ AI Skill quality โ€” 500+ line SKILL.md files with examples, patterns, and guides
  • ๐Ÿ“Š RAG-ready chunks โ€” Smart chunking preserves code blocks and maintains context
  • ๐ŸŽฌ Videos โ€” Extract code, transcripts, and structured knowledge from YouTube and local videos
  • ๐Ÿ”„ Multi-source โ€” Combine 18 source types (docs, GitHub, PDFs, videos, notebooks, wikis, and more) into one knowledge asset
  • ๐ŸŒ One prep, every target โ€” Export the same asset to 21 platforms without re-scraping
  • โœ… Battle-tested โ€” 3,700+ tests, 24+ framework presets, production-ready

๐Ÿš€ Quick Start (3 Commands)

# 1. Install
pip install skill-seekers

# 2. Create skill from any source
skill-seekers create https://docs.django.com/

# 3. Package for your AI platform
skill-seekers package output/django --target claude

That's it! You now have output/django-claude.zip ready to use.

# Use a different AI agent for enhancement (default: claude)
skill-seekers create https://docs.django.com/ --agent kimi
skill-seekers create https://docs.django.com/ --agent codex
skill-seekers create https://docs.django.com/ --agent-cmd "my-custom-agent run"

๐Ÿ›ฐ๏ธ AI-driven project scan (new)

Point scan at any project and an AI agent reads its manifests, README, Dockerfile/CI and sampled source imports โ€” then emits one config per detected framework plus a <project>-codebase.json for your own code. Pins the detected version so re-running reports bumps:

skill-seekers scan ./my-react-app --out ./configs/scanned/
# โ†’ react.json, vite.json, tailwind.json, jest.json, my-react-app-codebase.json

# Then build any of them
skill-seekers create ./configs/scanned/react.json

If a detection has no existing preset, the AI generates a fresh config; on exit you can optionally publish it back to the community registry.

Other Sources (18 Supported)

# GitHub repository
skill-seekers create facebook/react

# Local project
skill-seekers create ./my-project

# PDF document
skill-seekers create manual.pdf

# Word document
skill-seekers create report.docx

# EPUB e-book
skill-seekers create book.epub

# Jupyter Notebook
skill-seekers create notebook.ipynb

# OpenAPI spec
skill-seekers create openapi.yaml

# PowerPoint presentation
skill-seekers create presentation.pptx

# AsciiDoc document
skill-seekers create guide.adoc

# Local HTML file (auto-detected by extension)
skill-seekers create page.html

# Whole directory of HTML files (auto-detected for HTML-dominant dirs)
skill-seekers create ./mirror_output/site/

# Force HTML mode on a mixed/code-heavy directory
skill-seekers create ./repo/ --html-path ./repo/docs/build/html/

# RSS/Atom feed
skill-seekers create feed.rss

# Man page
skill-seekers create curl.1

# Video (YouTube, Vimeo, or local file โ€” requires skill-seekers[video])
skill-seekers create --video-url https://www.youtube.com/watch?v=... --name mytutorial
# First time? Auto-install GPU-aware visual deps:
skill-seekers create --setup

# Confluence wiki
skill-seekers create --space-key TEAM --name wiki

# Notion pages
skill-seekers create --database-id ... --name docs

# Slack/Discord chat export
skill-seekers create --chat-export-path ./slack-export --name team-chat

Export Everywhere

# Package for multiple platforms
for platform in claude gemini openai langchain; do
  skill-seekers package output/django --target $platform
done

What is Skill Seekers?

Skill Seekers is the data layer for AI systems. It transforms 18 source typesโ€”documentation websites, GitHub repositories, PDFs, videos, Jupyter Notebooks, Word/EPUB/AsciiDoc documents, OpenAPI specs, PowerPoint presentations, RSS feeds, man pages, Confluence wikis, Notion pages, Slack/Discord exports, and moreโ€”into structured knowledge assets for every AI target:

| Use Case | What you get | Examples | |----------|-------------|---------| | AI Skills | Comprehensive SKILL.md + references | Claude Code, Gemini, GPT | | RAG Pipelines | Chunked documents with rich metadata | LangChain, LlamaIndex, Haystack | | Vector Databases | Pre-formatted data ready for upsert | Pinecone, Chroma, Weaviate, FAISS | | AI Coding Assistants | Context files your IDE AI reads automatically | Cursor, Windsurf, Cline, Continue.dev |

๐Ÿ“š Documentation

| I want to... | Read this | |--------------|-----------| | Get started quickly | Quick Start - 3 commands to first skill | | Understand concepts | Core Concepts - How it works | | Scrape sources | Scraping Guide - All source types | | Enhance skills | Enhancement Guide - AI enhancement | | Export skills | Packaging Guide - Platform export | | Look up commands | CLI Reference - All 20 commands | | Configure | Config Format - JSON specification | | Fix issues | Troubleshooting - Common problems |

Complete documentation: docs/README.md

Instead of spending days on manual preprocessing, Skill Seekers:

  1. Ingests โ€” docs, GitHub repos, local codebases, PDFs, videos, notebooks, wikis, and 10+ more source types
  2. Analyzes โ€” deep AST parsing, pattern detection, API extraction
  3. Structures โ€” categorized reference files with metadata
  4. Enhances โ€” AI-powered SKILL.md generation (Claude, Gemini, or local)
  5. Exports โ€” 16 platform-specific formats from one asset

Why Use This?

For AI Skill Builders (Claude, Gemini, OpenAI)

  • ๐ŸŽฏ Production-grade Skills โ€” 500+ line SKILL.md files with code examples, patterns, and guides
  • ๐Ÿ”„ Enhancement Workflows โ€” Apply security-focus, architecture-comprehensive, or custom YAML presets
  • ๐ŸŽฎ Any Domain โ€” Game engines (Godot, Unity), frameworks (React, Django), internal tools
  • ๐Ÿ”ง Teams โ€” Combine internal docs + code into a single source of truth
  • ๐Ÿ“š Quality โ€” AI-enhanced with examples, quick reference, and navigation guidance

For RAG Builders & AI Engineers

  • ๐Ÿค– RAG-ready data โ€” Pre-chunked LangChain Documents, LlamaIndex TextNodes, Haystack Documents
  • ๐Ÿš€ 99% faster โ€” Days of preprocessing โ†’ 15โ€“45 minutes
  • ๐Ÿ“Š Smart metadata โ€” Categories, sources, types โ†’ better retrieval accuracy
  • ๐Ÿ”„ Multi-source โ€” Combine docs + GitHub + PDFs + videos in one pipeline
  • ๐ŸŒ Platform-agnostic โ€” Export to any vector DB or framework without re-scraping

For AI Coding Assistant Users

  • ๐Ÿ’ป Cursor / Windsurf / Cline โ€” Generate .cursorrules / .windsurfrules / .clinerules automatically
  • ๐ŸŽฏ Persistent context โ€” AI "knows" your frameworks without repeated prompting
  • ๐Ÿ“š Always current โ€” Update context in minutes when docs change

Key Features

๐ŸŒ Documentation Scraping

  • โœ… Smart SPA Discovery - Three-layer discovery for JavaScript SPA sites (sitemap.xml โ†’ llms.txt โ†’ headless browser rendering)
  • โœ… llms.txt Support - Automatically detects and uses LLM-ready documentation files (10x faster)
  • โœ… Universal Scraper - Works with ANY documentation website
  • โœ… Smart Categorization - Automatically organizes content by topic
  • โœ… Code Language Detection - Recognizes Python, JavaScript, C++, GDScript, etc.
  • โœ… 24+ Ready-to-Use Presets - Godot, React, Vue, Django, FastAPI, and more

๐Ÿ“„ PDF Support

  • โœ… Basic PDF Extraction - Extract text, code, and images from PDF files
  • โœ… OCR for Scanned PDFs - Extract text from scanned documents
  • โœ… Password-Protected PDFs - Handle encrypted PDFs
  • โœ… Table Extraction - Extract complex tables from PDFs
  • โœ… Parallel Processing - 3x faster for large PDFs
  • โœ… Intelligent Caching - 50% faster on re-runs

๐ŸŽฌ Video Extraction

  • โœ… YouTube & Local Videos - Extract transcripts, on-screen code, and structured knowledge from videos
  • โœ… Visual Frame Analysis - OCR extraction from code editors, terminals, slides, and diagrams
  • โœ… GPU Auto-Detection - Automatically installs correct PyTorch build (CUDA/ROCm/MPS/CPU)
  • โœ… AI Enhancement - Two-pass: clean OCR artifacts + generate polished SKILL.md
  • โœ… Time Clipping - Extract specific sections with --start-time and --end-time
  • โœ… Playlist Support - Batch process all videos in a YouTube playlist
  • โœ… Vision API Fallback - Use Claude Vision for low-confidence OCR frames

๐Ÿ™ GitHub Repository Analysis

  • โœ… Deep Code Analysis - AST parsing for Python, JavaScript, TypeScript, Java, C++, Go
  • โœ… API Extraction - Functions, classes, methods with parameters and types
  • โœ… Repository Metadata - README, file tree, language breakdown, stars/forks
  • โœ… GitHub Issues & PRs - Fetch open/closed issues with labels and milestones
  • โœ… CHANGELOG & Releases - Automatically extract version history
  • โœ… Conflict Detection - Compare documented APIs vs actual code implementation
  • โœ… MCP Integration - Natural language: "Scrape GitHub repo facebook/react"

๐Ÿ”„ Unified Multi-Source Scraping

  • โœ… Combine Multiple Sources - Mix documentation + GitHub + PDF in one skill
  • โœ… Conflict Detection - Automatically finds discrepancies between docs and code
  • โœ… Intelligent Merging - Rule-based or AI-powered conflict resolution
  • โœ… Transparent Reporting - Side-by-side comparison with โš ๏ธ warnings
  • โœ… Documentation Gap Analysis - Identifies outdated docs and undocumented features
  • โœ… Single Source of Truth - One skill showing both intent (docs) and reality (code)
  • โœ… Backward Compatible - Legacy single-source configs still work

๐Ÿค– Multi-LLM Platform Support

  • โœ… 12 LLM Platforms - Claude AI, Google Gemini, OpenAI ChatGPT, MiniMax AI, Generic Markdown, OpenCode, Kimi (Moonshot AI), DeepSeek AI, Qwen (Alibaba), OpenRouter, Together AI, Fireworks AI
  • โœ… Universal Scraping - Same documentation works for all platforms
  • โœ… Platform-Specific Packaging - Optimized formats for each LLM
  • โœ… One-Command Export - --target flag selects platform
  • โœ… Optional Dependencies - Install only what you need
  • โœ… 100% Backward Compatible - Existing Claude workflows unchanged

| Platform | Format | Upload | Enhancement | API Key | Custom Endpoint | |----------|--------|--------|-------------|---------|-----------------| | Claude AI | ZIP + YAML | โœ… Auto | โœ… Yes | ANTHROPIC_API_KEY | ANTHROPIC_BASE_URL | | Google Gemini | tar.gz | โœ… Auto | โœ… Yes | GOOGLE_API_KEY | - | | OpenAI ChatGPT | ZIP + Vector Store | โœ… Auto | โœ… Yes | OPENAI_API_KEY | - | | MiniMax AI | ZIP + Knowledge Files | โœ… Auto | โœ… Yes | MINIMAX_API_KEY | - | | Generic Markdown | ZIP | โŒ Manual | โŒ No | - | - |

# Claude (default - no changes needed!)
skill-seekers package output/react/
skill-seekers upload react.zip

# Google Gemini
pip install skill-seekers[gemini]
skill-seekers package output/react/ --target gemini
skill-seekers upload react-gemini.tar.gz --target gemini

# OpenAI ChatGPT
pip install skill-seekers[openai]
skill-seekers package output/react/ --target openai
skill-seekers upload react-openai.zip --target openai

# MiniMax AI
pip install skill-seekers[minimax]
skill-seekers package output/react/ --target minimax
skill-seekers upload react-minimax.zip --target minimax

# Generic Markdown (universal export)
skill-seekers package output/react/ --target markdown
# Use the markdown files directly in any LLM

<details> <summary>๐Ÿ”ง <strong>Use your own AI provider (OpenAI-compatible endpoints + subscriptions, no Anthropic credits needed)</strong></summary>

The optional AI enhancement step (used by create, scan, and enhance) does not require an Anthropic key. You have three ways to power it:

1. Use a subscription you already pay for โ€” no API credits at all (LOCAL agent mode)

Skill Seekers can shell out to a coding-agent CLI you're already logged into, so enhancement runs on your existing plan instead of metered API tokens:

skill-seekers create <source> --agent codex     # OpenAI Codex CLI โ†’ your ChatGPT Plus
skill-seekers create <source> --agent claude    # Claude Code      โ†’ your Claude Pro/Max

Supported agents: claude, codex, copilot, opencode, kimi, and custom (pair --agent custom with --agent-cmd "<your-cli> ..." to drive any other tool).

2. Any OpenAI-compatible provider (OpenRouter, Groq, Cerebras, Mistral, NVIDIA NIM, โ€ฆ)

All of these expose an OpenAI-compatible /v1 endpoint. Point Skill Seekers at one with three env vars โ€” it detects OPENAI_API_KEY, and the OpenAI SDK honors OPENAI_BASE_URL automatically:

export OPENAI_API_KEY="<your provider key>"
export OPENAI_BASE_URL="https://openrouter.ai/api/v1"   # provider endpoint (see table)
export OPENAI_MODEL="<a model that provider offers>"     # required โ€” default gpt-4o won't exist elsewhere
skill-seekers create <source>

| Provider | OPENAI_BASE_URL | |--------------|--------------------------------------------| | OpenRouter | https://openrouter.ai/api/v1 | | Groq | https://api.groq.com/openai/v1 | | Cerebras | https://api.cerebras.ai/v1 | | Mistral | https://api.mistral.ai/v1 | | NVIDIA NIM | https://integrate.api.nvidia.com/v1 |

Provider detection picks the first API-key env var it finds (ANTHROPIC_API_KEY โ†’ GOOGLE_API_KEY โ†’ OPENAI_API_KEY โ†’ MOONSHOT_API_KEY). Set SKILL_SEEKER_PROVIDER to force a specific provider, or make sure the higher-priority keys are unset.

3. Claude-compatible endpoints (e.g. GLM, proxies)

export ANTHROPIC_API_KEY="your-key"
export ANTHROPIC_BASE_URL="https://your-claude-compatible-endpoint/v1"

Google Gemini (GOOGLE_API_KEY) and Kimi/Moonshot (MOONSHOT_API_KEY) are also supported natively. See Environment Variables Reference for the full list, including per-provider model overrides.

</details>

Installation: ```bash

Install with Gemini support

pip install skill-seekers[gemini]

Install with OpenAI support

pip install skill-seekers[openai]

Install with MiniMax support

pip install skill-seekers[minimax]

Install with all LLM platforms

pip install skill-seekers[all-llms] ```

๐Ÿ”— RAG Framework Integrations

  • โœ… Pinecone-Ready Format - Optimized for vector database upsert
  • Perfect for: Production vector search, semantic search, hybrid search
  • Example: Pinecone Upsert
  • Guide: Pinecone Integration

Quick Export: ```bash

LangChain Documents (JSON)

skill-seekers package output/django --target langchain

โ†’ output/django-langchain.json

LlamaIndex TextNodes (JSON)

skill-seekers package output/django --target llama-index

โ†’ output/django-llama-index.json

Markdown (Universal)

skill-seekers package output/django --target markdown

โ†’ output/django-markdown/SKILL.md + references/


**Complete RAG Pipeline Guide:** [RAG Pipelines Documentation](docs/integrations/RAG_PIPELINES.md)

---

### ๐Ÿง  AI Coding Assistant Integrations

Transform any framework documentation into expert coding context for 4+ AI assistants:

- โœ… **Cursor IDE** - Generate `.cursorrules` for AI-powered code suggestions
  - Perfect for: Framework-specific code generation, consistent patterns
  - Works with: Cursor IDE (VS Code fork)
  - Guide: [Cursor Integration](docs/integrations/CURSOR.md)
  - Example: [Cursor React Skill](examples/cursor-react-skill/)

- โœ… **Windsurf** - Customize Windsurf's AI assistant context with `.windsurfrules`
  - Perfect for: IDE-native AI assistance, flow-based coding
  - Works with: Windsurf IDE by Codeium
  - Guide: [Windsurf Integration](docs/integrations/WINDSURF.md)
  - Example: [Windsurf FastAPI Context](examples/windsurf-fastapi-context/)

- โœ… **Cline (VS Code)** - System prompts + MCP for VS Code agent
  - Perfect for: Agentic code generation in VS Code
  - Works with: Cline extension for VS Code
  - Guide: [Cline Integration](docs/integrations/CLINE.md)
  - Example: [Cline Django Assistant](examples/cline-django-assistant/)

- โœ… **Continue.dev** - Context servers for IDE-agnostic AI
  - Perfect for: Multi-IDE environments (VS Code, JetBrains, Vim), custom LLM providers
  - Works with: Any IDE with Continue.dev plugin
  - Guide: [Continue Integration](docs/integrations/CONTINUE_DEV.md)
  - Example: [Continue Universal Context](examples/continue-dev-universal/)

**Quick Export for AI Coding Tools:**

For any AI coding assistant (Cursor, Windsurf, Cline, Continue.dev)

skill-seekers create --config configs/django.json skill-seekers package output/django --target claude # or --target markdown

Copy to your project (example for Cursor)

cp output/django-claude/SKILL.md my-project/.cursorrules

Or for Windsurf

cp output/django-claude/SKILL.md my-project/.windsurf/rules/django.md

Or for Cline

cp output/django-claude/SKILL.md my-project/.clinerules

Or for Continue.dev (HTTP server)

python examples/continue-dev-universal/context_server.py

Configure in ~/.continue/config.json


**Integration Hub:** [All AI System Integrations](docs/integrations/INTEGRATIONS.md)

---

### ๐ŸŒŠ Three-Stream GitHub Architecture
- โœ… **Triple-Stream Analysis** - Split GitHub repos into Code, Docs, and Insights streams
- โœ… **Unified Codebase Analyzer** - Works with GitHub URLs AND local paths
- โœ… **C3.x as Analysis Depth** - Choose 'basic' (1-2 min) or 'c3x' (20-60 min) analysis
- โœ… **Enhanced Router Generation** - GitHub metadata, README quick start, common issues
- โœ… **Issue Integration** - Top problems and solutions from GitHub issues
- โœ… **Smart Routing Keywords** - GitHub labels weighted 2x for better topic detection

**Three Streams Explained:**
- **Stream 1: Code** - Deep C3.x analysis (patterns, examples, guides, configs, architecture)
- **Stream 2: Docs** - Repository documentation (README, CONTRIBUTING, docs/*.md)
- **Stream 3: Insights** - Community knowledge (issues, labels, stars, forks)

from skill_seekers.cli.unified_codebase_analyzer import UnifiedCodebaseAnalyzer

Analyze GitHub repo with all three streams

analyzer = UnifiedCodebaseAnalyzer() result = analyzer.analyze( source="https://github.com/facebook/react", depth="c3x", # or "basic" for fast analysis fetch_github_metadata=True )

Access code stream (C3.x analysis)

print(f"Design patterns: {len(result.code_analysis['c3_1_patterns'])}") print(f"Test examples: {result.code_analysis['c3_2_examples_count']}")

Access docs stream (repository docs)

print(f"README: {result.github_docs['readme'][:100]}")

Access insights stream (GitHub metadata)

print(f"Stars: {result.github_insights['metadata']['stars']}") print(f"Common issues: {len(result.github_insights['common_problems'])}") ```

See complete documentation: Three-Stream Implementation Summary

๐Ÿ” Smart Rate Limit Management & Configuration

  • โœ… Multi-Token Configuration System - Manage multiple GitHub accounts (personal, work, OSS)
  • Secure config storage at ~/.config/skill-seekers/config.json (600 permissions)
  • Per-profile rate limit strategies: prompt, wait, switch, fail
  • Configurable timeout per profile (default: 30 min, prevents indefinite waits)
  • Smart fallback chain: CLI arg โ†’ Env var โ†’ Config file โ†’ Prompt
  • API key management for Claude, Gemini, OpenAI
  • โœ… Interactive Configuration Wizard - Beautiful terminal UI for easy setup
  • Browser integration for token creation (auto-opens GitHub, etc.)
  • Token validation and connection testing
  • Visual status display with color coding
  • โœ… Intelligent Rate Limit Handler - No more indefinite waits!
  • Upfront warning about rate limits (60/hour vs 5000/hour)
  • Real-time detection from GitHub API responses
  • Live countdown timers with progress
  • Automatic profile switching when rate limited
  • Four strategies: prompt (ask), wait (countdown), switch (try another), fail (abort)
  • โœ… Resume Capability - Continue interrupted jobs
  • Auto-save progress at configurable intervals (default: 60 sec)
  • List all resumable jobs with progress details
  • Auto-cleanup of old jobs (default: 7 days)
  • โœ… CI/CD Support - Non-interactive mode for automation
  • --non-interactive flag fails fast without prompts
  • --profile flag to select specific GitHub account
  • Clear error messages for pipeline logs

Quick Setup: ```bash

One-time configuration (5 minutes)

skill-seekers config --github

Use specific profile for private repos

skill-seekers create mycompany/private-repo --profile work

CI/CD mode (fail fast, no prompts)

skill-seekers create owner/repo --non-interactive

Resume interrupted job

skill-seekers resume --list skill-seekers resume github_react_20260117_143022 ```

Rate Limit Strategies Explained:

  • prompt (default) - Ask what to do when rate limited (wait, switch, setup token, cancel)
  • wait - Automatically wait with countdown timer (respects timeout)
  • switch - Automatically try next available profile (for multi-account setups)
  • fail - Fail immediately with clear error (perfect for CI/CD)

๐ŸŽฏ Bootstrap Skill - Self-Hosting

Generate skill-seekers as a skill to use within your AI agent (Claude Code, Kimi, Codex, etc.):

# Generate the skill
./scripts/bootstrap_skill.sh

# Install to Claude Code
cp -r output/skill-seekers ~/.claude/skills/

What you get:

  • โœ… Complete skill documentation - All CLI commands and usage patterns
  • โœ… CLI command reference - Every tool and its options documented
  • โœ… Quick start examples - Common workflows and best practices
  • โœ… Auto-generated API docs - Code analysis, patterns, and examples

๐Ÿ” Private Config Repositories

  • โœ… Git-Based Config Sources - Fetch configs from private/team git repositories
  • โœ… Multi-Source Management - Register unlimited GitHub, GitLab, Bitbucket repos
  • โœ… Team Collaboration - Share custom configs across 3-5 person teams
  • โœ… Enterprise Support - Scale to 500+ developers with priority-based resolution
  • โœ… Secure Authentication - Environment variable tokens (GITHUB_TOKEN, GITLAB_TOKEN)
  • โœ… Intelligent Caching - Clone once, pull updates automatically
  • โœ… Offline Mode - Work with cached configs when offline

๐Ÿค– Codebase Analysis (C3.x)

C3.4: Configuration Pattern Extraction with AI Enhancement

  • โœ… 9 Config Formats - JSON, YAML, TOML, ENV, INI, Python, JavaScript, Dockerfile, Docker Compose
  • โœ… 7 Pattern Types - Database, API, logging, cache, email, auth, server configurations
  • โœ… AI Enhancement - Optional dual-mode AI analysis (API + LOCAL)
  • Explains what each config does
  • Suggests best practices and improvements
  • Security analysis - Finds hardcoded secrets, exposed credentials
  • โœ… Auto-Documentation - Generates JSON + Markdown documentation of all configs
  • โœ… MCP Integration - extract_config_patterns tool with enhancement support

C3.3: AI-Enhanced How-To Guides

  • โœ… Comprehensive AI Enhancement - Transforms basic guides into professional tutorials
  • โœ… 5 Automatic Improvements - Step descriptions, troubleshooting, prerequisites, next steps, use cases
  • โœ… Dual-Mode Support - API mode (Claude API) or LOCAL mode (Claude Code CLI)
  • โœ… No API Costs with LOCAL Mode - FREE enhancement using your Claude Code Max plan
  • โœ… Quality Transformation - 75-line templates โ†’ 500+ line comprehensive guides

Usage: ```bash

Quick analysis (1-2 min, basic features only)

skill-seekers scan tests/ --quick

Comprehensive analysis with AI (20-60 min, all features)

skill-seekers scan tests/ --comprehensive

With AI enhancement

skill-seekers scan tests/ --enhance ```

Full Documentation: docs/features/HOW_TO_GUIDES.md

๐Ÿ”„ Enhancement Workflow Presets

Reusable YAML-defined enhancement pipelines that control how AI transforms your raw documentation into a polished skill.

  • โœ… 5 Bundled Presets โ€” default, minimal, security-focus, architecture-comprehensive, api-documentation
  • โœ… User-Defined Presets โ€” add custom workflows to ~/.config/skill-seekers/workflows/
  • โœ… Multiple Workflows โ€” chain two or more workflows in one command
  • โœ… Fully Managed CLI โ€” list, inspect, copy, add, remove, and validate workflows
# Apply a single workflow
skill-seekers create ./my-project --enhance-workflow security-focus

# Chain multiple workflows (applied in order)
skill-seekers create ./my-project \
  --enhance-workflow security-focus \
  --enhance-workflow minimal

# Manage presets
skill-seekers workflows list                          # List all (bundled + user)
skill-seekers workflows show security-focus           # Print YAML content
skill-seekers workflows copy security-focus           # Copy to user dir for editing
skill-seekers workflows add ./my-workflow.yaml        # Install a custom preset
skill-seekers workflows remove my-workflow            # Remove a user preset
skill-seekers workflows validate security-focus       # Validate preset structure

# Copy multiple at once
skill-seekers workflows copy security-focus minimal api-documentation

# Add multiple files at once
skill-seekers workflows add ./wf-a.yaml ./wf-b.yaml

# Remove multiple at once
skill-seekers workflows remove my-wf-a my-wf-b

YAML preset format: ```yaml name: security-focus description: "Security-focused review: vulnerabilities, auth, data handling" version: "1.0" stages:

  • name: vulnerabilities

type: custom prompt: "Review for OWASP top 10 and common security vulnerabilities..."

  • name: auth-review

type: custom prompt: "Examine authentication and authorisation patterns..." uses_history: true ```

โšก Performance & Scale

  • โœ… Async Mode - 2-3x faster scraping with async/await (use --async flag)
  • โœ… Large Documentation Support - Handle 10K-40K+ page docs with intelligent splitting
  • โœ… Router/Hub Skills - Intelligent routing to specialized sub-skills
  • โœ… Parallel Scraping - Process multiple skills simultaneously
  • โœ… Checkpoint/Resume - Never lose progress on long scrapes
  • โœ… Caching System - Scrape once, rebuild instantly

๐Ÿค– Agent-Agnostic Skill Generation

  • โœ… Multi-Agent Support - Generate skills for Claude, Kimi, Codex, Copilot, OpenCode, or any custom agent via --agent flag
  • โœ… Custom Agent Commands - Use --agent-cmd to specify a custom agent CLI command for enhancement
  • โœ… Universal Flags - --agent and --agent-cmd available on all commands (create, scrape, github, pdf, etc.)

๐Ÿ“ฆ Marketplace Pipeline

  • โœ… Publish to Marketplace - Publish skills to Claude Code plugin marketplace repos
  • โœ… End-to-End Pipeline - From documentation source to published marketplace entry

โœ… Quality Assurance

  • โœ… Fully Tested - 3,700+ tests with comprehensive coverage

---

๐Ÿ“ฆ Installation

# Basic install (documentation scraping, GitHub analysis, PDF, packaging)
pip install skill-seekers

# With all LLM platform support
pip install skill-seekers[all-llms]

# With MCP server
pip install skill-seekers[mcp]

# Everything
pip install skill-seekers[all]

Need help choosing? Run the setup wizard: ``bash skill-seekers-setup ``

Installation Options

| Install | Features | |---------|----------| | pip install skill-seekers | Scraping, GitHub analysis, PDF, all platforms | | pip install skill-seekers[gemini] | + Google Gemini support | | pip install skill-seekers[openai] | + OpenAI ChatGPT support | | pip install skill-seekers[all-llms] | + All LLM platforms | | pip install skill-seekers[mcp] | + MCP server for Claude Code, Cursor, etc. | | pip install skill-seekers[video] | + YouTube/Vimeo transcript & metadata extraction | | pip install skill-seekers[video-full] | + Whisper transcription & visual frame extraction | | pip install skill-seekers[jupyter] | + Jupyter Notebook support | | pip install skill-seekers[pptx] | + PowerPoint support | | pip install skill-seekers[confluence] | + Confluence wiki support | | pip install skill-seekers[notion] | + Notion pages support | | pip install skill-seekers[rss] | + RSS/Atom feed support | | pip install skill-seekers[chat] | + Slack/Discord chat export support | | pip install skill-seekers[asciidoc] | + AsciiDoc document support | | pip install skill-seekers[all] | Everything enabled |

Video visual deps (GPU-aware): After installing skill-seekers[video-full], run skill-seekers create --setup to auto-detect your GPU and install the correct PyTorch variant + easyocr. This is the recommended way to install visual extraction dependencies.

---

๐Ÿš€ One-Command Install Workflow

The fastest way to go from config to uploaded skill - complete automation:

# Install React skill from official configs (auto-uploads to Claude)
skill-seekers install --config react

# Install from local config file
skill-seekers install --config configs/custom.json

# Install without uploading (package only)
skill-seekers install --config django --no-upload

# Preview workflow without executing
skill-seekers install --config react --dry-run

Time: 20-45 minutes total | Quality: Production-ready (9/10) | Cost: Free

Phases executed: `` ๐Ÿ“ฅ PHASE 1: Fetch Config (if config name provided) ๐Ÿ“– PHASE 2: Scrape Documentation โœจ PHASE 3: AI Enhancement (MANDATORY - no skip option) ๐Ÿ“ฆ PHASE 4: Package Skill โ˜๏ธ PHASE 5: Upload to Claude (optional, requires API key) ``

Requirements:

  • ANTHROPIC_API_KEY environment variable (for auto-upload)
  • Claude Code Max plan (for local AI enhancement), or use --agent to select a different AI agent

---

๐Ÿ“Š Feature Matrix

Skill Seekers supports 12 LLM platforms, 8 RAG/vector targets, 18 source types, and full feature parity across all targets.

Platforms: Claude AI, Google Gemini, OpenAI ChatGPT, MiniMax AI, Generic Markdown, OpenCode, Kimi (Moonshot AI), DeepSeek AI, Qwen (Alibaba), OpenRouter, Together AI, Fireworks AI Source Types: Documentation websites, GitHub repos, PDFs, Word (.docx), EPUB, Video, Local codebases, Jupyter Notebooks, Local HTML, OpenAPI/Swagger, AsciiDoc, PowerPoint (.pptx), RSS/Atom feeds, Man pages, Confluence wikis, Notion pages, Slack/Discord chat exports

See Complete Feature Matrix for detailed platform and feature support.

Quick Platform Comparison

| Feature | Claude | Gemini | OpenAI | MiniMax | Markdown | |---------|--------|--------|--------|--------|----------| | Format | ZIP + YAML | tar.gz | ZIP + Vector | ZIP + Knowledge | ZIP | | Upload | โœ… API | โœ… API | โœ… API | โœ… API | โŒ Manual | | Enhancement | โœ… Sonnet 4 | โœ… 2.0 Flash | โœ… GPT-4o | โœ… M3 | โŒ None | | All Skill Modes | โœ… | โœ… | โœ… | โœ… | โœ… |

---

Usage Examples

Documentation Scraping

# Scrape documentation website
skill-seekers create --config configs/react.json

# Quick scrape without config
skill-seekers create https://react.dev --name react

# With async mode (3x faster)
skill-seekers create --config configs/godot.json --async --workers 8

# Use a specific AI agent for enhancement
skill-seekers create --config configs/react.json --agent kimi

PDF Extraction

# Basic PDF extraction
skill-seekers create --pdf docs/manual.pdf --name myskill

# Advanced features
skill-seekers create --pdf docs/manual.pdf --name myskill \
    --extract-tables \        # Extract tables
    --parallel \              # Fast parallel processing
    --workers 8               # Use 8 CPU cores

# Scanned PDFs (requires: pip install pytesseract Pillow)
skill-seekers create --pdf docs/scanned.pdf --name myskill --ocr

Video Extraction

# Install video support
pip install skill-seekers[video]        # Transcripts + metadata
pip install skill-seekers[video-full]   # + Whisper + visual frame extraction

# Auto-detect GPU and install visual deps (PyTorch + easyocr)
skill-seekers create --setup

# Extract from YouTube video
skill-seekers create --video-url https://www.youtube.com/watch?v=dQw4w9WgXcQ --name mytutorial

# Extract from a YouTube playlist
skill-seekers create --video-playlist https://www.youtube.com/playlist?list=... --name myplaylist

# Extract from a local video file
skill-seekers create --video-file recording.mp4 --name myrecording

# Extract with visual frame analysis (requires video-full deps)
skill-seekers create --video-url https://www.youtube.com/watch?v=... --name mytutorial --visual

# With AI enhancement (cleans OCR + generates polished SKILL.md)
skill-seekers create --video-url https://www.youtube.com/watch?v=... --visual --enhance-level 2

# Clip a specific section of a video (supports seconds, MM:SS, HH:MM:SS)
skill-seekers create --video-url https://www.youtube.com/watch?v=... --start-time 1:30 --end-time 5:00

# Use Vision API for low-confidence OCR frames (requires ANTHROPIC_API_KEY)
skill-seekers create --video-url https://www.youtube.com/watch?v=... --visual --vision-ocr

# Re-build skill from previously extracted data (skip download)
skill-seekers create --from-json output/mytutorial/video_data/extracted_data.json --name mytutorial

Full guide: See docs/VIDEO_GUIDE.md for complete CLI reference, visual pipeline details, AI enhancement options, and troubleshooting.

GitHub Repository Analysis

# Basic repository scraping
skill-seekers create facebook/react

# With authentication (higher rate limits)
export GITHUB_TOKEN=ghp_your_token_here
skill-seekers create facebook/react

# Customize what to include
skill-seekers create django/django \
    --include-issues \        # Extract GitHub Issues
    --max-issues 100 \        # Limit issue count
    --include-changelog       # Extract CHANGELOG.md

Unified Multi-Source Scraping

Combine documentation + GitHub + PDF into one unified skill with conflict detection:

# Use existing unified configs
skill-seekers create --config configs/react_unified.json
skill-seekers create --config configs/django_unified.json

# Or create unified config
cat > configs/myframework_unified.json << 'EOF'
{
  "name": "myframework",
  "merge_mode": "rule-based",
  "sources": [
    {
      "type": "documentation",
      "base_url": "https://docs.myframework.com/",
      "max_pages": 200
    },
    {
      "type": "github",
      "repo": "owner/myframework",
      "code_analysis_depth": "surface"
    }
  ]
}
EOF

skill-seekers create --config configs/myframework_unified.json

Conflict Detection automatically finds:

  • ๐Ÿ”ด Missing in code (high): Documented but not implemented
  • ๐ŸŸก Missing in docs (medium): Implemented but not documented
  • โš ๏ธ Signature mismatch: Different parameters/types
  • โ„น๏ธ Description mismatch: Different explanations

Full Guide: See docs/features/UNIFIED_SCRAPING.md for complete documentation.

Private Config Repositories

Share custom configs across teams using private git repositories:

# Option 1: Using MCP tools (recommended)
# Register your team's private repo
add_config_source(
    name="team",
    git_url="https://github.com/mycompany/skill-configs.git",
    token_env="GITHUB_TOKEN"
)

# Fetch config from team repo
fetch_config(source="team", config_name="internal-api")

Supported Platforms:

  • GitHub (GITHUB_TOKEN), GitLab (GITLAB_TOKEN), Gitea (GITEA_TOKEN), Bitbucket (BITBUCKET_TOKEN)

Full Guide: See docs/reference/GIT_CONFIG_SOURCES.md for complete documentation.

How It Works

graph LR
    A[Documentation Website] --> B[Skill Seekers]
    B --> C[Scraper]
    B --> D[AI Enhancement]
    B --> E[Packager]
    C --> F[Organized References]
    D --> F
    F --> E
    E --> G[AI Skill .zip]
    G --> H[Upload to AI Platform]
  1. Detect llms.txt - Checks for llms-full.txt, llms.txt, llms-small.txt first (part of Smart SPA Discovery)
  2. Scrape: Extracts all pages from documentation
  3. Categorize: Organizes content into topics (API, guides, tutorials, etc.)
  4. Enhance: AI analyzes docs and creates comprehensive SKILL.md with examples (supports multiple agents via --agent)
  5. Package: Bundles everything into a platform-ready .zip file

Architecture

The system is organized into 8 core modules and 5 utility modules (~200 classes total):

!Package Overview

| Module | Purpose | Key Classes | |--------|---------|-------------| | CLICore | Git-style command dispatcher | CLIDispatcher, SourceDetector, CreateCommand | | Scrapers | 18 source-type extractors | DocToSkillConverter, DocumentSkillBuilder (shared build layer), UnifiedScraper | | Adaptors | 20+ output platform formats | SkillAdaptor (ABC), ClaudeAdaptor, LangChainAdaptor | | Analysis | C3.x codebase analysis pipeline | UnifiedCodebaseAnalyzer, PatternRecognizer, 10 GoF detectors | | Enhancement | AI-powered skill improvement via AgentClient | AgentClient, AIEnhancer, UnifiedEnhancer, WorkflowEngine | | Packaging | Package, upload, install skills | PackageSkill, InstallAgent | | MCP | FastMCP server (40 tools) | SkillSeekerMCPServer, 10 tool modules | | Sync | Doc change detection | ChangeDetector, SyncMonitor, Notifier |

Utility modules: Parsers (28 CLI parsers), Storage (S3/GCS/Azure), Embedding (multi-provider vectors), Benchmark (performance), Utilities (16 shared helpers).

Full UML diagrams: docs/UML_ARCHITECTURE.md | StarUML project: docs/UML/skill_seekers.mdj | HTML API reference: docs/UML/html/

๐Ÿ“‹ Prerequisites

Before you start, make sure you have:

  1. Python 3.10 or higher - Download | Check: python3 --version
  2. Git - Download | Check: git --version
  3. 15-30 minutes for first-time setup

First time user? โ†’ Start Here: Bulletproof Quick Start Guide ๐ŸŽฏ

---

๐Ÿ“ค Uploading Skills to Claude

Once your skill is packaged, you need to upload it to Claude:

Option 1: Automatic Upload (API-based)

# Set your API key (one-time)
export ANTHROPIC_API_KEY=sk-ant-...

# Package and upload automatically
skill-seekers package output/react/ --upload

# OR upload existing .zip
skill-seekers upload output/react.zip

Option 2: Manual Upload (No API Key)

# Package skill
skill-seekers package output/react/
# โ†’ Creates output/react.zip

# Then manually upload:
# - Go to https://claude.ai/skills
# - Click "Upload Skill"
# - Select output/react.zip

Option 3: MCP (Claude Code)

In Claude Code, just ask:
"Package and upload the React skill"

---

๐Ÿค– Installing to AI Agents

Skill Seekers can automatically install skills to 19 AI coding agents.

# Install to specific agent
skill-seekers install-agent output/react/ --agent cursor

# Install to IBM Bob (project-local .bob/skills/)
skill-seekers install-agent output/react/ --agent bob

# Install to all agents at once
skill-seekers install-agent output/react/ --agent all

# Preview without installing
skill-seekers install-agent output/react/ --agent cursor --dry-run

Supported Agents

| Agent | Path | Type | |-------|------|------| | Claude Code | ~/.claude/skills/ | Global | | Cursor | .cursor/skills/ | Project | | VS Code / Copilot | .github/skills/ | Project | | Amp | ~/.amp/skills/ | Global | | Goose | ~/.config/goose/skills/ | Global | | OpenCode | ~/.opencode/skills/ | Global | | Windsurf | ~/.windsurf/skills/ | Global | | Roo Code | .roo/skills/ | Project | | Cline | .cline/skills/ | Project | | Aider | ~/.aider/skills/ | Global | | Bolt | .bolt/skills/ | Project | | Kilo Code | .kilo/skills/ | Project | | Continue | ~/.continue/skills/ | Global | | Kimi Code | ~/.kimi/skills/ | Global | | IBM Bob | .bob/skills/ | Project |

---

๐Ÿ”Œ MCP Integration (40 Tools)

Skill Seekers ships an MCP server for use from Claude Code, Cursor, Windsurf, VS Code + Cline, or IntelliJ IDEA.

# stdio mode (Claude Code, VS Code + Cline)
python -m skill_seekers.mcp.server_fastmcp

# HTTP mode (Cursor, Windsurf, IntelliJ)
python -m skill_seekers.mcp.server_fastmcp --transport http --port 8765

# Auto-configure all agents at once
./setup_mcp.sh

All 40 tools available:

  • Core (9): list_configs, generate_config, validate_config, estimate_pages, scrape_docs, package_skill, upload_skill, enhance_skill, install_skill
  • Extended (10): scrape_github, scrape_pdf, unified_scrape, merge_sources, detect_conflicts, add_config_source, fetch_config, list_config_sources, remove_config_source, split_config
  • Vector DB (4): export_to_chroma, export_to_weaviate, export_to_faiss, export_to_qdrant
  • Cloud (3): cloud_upload, cloud_download, cloud_list

Full Guide: docs/guides/MCP_SETUP.md

---

โš™๏ธ Configuration

Available Presets (24+)

# List all presets
# skill-seekers list-configs  # Not available in v3.7.0

| Category | Presets | |----------|---------| | Web Frameworks | react, vue, angular, svelte, nextjs | | Python | django, flask, fastapi, sqlalchemy, pytest | | Game Development | godot, pygame, unity | | Tools & DevOps | docker, kubernetes, terraform, ansible | | Unified (Docs + GitHub) | react-unified, vue-unified, nextjs-unified, and more |

Creating Your Own Config

# Option 1: Interactive
skill-seekers create --interactive

# Option 2: Copy and edit a preset
cp configs/react.json configs/myframework.json
nano configs/myframework.json
skill-seekers create --config configs/myframework.json

Config File Structure

{
  "name": "myframework",
  "description": "When to use this skill",
  "base_url": "https://docs.myframework.com/",
  "selectors": {
    "main_content": "article",
    "title": "h1",
    "code_blocks": "pre code"
  },
  "url_patterns": {
    "include": ["/docs", "/guide"],
    "exclude": ["/blog", "/about"]
  },
  "categories": {
    "getting_started": ["intro", "quickstart"],
    "api": ["api", "reference"]
  },
  "rate_limit": 0.5,
  "max_pages": 500
}

Where to Store Configs

The tool searches in this order:

  1. Exact path as provided
  2. ./configs/ (current directory)
  3. ~/.config/skill-seekers/configs/ (user config directory)
  4. SkillSeekersWeb.com API (preset configs)

---

๐Ÿ“Š What Gets Created

output/
โ”œโ”€โ”€ godot_data/              # Scraped raw data
โ”‚   โ”œโ”€โ”€ pages/              # JSON files (one per page)
โ”‚   โ””โ”€โ”€ summary.json        # Overview
โ”‚
โ””โ”€โ”€ godot/                   # The skill
    โ”œโ”€โ”€ SKILL.md            # Enhanced with real examples
    โ”œโ”€โ”€ references/         # Categorized docs
    โ”‚   โ”œโ”€โ”€ index.md
    โ”‚   โ”œโ”€โ”€ getting_started.md
    โ”‚   โ”œโ”€โ”€ scripting.md
    โ”‚   โ””โ”€โ”€ ...
    โ”œโ”€โ”€ scripts/            # Empty (add your own)
    โ””โ”€โ”€ assets/             # Empty (add your own)

---

๐Ÿ› Troubleshooting

No Content Extracted?

  • Check your main_content selector
  • Try: article, main, div[role="main"]

Data Exists But Won't Use It?

# Force re-scrape
rm -rf output/myframework_data/
skill-seekers create --config configs/myframework.json

Categories Not Good?

Edit the config categories section with better keywords.

Want to Update Docs?

# Delete old data and re-scrape
rm -rf output/godot_data/
skill-seekers create --config configs/godot.json

Enhancement Not Working?

# Check if API key is set
echo $ANTHROPIC_API_KEY

# Try LOCAL mode instead (uses Claude Code Max, no API key needed)
skill-seekers enhance output/react/ --mode LOCAL

# Monitor background enhancement status
skill-seekers enhance-status output/react/ --watch

GitHub Rate Limit Issues?

# Set a GitHub token (5000 req/hour vs 60/hour anonymous)
export GITHUB_TOKEN=ghp_your_token_here

# Or configure multiple profiles
skill-seekers config --github

---

๐Ÿ“ˆ Performance

| Task | Time | Notes | |------|------|-------| | Scraping (sync) | 15-45 min | First time only, thread-based | | Scraping (async) | 5-15 min | 2-3x faster with --async flag | | Building | 1-3 min | Fast rebuild from cache | | Re-building | <1 min | With --skip-scrape | | Enhancement (LOCAL) | 30-60 sec | Uses Claude Code Max | | Enhancement (API) | 20-40 sec | Requires API key | | Video (transcript) | 1-3 min | YouTube/local, transcript only | | Video (visual) | 5-15 min | + OCR frame extraction | | Packaging | 5-10 sec | Final .zip creation |

---

๐Ÿ†• New in v3.6.0

Workflow Presets

Control analysis depth with --preset:

skill-seekers create https://docs.react.dev/ --preset quick      # Fast, surface-level
skill-seekers create https://docs.react.dev/ --preset standard   # Balanced (default)
skill-seekers create https://docs.react.dev/ --preset comprehensive # Deep, exhaustive

Lifecycle Flags

skill-seekers create https://docs.react.dev/ --dry-run    # Preview without scraping
skill-seekers create https://docs.react.dev/ --fresh      # Ignore cache, full re-scrape
skill-seekers create https://docs.react.dev/ --resume     # Resume interrupted job
skill-seekers create https://docs.react.dev/ --skip-scrape # Re-package existing output

Health Check & Utilities

skill-seekers doctor                    # Diagnose installation & environment
skill-seekers sync-config               # Detect config drift
skill-seekers stream <source>           # Streaming ingestion for large docs
skill-seekers update output/react/      # Incremental update
skill-seekers multilang <source>        # Multi-language skill generation
skill-seekers quality output/react/     # Quality report (add --threshold 7 to gate: non-zero exit below 7/10)

RAG Chunking Options (package)

skill-seekers package output/react/ --chunk-for-rag --chunk-tokens 512 --chunk-overlap-tokens 50

Marketplace Publishing

skill-seekers package output/react/ --marketplace --marketplace-category frontend

Additional Optional Dependencies

| Extra | Install | Purpose | |-------|---------|---------| | browser | pip install "skill-seekers[browser]" | Headless Playwright for SPA sites | | embedding | pip install "skill-seekers[embedding]" | Embedding server support | | s3 / gcs / azure | pip install "skill-seekers[s3]" etc. | Cloud storage upload | | rag-upload | pip install "skill-seekers[rag-upload]" | Combined vector DB upload deps |

---

๐Ÿ“š Documentation

Getting Started

Architecture

Guides

Integration Guides

---

๐Ÿ“ License

MIT License - see LICENSE file for details

---

Happy skill building! ๐Ÿš€

---

๐Ÿ”’ Security

![MseeP.ai Security Assessment Badge](https://mseep.ai/app/yusufkaraaslan-skill-seekers)

---

๐Ÿ’› Sponsors

<p align="center"> <a href="https://www.atlascloud.ai/?utm_source=github&utm_medium=link&utm_campaign=skill_seekers"> <img src="docs/assets/atlas-cloud-logo.png" alt="Atlas Cloud" width="200"> </a> </p>

Atlas Cloud โ€” a full-modal, OpenAI-compatible AI inference platform. Skill Seekers supports it as a packaging/enhancement target via --target atlas with ATLAS_API_KEY.

Related MCP servers

Browse all โ†’