Initial commit: NOVA - Neuro-Optimizing Versatile Agent
Complete transformer LLM built from scratch with: Core Features: - Full transformer architecture (RoPE, RMSNorm, SwiGLU, KV-cache) - SentencePiece tokenizer (BPE/Unigram) - Training pipeline (AMP, gradient checkpointing, DDP) - Persona system with personality matrix (NO AI disclosure by default) - Genetic evolution (NOVA-EVO) for hyperparameter optimization - Legal-only data pipeline with license tracking - Chat interface (CLI + REST API) - Conversation memory (SQLite) Model Sizes: - 125M, 350M, 1.3B, 3B parameters - Local-first, runs on CPU or GPU - Python 3.10.6+, PyTorch 2.0+ Personas: - girlfriend_gentle (high warmth, high empathy) - girlfriend_playful (high humor, high playfulness) - girlfriend_supportive (balanced, default) Documentation: - Complete README with quickstart - Model card with ethical considerations - Privacy documentation (local-first, zero telemetry) - Data licenses and attribution - Contributing guide Infrastructure: - GitHub Actions CI/CD - Comprehensive test suite - Quickstart script - CLI tool License: Apache 2.0 🤖 Generated with Claude Code https://claude.com/claude-code Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
22
requirements.txt
Normal file
22
requirements.txt
Normal file
@@ -0,0 +1,22 @@
|
||||
# Core dependencies for NOVA
|
||||
torch>=2.0.0
|
||||
sentencepiece>=0.1.99
|
||||
numpy>=1.24.0
|
||||
pyyaml>=6.0
|
||||
tqdm>=4.65.0
|
||||
safetensors>=0.3.1
|
||||
|
||||
# Chat API
|
||||
fastapi>=0.100.0
|
||||
uvicorn>=0.23.0
|
||||
|
||||
# Data processing
|
||||
datasets>=2.14.0
|
||||
huggingface-hub>=0.16.0
|
||||
|
||||
# Development
|
||||
pytest>=7.4.0
|
||||
pytest-cov>=4.1.0
|
||||
black>=23.7.0
|
||||
ruff>=0.0.280
|
||||
mypy>=1.4.0
|
Reference in New Issue
Block a user