Commit Graph
87 Commits
Author SHA1 Message Date
Folzo fdcf513baf feat: add effi-ocr tool with Valves configuration and improved file search
- Added Valves (Pydantic) pattern for ocr_url configuration via wheel icon
- Inspired by Kreuzberg tool: multi-level file search (exact, substring, word matches)
- Support for multi-file OCR with extract_text_from_images
- Added search_files function for pattern matching
- effi-ocr runs on port 8301 (Tesseract with preprocessing)
2026-04-12 17:52:42 +02:00
Folzo 82ea2313f0 docs: add Effi system prompt - original and optimized versions
- Original prompt kept for reference (200+ lines, too verbose)
- New optimized prompt: ~40 lines, -75% tokens
- Added table for tools usage (Kreuzberg, web_search, sub-agent, etc.)
- Optimized version includes explicit Kreuzberg usage for OCR
2026-04-12 16:41:13 +02:00
Folzo 189ff4eaab docs: April 2026 optimizations - gemma4:e4b, RAG, Ollama service
- LLM principal: gemma4:e4b (9.6GB, 128K context, MMLU 82.6%)
- Ollama service systemd with optimization vars (FLASH_ATTENTION, KV_CACHE)
- RAG: RAG_SYSTEM_CONTEXT=True, ENABLE_RAG_HYBRID_SEARCH=True
- ComfyUI memory manager: fix timestamp parsing (execution_success)
2026-04-12 16:19:14 +02:00
Folzo 49d7afdf1f docs: restore Structure du Projet section 2026-04-12 14:36:53 +02:00
Folzo 8f472170f6 docs: add Beszel tool improvements + update README
- README: add Tool OpenWebUI section with current features
- README: update Historique with Tool section
- Tool doc: add Limitations and Future Improvements sections

Future improvements noted:
- Support historique (données N dernières minutes)
- Filtres par période
- Graphiques et alertes automatisées
2026-04-12 14:34:29 +02:00
Folzo cf406b764f fix: Beszel tool - correct PocketBase API endpoints
- Changed /api/auth/login to /api/collections/users/auth-with-password
- Changed /api/systems to /api/collections/systems/records
- Added proper error messages for connection issues
2026-04-12 13:59:50 +02:00
Folzo 26e6b89229 fix: Use Pydantic Valves pattern for OpenWebUI tool config
- Add BaseModel Valves class with configurable parameters
- beszel_url, beszel_user, beszel_password as configurable valves
- Matches ACE Step tool pattern for UI configuration
2026-04-12 13:46:20 +02:00
Folzo 6212aa6f27 fix: Use hardcoded config in Beszel tool - no env vars needed 2026-04-12 13:42:44 +02:00
Folzo 3dbd2bcc17 fix: Rename class to Tools for OpenWebUI compatibility 2026-04-12 13:39:12 +02:00
Folzo b42cfcabce feat: Add Beszel tool for OpenWebUI
Permet à Effi de:
- get_all_stats() - Stats de tous les systèmes
- get_system_stats('folzocorp') - Stats d'un système
- check_alerts() - Vérifier les alertes
- get_gpu_status('folzocorp') - Status GPU AMD
- can_run_comfyui() - Vérifier si ComfyUI peut tourner
2026-04-12 13:01:48 +02:00
Folzo 4fff805c3d feat(beszel): Add NAS Synology agent configuration 2026-04-12 12:51:00 +02:00
Folzo f425294473 fix: ComfyUI memory manager - only consider recent history (last 5min)
- Fix bug where old history entries were counted as recent activity
- Added recent_threshold parameter (default 300s)
- is_recent_history() now checks timestamp of last history item
2026-04-12 12:37:18 +02:00
Folzo 952a9da41a docs: Rewrite README.md with complete project overview
- Add full architecture diagram with all machines (FolzoCorp, EffiServer, NAS)
- Document all services on each machine with ports and roles
- Add memory management section (auto-unload scripts)
- Add project structure tree
- Update technologies list
- Add documentation links
2026-04-12 12:30:28 +02:00
Folzo b69dee1d3a docs: Mettre à jour journal de session 2026-04-12
- État final des scripts et services
- ComfyUI memory manager avec restart container
- Beszel wake service
- Résumé commits
2026-04-12 12:25:45 +02:00
Folzo 2ca4235b89 feat: Add ComfyUI memory manager that restarts container after inactivity
- Monitors VRAM, queue status, and history
- Restarts ComfyUI container after timeout if RAM > 5GB and VRAM < 1%
- More effective at freeing RAM than model unloading alone
2026-04-12 12:14:59 +02:00
Folzo 7439033edd fix: Corriger script ComfyUI monitor et service systemd
- Corriger extraction VRAM via API correcte
- Ajouter gestion signaux propre
- Ajouter TimeoutStopSec pour arrêt propre
- Ajouter service restart Beszel au réveil
2026-04-12 12:08:27 +02:00
Folzo e528e25bde feat: Add systemd services and startup script for memory monitors 2026-04-12 10:20:39 +02:00
Folzo cf5b39215e docs: Ajouter journal de session 2026-04-12 - RAM + Beszel 2026-04-12 10:01:55 +02:00
Folzo 8b6f967736 fix(beszel): Remove group_add video/render for Fedora compatibility 2026-04-12 09:43:30 +02:00
Folzo 5b677d840d fix(beszel): Mise à jour chemins d'installation
- Synology NAS: /volume1/docker/beszel
- EffiServer: ~/effi/beszel
- FolzoCorp: chemin projet Effi (inchangé)
2026-04-12 09:34:59 +02:00
Folzo 8b1338f824 feat(beszel): Installation Beszel monitoring infrastructure
- Ajout Hub Beszel pour Synology NAS (192.168.1.25)
  - docker-compose-hub.yml
- Ajout Agent FolzoCorp avec GPU AMD RX 7800 XT
  - docker-compose-agent-folzocorp.yml (amd_sysfs)
- Ajout Agent EffiServer (CPU only, SKIP_GPU)
  - docker-compose-agent-effiserver.yml
- Documentation: docs/BESZEL-INSTALLATION.md
- Script client Python: scripts/beszel_client.py
  - Permet à Effi d'interroger l'API Beszel
2026-04-12 09:29:59 +02:00
Folzo f69dda5e20 feat(memory): Ajout déchargement automatique mémoire sur FolzoCorp
- effi-stt: Déchargement Whisper après 300s inactivité (INACTIVITY_TIMEOUT)
  * Nouveaux endpoints: /unload, /reload, /stats
  * Modelo rechargé à la première requête
- ComfyUI: Script monitor qui décharge VRAM après inactivité
  * Vérifie usage VRAM toutes les 60s
  * Exécute workflow UnloadAllModelsNode après 300s inactivité
- Kreuzberg: Manager qui redémarre le container après seuil mémoire + inactivité
  * Restart si > 2GB pendant > 10min inactif
- Documentation: docs/MEMOIRE-GESTION.md
2026-04-12 09:26:29 +02:00
Folzo e501213959 feat(generate-song): add ACE-Step download script, remove legacy effi-ocr
- Add download-ace-step-full.sh script for easier model downloads
- Remove effi-ocr (migrated to effi-kreuzberg for OCR functionality)
- Generate Song v0.5.4 now fully functional with JK-AceStep-Nodes
2026-04-11 12:27:20 +02:00
Folzo 2ab1efd7e4 Fix _find_file to prioritize exact matches and word count 2026-04-11 03:27:17 +02:00
Folzo 58b439cf1d docs: add system prompt with OCR reminder to use extract_file tool 2026-04-11 02:45:36 +02:00
Folzo 263a942585 fix(kreuzberg): fix 'read of closed file' error by reading file content before requests 2026-04-11 02:42:54 +02:00
Folzo b72dafd66b feat(kreuzberg): improve tool - remove preprocessing, better file search, show available files on error
- Removed image preprocessing (Kreuzberg handles it internally)
- Improved file search (partial name matching)
- Shows available files when file not found
- Uses mimetypes for proper content-type
2026-04-11 02:36:32 +02:00
Folzo 33a463d5a4 fix(effi-ocr): revert to simpler preprocessing - grayscale + contrast 1.8x 2026-04-11 02:26:57 +02:00
Folzo 9a69d96999 fix(effi-ocr): improve preprocessing for dark/shadowy document areas
- Add median filter to reduce noise
- Increase contrast from x2 to x2.5
- Add brightness enhancement x1.2
2026-04-11 02:24:59 +02:00
Folzo eebebd64f1 fix(effi-ocr): explicitly set content-type from mimetypes when sending file 2026-04-11 02:17:57 +02:00
Folzo 35486244fe fix(effi-ocr): handle None content-type by guessing from filename extension 2026-04-11 02:13:11 +02:00
Folzo f17b62737a fix(effi-ocr): improve file search and show available files on error 2026-04-11 02:09:09 +02:00
Folzo fb1a9f1176 fix(effi-ocr-server): final config - remove network, use default 2026-04-11 01:57:58 +02:00
Folzo 07c1bb5e5e fix(effi-ocr-server): use correct volume name effi_open-webui-data 2026-04-11 01:54:35 +02:00
Folzo 56a07beb64 fix(effi-ocr-server): add open-webui volume for file access 2026-04-11 01:50:33 +02:00
Folzo 39e9bee291 fix(effi-ocr-server): remove external volume dependency 2026-04-11 01:47:48 +02:00
Folzo 133bd5924e fix(effi-ocr-server): create effi-net network instead of external 2026-04-11 01:45:40 +02:00
Folzo fcbbb75e8f fix: change path to /home/effi/effi-ocr 2026-04-11 01:42:27 +02:00
Folzo 78c3f27104 fix(effi-ocr): update paths for effi-server installation
- Change install path to /root/effi/effi-ocr
- Change OCR_URL default to localhost:8301
2026-04-11 01:40:43 +02:00
Folzo b7af58a2c5 feat(effi-ocr): add effi-server deployment configuration
- docker-compose for effi-server (192.168.1.27)
- Uses same network and volumes as OpenWebUI
- Port 8301
2026-04-11 01:38:06 +02:00
Folzo a8e9792412 fix(effi-ocr): improve file search and normalize language codes
- Better file finding (startswith + contains)
- Normalize language codes (French->fra, English->eng, etc.)
- List all files in directory when searching
2026-04-11 01:31:06 +02:00
Folzo 54aaea3df3 fix(effi-ocr): update tool for port 8301 and correct file paths
- Change OCR_URL to port 8301
- Add uploads directory paths for finding files
- Add list_recent_files function
2026-04-11 01:15:49 +02:00
Folzo e4009f22ce docs: add effi-ocr-legacy for OCR comparison
effi-ocr runs on port 8301 alongside Kreuzberg on 8300 for quality comparison
2026-04-11 01:04:48 +02:00
Folzo e9d6de3513 fix(kreuzberg): rewrite tool code to fix parsing errors
- Remove complex docstrings that caused parsing issues
- Use simple string concatenation instead of f-strings with special chars
- Remove duplicate code
- Keep functionality intact: single file, multi-file, list, search
2026-04-11 00:47:21 +02:00
Folzo 98b695bc31 docs: document PaddleOCR configuration 2026-04-11 00:42:46 +02:00
Folzo f85ee6c122 feat(kreuzberg): add multi-file processing and PaddleOCR backend
- Add extract_files() for processing multiple files one by one
- Support comma-separated and JSON array input
- Switch OCR backend from Tesseract to PaddleOCR (better accuracy)
- Update tool description
2026-04-11 00:42:32 +02:00
Folzo 3355fd4f28 docs: add OCR quality improvement note (preprocessing grayscale + contrast) 2026-04-11 00:32:54 +02:00
Folzo 2ada7cab05 fix(kreuzberg): add image preprocessing for better OCR quality
- Convert images to grayscale before OCR
- Increase contrast by 2x for better text detection
- This matches the preprocessing that effi-ocr (Tesseract) was using
2026-04-11 00:32:37 +02:00
Folzo d58c38bca1 fix(openwebui): add Kreuzberg integration solution with OCR patches
- Document FETCH_URL_MAX_CONTENT_LENGTH typo bug fix
- Add image_export_mode=inline + ocr=true patch for DoclingLoader
- Add 'docling' to MIME type validation in files.py
- Enable OCR processing for image files in Knowledge Bases
2026-04-11 00:22:41 +02:00
Folzo 982ec160ca feat: update ACE-Step documentation and scripts
- docs/guide-ace-step.md: Complete installation guide
- comfyui/download-ace-step.sh: Download script for all ACE-Step models
- comfyui/docker-compose.yml: Add diffusion_models and text_encoders mounts

Includes:
- ace_step_1.5_turbo_aio.safetensors (~9.4GB)
- qwen_0.6b_ace15.safetensors
- qwen_1.7b_ace15.safetensors
- ace_1.5_vae.safetensors
2026-04-08 23:30:21 +02:00