vasceannie/lightrag
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
6,166 Commits 1 Branch 0 Tags
main
Commit Graph

54 Commits

Author SHA1 Message Date
yangdx
833ddf4931 Add CLAUDE.md to .gitignore 2025-12-24 14:10:20 +08:00
BukeLy
eb52ec94d7 feat: Add workspace isolation support for pipeline status 
Problem:
In multi-tenant scenarios, different workspaces share a single global
pipeline_status namespace, causing pipelines from different tenants to
block each other, severely impacting concurrent processing performance.

Solution:
- Extended get_namespace_data() to recognize workspace-specific pipeline
  namespaces with pattern "{workspace}:pipeline" (following GraphDB pattern)
- Added workspace parameter to initialize_pipeline_status() for per-tenant
  isolated pipeline namespaces
- Updated all 7 call sites to use workspace-aware locks:
  * lightrag.py: process_document_queue(), aremove_document()
  * document_routes.py: background_delete_documents(), clear_documents(),
    cancel_pipeline(), get_pipeline_status(), delete_documents()

Impact:
- Different workspaces can process documents concurrently without blocking
- Backward compatible: empty workspace defaults to "pipeline_status"
- Maintains fail-fast: uninitialized pipeline raises clear error
- Expected N× performance improvement for N concurrent tenants

Bug fixes:
- Fixed AttributeError by using self.workspace instead of self.global_config
- Fixed pipeline status endpoint to show workspace-specific status
- Fixed delete endpoint to check workspace-specific busy flag

Code changes: 4 files, 141 insertions(+), 28 deletions(-)

Testing: All syntax checks passed, comprehensive workspace isolation tests completed
 2025-11-17 12:53:44 +08:00
yangdx
a790f081dc Refine gitignore to only exclude root-level test files 2025-11-06 18:51:21 +08:00
anouarbm
1ad0bf82f9 feat: add RAGAS evaluation framework for RAG quality assessment 
This contribution adds a comprehensive evaluation system using the RAGAS
framework to assess LightRAG's retrieval and generation quality.

Features:
- RAGEvaluator class with four key metrics:
  * Faithfulness: Answer accuracy vs context
  * Answer Relevance: Query-response alignment
  * Context Recall: Retrieval completeness
  * Context Precision: Retrieved context quality
- HTTP API integration for live system testing
- JSON and CSV report generation
- Configurable test datasets
- Complete documentation with examples
- Sample test dataset included

Changes:
- Added lightrag/evaluation/eval_rag_quality.py (RAGAS evaluator implementation)
- Added lightrag/evaluation/README.md (comprehensive documentation)
- Added lightrag/evaluation/__init__.py (package initialization)
- Updated pyproject.toml with optional 'evaluation' dependencies
- Updated .gitignore to exclude evaluation results directory

Installation:
pip install lightrag-hku[evaluation]

Dependencies:
- ragas>=0.3.7
- datasets>=4.3.0
- httpx>=0.28.1
- pytest>=8.4.2
- pytest-asyncio>=1.2.0
 2025-11-01 21:36:39 +01:00
yangdx
2496d87148 Add data/ directory to .gitignore 2025-10-31 14:51:53 +08:00
yangdx
78ccc4f6fd Refactor .gitignore 2025-10-30 12:56:40 +08:00
yangdx
04d2367147 Fix redoc access problem in front-end dev mode 
- Add /redoc endpoint to proxy config
- Remove root path from API endpoints
- Add .env.development to git reopo
- Update sample environment files
- Refine .gitignore patterns for env files
 2025-10-17 20:36:15 +08:00
yangdx
c0b1552e49 Remove .gitkeep file by ensuring webui dir exists on bun build 2025-10-14 03:22:48 +08:00
yangdx
be9e6d1612 Exclude Frontend Build Artifacts from Git Repository 
• Automate frontend build in CI/CD
• Add build validation checks
• Clean git repo of build artifacts
• Comprehensive build guide docs
• Smart setup.py build validation
 2025-10-13 23:43:34 +08:00
yangdx
577b9e6882 Add project intelligence files for AI agent collaboration 
- Add .clinerules with technical patterns
- Create Agments.md for Codex agent guidance
- Ensures consistent behavior across all team members
 2025-10-09 16:35:38 +08:00
yangdx
1f07d4b160 Remove .env_example from .gitignore 2025-10-02 21:20:24 +08:00
yangdx
0b45d463df Add .clinerules to .gitignore 2025-08-15 00:43:45 +08:00
yangdx
ecd7777e61 Update OpenAI embedding handling for both list and base64 embeddings 
- Fix OpenAI embedding array parsing
- Improve embedding data type safety
 2025-08-09 08:40:33 +08:00
yangdx
8dd3069005 feat: add tiktoken cache directory support for offline deployment 
- Mount tiktoken cache volume in docker-compose
- Add TIKTOKEN_CACHE_DIR environment variable
- Update env.example with tiktoken cache configuration
- Added /data to gitignore
- Added tiktoken env example
 2025-08-05 14:22:19 +08:00
yangdx
d94b5f07a4 Update .gitignore 2025-06-02 17:26:00 +08:00
Daniel.y
dbad528e62 Update .gitignore 2025-03-13 02:19:23 +08:00
yangdx
5b70d34822 Fix get single node subgrap problem 
- Replaced MATCH with OPTIONAL MATCH
- Add memory-bank directory for Cline to .gitignore
 2025-03-13 02:14:02 +08:00
zrguo
1611400854 fix demo 2025-03-03 18:33:42 +08:00
yangdx
8fb3670ac7 Add additional log-related patterns to gitignore 2025-03-02 02:26:21 +08:00
yangdx
a8abcf14ac Fit linting 2025-02-20 04:12:21 +08:00
yangdx
36de7e3197 Add test_* pattern to .gitignore for unit test files 2025-02-20 03:46:36 +08:00
zrguo
fc6dff04ff fix logger level 2025-02-17 15:10:15 +08:00
yangdx
8f6e9fcf50 Merge branch 'main' into add-env-settings 2025-02-16 22:34:39 +08:00
yangdx
cfb49fc013 Delete inline comment about config.ini 2025-02-16 22:31:12 +08:00
Yannick Stephan
50919442e9 Improve git and docker ignore 2025-02-15 00:58:24 +01:00
Saifeddine ALOUI
06c9e4e454 Fixed missing imports bug and fixed linting 2025-01-25 00:55:07 +01:00
Saifeddine ALOUI
34018cb1e0 Separated llms from the main llm.py file and fixed some deprication bugs 2025-01-25 00:11:00 +01:00
jin
6ae8647285 support pipeline mode 2025-01-16 12:58:15 +08:00
jin
957bcf8659 Organize files 
move some test files from root to example
 2025-01-07 13:51:20 +08:00
Saifeddine ALOUI
9921223281 Merge remote-tracking branch 'upstream/main' 2024-12-25 18:04:02 +01:00
Saifeddine ALOUI
848465d5d7 precommit tested 2024-12-24 10:35:00 +01:00
Luca Congiu
725d5af215 Refactor code formatting and update requirements for improved clarity and consistency 2024-12-24 09:56:33 +01:00
Luca Congiu
58e74d5fb2 Added Azure OpenAI api sample with streaming 2024-12-23 14:34:34 +01:00
Saifeddine ALOUI
fe6ebfa995 Fixed linting 2024-12-19 11:44:01 +01:00
Saifeddine ALOUI
d8f4f3eede Added a fastapi service 2024-12-16 01:05:49 +01:00
jin
26ae240c65 Logic Optimization 2024-11-25 13:40:38 +08:00
jin
89c2de54a2 Optimization logic 2024-11-25 13:29:55 +08:00
jin
8bc5d4efff add Oracle support 2024-11-12 09:59:12 +08:00
LarFii
b49f73181c update 2024-11-11 17:54:22 +08:00
LarFii
4c0352ee2b Add delete method 2024-11-11 17:48:40 +08:00
jin
b1cf41d242 fix bug 2024-11-11 15:19:42 +08:00
wiltshirek
f40725feeb Merge branch 'main' into main 2024-11-01 16:50:45 -04:00
Ken Wiltshire
b41d990fd6 securing for production with env vars for creds 2024-11-01 11:01:50 -04:00
Ken Wiltshire
e966a14418 set kg by start param, defaults to networkx 2024-11-01 08:47:52 -04:00
Ken Wiltshire
e4509327dd index to neo4j working and tested. check queires next. 2024-10-30 17:48:14 -04:00
Ken Wiltshire
01b7df7afa inference running locally. use neo4j next 2024-10-27 15:37:41 -04:00
Andrii Lazarchuk
392bf05be1 Merge remote-tracking branch 'origin/main' into fix-ollama-integration 2024-10-21 12:00:37 +00:00
Andrii Lazarchuk
25a2dd41c1 Add ability to passadditional parameters to ollama library like host and timeout 2024-10-21 11:55:46 +00:00
Andrii Lazarchuk
108fc4a1ee Add ability to passadditional parameters to ollama library like host and timeout 2024-10-21 11:53:06 +00:00
LarFii
bcd81e3a50 Add visualization methods 2024-10-20 23:08:26 +08:00