* UN-2470 [MISC] Remove Django dependency from Celery workers This commit introduces a new worker architecture that decouples Celery workers from Django where possible, enabling support for gevent/eventlet pool types and reducing worker startup overhead. Key changes: - Created separate worker modules (api-deployment, callback, file_processing, general) - Added internal API endpoints for worker communication - Implemented Django-free task execution where appropriate - Added shared utilities and client facades - Updated container configurations for new worker architecture 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> * Fix pre-commit issues: file permissions and ruff errors Setup the docker for new workers - Add executable permissions to worker entrypoint files - Fix import order in namespace package __init__.py - Remove unused variable api_status in general worker - Address ruff E402 and F841 errors 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> * refactoreed, Dockerfiles,fixes * flexibility on celery run commands * added debug logs * handled filehistory for API * cleanup * cleanup * cloud plugin structure * minor changes in import plugin * added notification and logger workers under new worker module * add docker compatibility for new workers * handled docker issues * log consumer worker fixes * added scheduler worker * minor env changes * cleanup the logs * minor changes in logs * resolved scheduler worker issues * cleanup and refactor * ensuring backward compatibbility to existing wokers * added configuration internal apis and cache utils * optimization * Fix API client singleton pattern to share HTTP sessions - Fix flawed singleton implementation that was trying to share BaseAPIClient instances - Now properly shares HTTP sessions between specialized clients - Eliminates 6x BaseAPIClient initialization by reusing the same underlying session - Should reduce API deployment orchestration time by ~135ms (from 6 clients to 1 session) - Added debug logging to verify singleton pattern activation * cleanup and structuring * cleanup in callback * file system connectors issue * celery env values changes * optional gossip * variables for sync, mingle and gossip * Fix for file type check * Task pipeline issue resolving * api deployement failed response handled * Task pipline fixes * updated file history cleanup with active file execution * pipline status update and workflow ui page execution * cleanup and resolvinf conflicts * remove unstract-core from conenctoprs * Commit uv.lock changes * uv locks updates * resolve migration issues * defer connector-metadtda * Fix connector migration for production scale - Add encryption key handling with defer() to prevent decryption failures - Add final cleanup step to fix duplicate connector names - Optimize for large datasets with batch processing and bulk operations - Ensure unique constraint in migration 0004 can be created successfully 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> * hitl fixes * minor fixes on hitl * api_hub related changes * dockerfile fixes * api client cache fixes with actual response class * fix: tags and llm_profile_id * optimized clear cache * cleanup * enhanced logs * added more handling on is file dir and added loggers * cleanup the runplatform script * internal apis are excempting from csrf * sonal cloud issues * sona-cloud issues * resolving sonar cloud issues * resolving sonar cloud issues * Delta: added Batch size fix in workers * comments addressed * celery configurational changes for new workers * fiixes in callback regaurding the pipline type check * change internal url registry logic * gitignore changes * gitignore changes * addressng pr cmmnets and cleanup the codes * adding missed profiles for v2 * sonal cloud blocker issues resolved * imlement otel * Commit uv.lock changes * handle execution time and some cleanup * adding user_data in metadata Pr: https://github.com/Zipstack/unstract/pull/1544 * scheduler backward compatibitlity * replace user_data with custom_data * Commit uv.lock changes * celery worker command issue resolved * enhance package imports in connectors by changing to lazy imports * Update runner.py by removing the otel from it Update runner.py by removing the otel from it Signed-off-by: ali <117142933+muhammad-ali-e@users.noreply.github.com> * added delta changes * handle erro to destination db * resolve tool instances id validation and hitl queu name in API * handled direct execution from workflow page to worker and logs * handle cost logs * Update health.py Signed-off-by: Ritwik G <100672805+ritwik-g@users.noreply.github.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * minor log changes * introducing log consumer scheduler to bulk create, and socket .emit from worker for ws * Commit uv.lock changes * time limit or timeout celery config cleanup * implemented redis client class in worker * pipline status enum mismatch * notification worker fixes * resolve uv lock conflicts * workflow log fixes * ws channel name issue resolved. and handling redis down in status tracker, and removing redis keys * default TTL changed for unified logs * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: ali <117142933+muhammad-ali-e@users.noreply.github.com> Signed-off-by: Ritwik G <100672805+ritwik-g@users.noreply.github.com> Co-authored-by: Claude <noreply@anthropic.com> Co-authored-by: Ritwik G <100672805+ritwik-g@users.noreply.github.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
716 lines
14 KiB
Plaintext
716 lines
14 KiB
Plaintext
# Created by https://www.toptal.com/developers/gitignore/api/windows,macos,linux,pycharm,pycharm+all,pycharm+iml,python,visualstudiocode,react,django
|
|
# Edit at https://www.toptal.com/developers/gitignore?templates=windows,macos,linux,pycharm,pycharm+all,pycharm+iml,python,visualstudiocode,react,django
|
|
|
|
# Development helper scripts
|
|
*.sh
|
|
# list Exceptional files with ! like !fix-and-test.sh
|
|
!run-platform.sh
|
|
!workers/run-worker.sh
|
|
!workers/run-worker-docker.sh
|
|
!workers/log_consumer/scheduler.sh
|
|
|
|
### Django ###
|
|
*.log
|
|
*.pot
|
|
*.pyc
|
|
__pycache__/
|
|
local_settings.py
|
|
media
|
|
|
|
# If your build process includes running collectstatic, then you probably don't need or want to include staticfiles/
|
|
# in your Git repository. Update and uncomment the following line accordingly.
|
|
# <django-project-name>/staticfiles/
|
|
|
|
### Django.Python Stack ###
|
|
# Byte-compiled / optimized / DLL files
|
|
*.py[cod]
|
|
*$py.class
|
|
|
|
# C extensions
|
|
*.so
|
|
|
|
# Distribution / packaging
|
|
.Python
|
|
build/
|
|
develop-eggs/
|
|
dist/
|
|
downloads/
|
|
eggs/
|
|
.eggs/
|
|
lib/
|
|
lib64/
|
|
parts/
|
|
sdist/
|
|
var/
|
|
wheels/
|
|
share/python-wheels/
|
|
*.egg-info/
|
|
.installed.cfg
|
|
*.egg
|
|
MANIFEST
|
|
|
|
# PyInstaller
|
|
# Usually these files are written by a python script from a template
|
|
# before PyInstaller builds the exe, so as to inject date/other infos into it.
|
|
*.manifest
|
|
*.spec
|
|
|
|
# Installer logs
|
|
pip-log.txt
|
|
pip-delete-this-directory.txt
|
|
|
|
# Unit test / coverage reports
|
|
htmlcov/
|
|
**/report.html
|
|
.tox/
|
|
.nox/
|
|
.coverage
|
|
.coverage.*
|
|
.cache
|
|
nosetests.xml
|
|
coverage.xml
|
|
*.cover
|
|
*.py,cover
|
|
.hypothesis/
|
|
.pytest_cache/
|
|
cover/
|
|
|
|
# Translations
|
|
*.mo
|
|
|
|
# Django stuff:
|
|
|
|
# Flask stuff:
|
|
instance/
|
|
.webassets-cache
|
|
|
|
# Scrapy stuff:
|
|
.scrapy
|
|
|
|
# Sphinx documentation
|
|
docs/_build/
|
|
|
|
# PyBuilder
|
|
.pybuilder/
|
|
target/
|
|
|
|
# Jupyter Notebook
|
|
.ipynb_checkpoints
|
|
|
|
# IPython
|
|
profile_default/
|
|
ipython_config.py
|
|
|
|
# pyenv
|
|
# For a library or package, you might want to ignore these files since the code is
|
|
# intended to run in multiple environments; otherwise, check them in:
|
|
# .python-version
|
|
|
|
# pipenv
|
|
# According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
|
|
# However, in case of collaboration, if having platform-specific dependencies or dependencies
|
|
# having no cross-platform support, pipenv may install dependencies that don't work, or not
|
|
# install all needed dependencies.
|
|
#Pipfile.lock
|
|
|
|
# poetry
|
|
# Similar to Pipfile.lock, it is generally recommended to include poetry.lock in version control.
|
|
# This is especially recommended for binary packages to ensure reproducibility, and is more
|
|
# commonly ignored for libraries.
|
|
# https://python-poetry.org/docs/basic-usage/#commit-your-poetrylock-file-to-version-control
|
|
#poetry.lock
|
|
|
|
# pdm
|
|
# Similar to Pipfile.lock, it is generally recommended to include pdm.lock in version control.
|
|
#pdm.lock
|
|
# pdm stores project-wide configurations in .pdm.toml, but it is recommended to not include it
|
|
# in version control.
|
|
# https://pdm.fming.dev/#use-with-ide
|
|
.pdm.toml
|
|
.pdm-build
|
|
.pdm-python
|
|
|
|
# PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm
|
|
__pypackages__/
|
|
|
|
# Celery stuff
|
|
celerybeat-schedule
|
|
celerybeat.pid
|
|
|
|
# SageMath parsed files
|
|
*.sage.py
|
|
|
|
# Environments
|
|
test*.env
|
|
*.env
|
|
!sample.env
|
|
.env.export
|
|
.venv*
|
|
env/
|
|
venv/
|
|
ENV/
|
|
env.bak/
|
|
venv.bak/
|
|
|
|
# Spyder project settings
|
|
.spyderproject
|
|
.spyproject
|
|
|
|
# Rope project settings
|
|
.ropeproject
|
|
|
|
# mkdocs documentation
|
|
/site
|
|
|
|
# mypy
|
|
.mypy_cache/
|
|
.dmypy.json
|
|
dmypy.json
|
|
|
|
# Pyre type checker
|
|
.pyre/
|
|
|
|
# pytype static type analyzer
|
|
.pytype/
|
|
|
|
# Cython debug symbols
|
|
cython_debug/
|
|
|
|
# PyCharm
|
|
# JetBrains specific template is maintained in a separate JetBrains.gitignore that can
|
|
# be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
|
|
# and can be added to the global gitignore or merged into this file. For a more nuclear
|
|
# option (not recommended) you can uncomment the following to ignore the entire idea folder.
|
|
.idea/
|
|
|
|
### Linux ###
|
|
*~
|
|
|
|
# temporary files which can be created if a process still has a handle open of a deleted file
|
|
.fuse_hidden*
|
|
|
|
# KDE directory preferences
|
|
.directory
|
|
|
|
# Linux trash folder which might appear on any partition or disk
|
|
.Trash-*
|
|
|
|
# .nfs files are created when an open file is removed but is still being accessed
|
|
.nfs*
|
|
|
|
### macOS ###
|
|
# General
|
|
.DS_Store
|
|
.AppleDouble
|
|
.LSOverride
|
|
|
|
# Icon must end with two \r
|
|
Icon
|
|
|
|
|
|
# Thumbnails
|
|
._*
|
|
|
|
# Files that might appear in the root of a volume
|
|
.DocumentRevisions-V100
|
|
.fseventsd
|
|
.Spotlight-V100
|
|
.TemporaryItems
|
|
.Trashes
|
|
.VolumeIcon.icns
|
|
.com.apple.timemachine.donotpresent
|
|
|
|
# Directories potentially created on remote AFP share
|
|
.AppleDB
|
|
.AppleDesktop
|
|
Network Trash Folder
|
|
Temporary Items
|
|
.apdisk
|
|
|
|
### macOS Patch ###
|
|
# iCloud generated files
|
|
*.icloud
|
|
|
|
### PyCharm ###
|
|
# Covers JetBrains IDEs: IntelliJ, RubyMine, PhpStorm, AppCode, PyCharm, CLion, Android Studio, WebStorm and Rider
|
|
# Reference: https://intellij-support.jetbrains.com/hc/en-us/articles/206544839
|
|
|
|
# User-specific stuff
|
|
.idea/**/workspace.xml
|
|
.idea/**/tasks.xml
|
|
.idea/**/usage.statistics.xml
|
|
.idea/**/dictionaries
|
|
.idea/**/shelf
|
|
|
|
# AWS User-specific
|
|
.idea/**/aws.xml
|
|
|
|
# Generated files
|
|
.idea/**/contentModel.xml
|
|
|
|
# Sensitive or high-churn files
|
|
.idea/**/dataSources/
|
|
.idea/**/dataSources.ids
|
|
.idea/**/dataSources.local.xml
|
|
.idea/**/sqlDataSources.xml
|
|
.idea/**/dynamic.xml
|
|
.idea/**/uiDesigner.xml
|
|
.idea/**/dbnavigator.xml
|
|
|
|
# Gradle
|
|
.idea/**/gradle.xml
|
|
.idea/**/libraries
|
|
|
|
# Gradle and Maven with auto-import
|
|
# When using Gradle or Maven with auto-import, you should exclude module files,
|
|
# since they will be recreated, and may cause churn. Uncomment if using
|
|
# auto-import.
|
|
# .idea/artifacts
|
|
# .idea/compiler.xml
|
|
# .idea/jarRepositories.xml
|
|
# .idea/modules.xml
|
|
# .idea/*.iml
|
|
# .idea/modules
|
|
# *.iml
|
|
# *.ipr
|
|
|
|
# CMake
|
|
cmake-build-*/
|
|
|
|
# Mongo Explorer plugin
|
|
.idea/**/mongoSettings.xml
|
|
|
|
# File-based project format
|
|
*.iws
|
|
|
|
# IntelliJ
|
|
out/
|
|
|
|
# mpeltonen/sbt-idea plugin
|
|
.idea_modules/
|
|
|
|
# JIRA plugin
|
|
atlassian-ide-plugin.xml
|
|
|
|
# Cursive Clojure plugin
|
|
.idea/replstate.xml
|
|
|
|
# SonarLint plugin
|
|
.idea/sonarlint/
|
|
|
|
# Crashlytics plugin (for Android Studio and IntelliJ)
|
|
com_crashlytics_export_strings.xml
|
|
crashlytics.properties
|
|
crashlytics-build.properties
|
|
fabric.properties
|
|
|
|
# Editor-based Rest Client
|
|
.idea/httpRequests
|
|
|
|
# Android studio 3.1+ serialized cache file
|
|
.idea/caches/build_file_checksums.ser
|
|
|
|
### PyCharm Patch ###
|
|
# Comment Reason: https://github.com/joeblau/gitignore.io/issues/186#issuecomment-215987721
|
|
|
|
# *.iml
|
|
# modules.xml
|
|
# .idea/misc.xml
|
|
# *.ipr
|
|
|
|
# Sonarlint plugin
|
|
# https://plugins.jetbrains.com/plugin/7973-sonarlint
|
|
.idea/**/sonarlint/
|
|
|
|
# SonarQube Plugin
|
|
# https://plugins.jetbrains.com/plugin/7238-sonarqube-community-plugin
|
|
.idea/**/sonarIssues.xml
|
|
|
|
# Markdown Navigator plugin
|
|
# https://plugins.jetbrains.com/plugin/7896-markdown-navigator-enhanced
|
|
.idea/**/markdown-navigator.xml
|
|
.idea/**/markdown-navigator-enh.xml
|
|
.idea/**/markdown-navigator/
|
|
|
|
# Cache file creation bug
|
|
# See https://youtrack.jetbrains.com/issue/JBR-2257
|
|
.idea/$CACHE_FILE$
|
|
|
|
# CodeStream plugin
|
|
# https://plugins.jetbrains.com/plugin/12206-codestream
|
|
.idea/codestream.xml
|
|
|
|
# Azure Toolkit for IntelliJ plugin
|
|
# https://plugins.jetbrains.com/plugin/8053-azure-toolkit-for-intellij
|
|
.idea/**/azureSettings.xml
|
|
|
|
### PyCharm+all ###
|
|
# Covers JetBrains IDEs: IntelliJ, RubyMine, PhpStorm, AppCode, PyCharm, CLion, Android Studio, WebStorm and Rider
|
|
# Reference: https://intellij-support.jetbrains.com/hc/en-us/articles/206544839
|
|
|
|
# User-specific stuff
|
|
|
|
# AWS User-specific
|
|
|
|
# Generated files
|
|
|
|
# Sensitive or high-churn files
|
|
|
|
# Gradle
|
|
|
|
# Gradle and Maven with auto-import
|
|
# When using Gradle or Maven with auto-import, you should exclude module files,
|
|
# since they will be recreated, and may cause churn. Uncomment if using
|
|
# auto-import.
|
|
# .idea/artifacts
|
|
# .idea/compiler.xml
|
|
# .idea/jarRepositories.xml
|
|
# .idea/modules.xml
|
|
# .idea/*.iml
|
|
# .idea/modules
|
|
# *.iml
|
|
# *.ipr
|
|
|
|
# CMake
|
|
|
|
# Mongo Explorer plugin
|
|
|
|
# File-based project format
|
|
|
|
# IntelliJ
|
|
|
|
# mpeltonen/sbt-idea plugin
|
|
|
|
# JIRA plugin
|
|
|
|
# Cursive Clojure plugin
|
|
|
|
# SonarLint plugin
|
|
|
|
# Crashlytics plugin (for Android Studio and IntelliJ)
|
|
|
|
# Editor-based Rest Client
|
|
|
|
# Android studio 3.1+ serialized cache file
|
|
|
|
### PyCharm+all Patch ###
|
|
# Ignore everything but code style settings and run configurations
|
|
# that are supposed to be shared within teams.
|
|
|
|
.idea/*
|
|
|
|
!.idea/codeStyles
|
|
!.idea/runConfigurations
|
|
|
|
### PyCharm+iml ###
|
|
# Covers JetBrains IDEs: IntelliJ, RubyMine, PhpStorm, AppCode, PyCharm, CLion, Android Studio, WebStorm and Rider
|
|
# Reference: https://intellij-support.jetbrains.com/hc/en-us/articles/206544839
|
|
|
|
# User-specific stuff
|
|
|
|
# AWS User-specific
|
|
|
|
# Generated files
|
|
|
|
# Sensitive or high-churn files
|
|
|
|
# Gradle
|
|
|
|
# Gradle and Maven with auto-import
|
|
# When using Gradle or Maven with auto-import, you should exclude module files,
|
|
# since they will be recreated, and may cause churn. Uncomment if using
|
|
# auto-import.
|
|
# .idea/artifacts
|
|
# .idea/compiler.xml
|
|
# .idea/jarRepositories.xml
|
|
# .idea/modules.xml
|
|
# .idea/*.iml
|
|
# .idea/modules
|
|
# *.iml
|
|
# *.ipr
|
|
|
|
# CMake
|
|
|
|
# Mongo Explorer plugin
|
|
|
|
# File-based project format
|
|
|
|
# IntelliJ
|
|
|
|
# mpeltonen/sbt-idea plugin
|
|
|
|
# JIRA plugin
|
|
|
|
# Cursive Clojure plugin
|
|
|
|
# SonarLint plugin
|
|
|
|
# Crashlytics plugin (for Android Studio and IntelliJ)
|
|
|
|
# Editor-based Rest Client
|
|
|
|
# Android studio 3.1+ serialized cache file
|
|
|
|
### PyCharm+iml Patch ###
|
|
# Reason: https://github.com/joeblau/gitignore.io/issues/186#issuecomment-249601023
|
|
|
|
*.iml
|
|
modules.xml
|
|
.idea/misc.xml
|
|
*.ipr
|
|
|
|
### Python ###
|
|
# Byte-compiled / optimized / DLL files
|
|
|
|
# C extensions
|
|
|
|
# Distribution / packaging
|
|
|
|
# PyInstaller
|
|
# Usually these files are written by a python script from a template
|
|
# before PyInstaller builds the exe, so as to inject date/other infos into it.
|
|
|
|
# Installer logs
|
|
|
|
# Unit test / coverage reports
|
|
|
|
# Translations
|
|
|
|
# Django stuff:
|
|
|
|
# Flask stuff:
|
|
|
|
# Scrapy stuff:
|
|
|
|
# Sphinx documentation
|
|
|
|
# PyBuilder
|
|
|
|
# Jupyter Notebook
|
|
|
|
# IPython
|
|
|
|
# pyenv
|
|
# For a library or package, you might want to ignore these files since the code is
|
|
# intended to run in multiple environments; otherwise, check them in:
|
|
# .python-version
|
|
|
|
# pipenv
|
|
# According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
|
|
# However, in case of collaboration, if having platform-specific dependencies or dependencies
|
|
# having no cross-platform support, pipenv may install dependencies that don't work, or not
|
|
# install all needed dependencies.
|
|
|
|
# poetry
|
|
# Similar to Pipfile.lock, it is generally recommended to include poetry.lock in version control.
|
|
# This is especially recommended for binary packages to ensure reproducibility, and is more
|
|
# commonly ignored for libraries.
|
|
# https://python-poetry.org/docs/basic-usage/#commit-your-poetrylock-file-to-version-control
|
|
|
|
# pdm
|
|
# Similar to Pipfile.lock, it is generally recommended to include pdm.lock in version control.
|
|
# pdm stores project-wide configurations in .pdm.toml, but it is recommended to not include it
|
|
# in version control.
|
|
# https://pdm.fming.dev/#use-with-ide
|
|
|
|
# PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm
|
|
|
|
# Celery stuff
|
|
|
|
# SageMath parsed files
|
|
|
|
# Environments
|
|
|
|
# Spyder project settings
|
|
|
|
# Rope project settings
|
|
|
|
# mkdocs documentation
|
|
|
|
# mypy
|
|
|
|
# Pyre type checker
|
|
|
|
# pytype static type analyzer
|
|
|
|
# Cython debug symbols
|
|
|
|
# PyCharm
|
|
# JetBrains specific template is maintained in a separate JetBrains.gitignore that can
|
|
# be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
|
|
# and can be added to the global gitignore or merged into this file. For a more nuclear
|
|
# option (not recommended) you can uncomment the following to ignore the entire idea folder.
|
|
|
|
### Python Patch ###
|
|
# Poetry local configuration file - https://python-poetry.org/docs/configuration/#local-configuration
|
|
poetry.toml
|
|
|
|
# ruff
|
|
.ruff_cache/
|
|
|
|
# LSP config files
|
|
pyrightconfig.json
|
|
|
|
### react ###
|
|
.DS_*
|
|
logs
|
|
**/*.backup.*
|
|
**/*.back.*
|
|
|
|
node_modules
|
|
bower_components
|
|
|
|
*.sublime*
|
|
|
|
psd
|
|
thumb
|
|
sketch
|
|
|
|
### VisualStudioCode ###
|
|
.vscode/
|
|
**/.vscode/*
|
|
!.vscode/settings.json
|
|
!.vscode/tasks.json
|
|
# !.vscode/launch.json
|
|
!.vscode/extensions.json
|
|
!.vscode/*.code-snippets
|
|
|
|
# Local History for Visual Studio Code
|
|
.history/
|
|
|
|
# Built Visual Studio Code Extensions
|
|
*.vsix
|
|
|
|
### VisualStudioCode Patch ###
|
|
# Ignore all local history of files
|
|
.history
|
|
.ionide
|
|
|
|
## Windsurf ###
|
|
.windsurfrules
|
|
|
|
### Windows ###
|
|
# Windows thumbnail cache files
|
|
Thumbs.db
|
|
Thumbs.db:encryptable
|
|
ehthumbs.db
|
|
ehthumbs_vista.db
|
|
|
|
# Dump file
|
|
*.stackdump
|
|
|
|
# Folder config file
|
|
[Dd]esktop.ini
|
|
|
|
# Recycle Bin used on file shares
|
|
$RECYCLE.BIN/
|
|
|
|
# Windows Installer files
|
|
*.cab
|
|
*.msi
|
|
*.msix
|
|
*.msm
|
|
*.msp
|
|
|
|
# Windows shortcuts
|
|
*.lnk
|
|
|
|
# Windsurf
|
|
.qodo
|
|
|
|
### Unstract ###
|
|
|
|
# Authentication Plugins
|
|
backend/plugins/authentication/*
|
|
!backend/plugins/authentication/auth_sample
|
|
|
|
# Processor Plugins
|
|
backend/plugins/processor/*
|
|
|
|
# Subscription Plugins
|
|
backend/plugins/subscription/*
|
|
|
|
|
|
# API Deployment Plugins
|
|
backend/plugins/api/**
|
|
|
|
# Notification Plugin
|
|
backend/plugins/notification/**
|
|
|
|
# Configuration Plugin
|
|
backend/plugins/configuration/**
|
|
|
|
# Verticals Usage Plugin
|
|
backend/plugins/verticals_usage/**
|
|
|
|
# BE pluggable-apps
|
|
backend/pluggable_apps/*
|
|
|
|
# FE Plugins
|
|
frontend/src/plugins/*
|
|
frontend/public/llm-whisperer/
|
|
|
|
|
|
# TODO: Ensure its made generic to abstract subfolder and file names
|
|
# Static content
|
|
backend/onboarding_static/*
|
|
# BE auth0 migration tenant scripot
|
|
backend/scripts/*
|
|
|
|
# Tool registry
|
|
unstract/tool-registry/tool_registry_config/*.json
|
|
unstract/tool-registry/tests/*.yaml
|
|
!unstract/tool-registry/tool_registry_config/public_tools.json
|
|
unstract/tool-registry/tool_registry_config/registry.yaml
|
|
|
|
# Docker related
|
|
# End of https://www.toptal.com/developers/gitignore/api/windows,macos,linux,pycharm,pycharm+all,pycharm+iml,python,visualstudiocode,react,django
|
|
docker/temp/*
|
|
docker/*.env
|
|
!docker/sample*.env
|
|
docker/public_tools.json
|
|
docker/proxy_overrides.yaml
|
|
docker/compose.override.yaml
|
|
docker/workflow_data/
|
|
|
|
# Tool development
|
|
tools/*/unstract-sdk/
|
|
tools/*/data_dir/
|
|
|
|
# Backend settings ignore (allows user overrides)
|
|
backend/backend/settings/*
|
|
!backend/backend/settings/__init__.py
|
|
!backend/backend/settings/base.py
|
|
!backend/backend/settings/dev.py
|
|
!backend/backend/settings/test.py
|
|
|
|
# Local Dependencies for docker testing
|
|
unstract/unstract-sdk/
|
|
|
|
# Backend requirements.txt
|
|
backend/requirements.txt
|
|
|
|
# Backend URLs
|
|
backend/backend/*_urls.py
|
|
!backend/backend/base_urls.py
|
|
!backend/backend/public_urls.py
|
|
!backend/backend/internal_base_urls.py
|
|
# TODO: Remove after v2 migration is completed
|
|
backend/backend/*_urls_v2.py
|
|
!backend/backend/public_urls_v2.py
|
|
|
|
## Vibe coding / Prompting-related files ##
|
|
prompting/
|
|
.prompting/
|
|
|
|
# Claude
|
|
CLAUDE.md
|
|
.claude/*
|
|
CONTRIBUTION_GUIDE.md
|
|
.mcp.json
|
|
|
|
# Windsurf
|
|
.qodo
|
|
.windsurfrules
|
|
.windsurf/rules
|