Docker compose improvements and cleanup (#54)

* replaced pgvector with official postgres docker image
* uncommented previously commented proxy_overrides.yaml  for testing
* removed old requirements.txt

---------

Co-authored-by: Hari John Kuriakose <hari@zipstack.com>

README.md

@@ -118,9 +118,6 @@ POSTGRES_DB: unstract_db
 
 If you require a different config, make sure the necessary envs from [backend/sample.env](/backend/sample.env) are exported.
 
-- Execute the script [backend/init.sql](/backend/init.sql) that adds roles and creates a DB and extension for ZS Document Indexer tool to work.
-Make sure that [pgvector](https://github.com/pgvector/pgvector#installation) is installed.
-
 ### Pre-commit hooks
 
 - We use pre-commit to run some hooks whenever code is pushed to perform linting and static code analysis among other checks.

backend/init.sql

@@ -3,5 +3,4 @@ ALTER ROLE unstract_dev SET default_transaction_isolation TO 'read committed';
 ALTER ROLE unstract_dev SET timezone TO 'UTC';
 ALTER USER unstract_dev CREATEDB;
 GRANT ALL PRIVILEGES ON DATABASE unstract_db TO unstract_dev;
-CREATE DATABASE unstract;
-CREATE EXTENSION vector;
+CREATE DATABASE unstract;

docker/docker-compose-dev-essentials.yaml

@@ -2,9 +2,10 @@ version: '3.7'
 
 services:
   db:
-    # Supports pgvector for doc indexer
-    image: 'ankane/pgvector:v0.5.1'
+    image: 'postgres:15.6'
     container_name: unstract-db
+    # set shared memory limit when using docker-compose
+    shm_size: 128mb
     ports:
       - "5432:5432"
     volumes:
@@ -14,6 +15,7 @@ services:
       - ./essentials.env
     labels:
       - traefik.enable=false
+    restart: always 
 
   redis:
     image: 'bitnami/redis:7.0.14'
@@ -103,7 +105,7 @@ services:
       - traefik.enable=false
 
   qdrant:
-    # Supports pgvector for doc indexer
+    # Vector DB for doc indexer
     image: 'qdrant/qdrant'
     container_name: unstract-vector-db
     ports:

worker/requirements.txt

@@ -1,5 +0,0 @@
-docker==6.1.3
-flask==3.0.0
-python-dotenv==1.0.0
-redis==5.0.1
-gunicorn==20.1.0