Skip to content

fix: added number_of_replicas as 0 to not create unused nodes in OpenSearch#1304

Merged
lucaseduoli merged 8 commits intomainfrom
fix/opensearch_yellow
Apr 1, 2026
Merged

fix: added number_of_replicas as 0 to not create unused nodes in OpenSearch#1304
lucaseduoli merged 8 commits intomainfrom
fix/opensearch_yellow

Conversation

@lucaseduoli
Copy link
Copy Markdown
Collaborator

This pull request focuses on optimizing OpenSearch index configurations by reducing the number of replicas to zero, which can improve indexing speed and reduce resource usage in development or single-node environments. The changes affect both the knowledge filters index and dynamically created embedding indices.

OpenSearch index configuration improvements:

  • Set "number_of_replicas": 0 in the knowledge filters index settings in src/main.py to ensure no replicas are created for this index.
  • Set "number_of_replicas": 0 (and remove the previous default of 1) for dynamically created embedding indices in src/utils/embeddings.py, further optimizing resource usage.

@lucaseduoli lucaseduoli requested a review from mpawlow March 30, 2026 18:54
@lucaseduoli lucaseduoli self-assigned this Mar 30, 2026
@github-actions github-actions bot added backend 🔷 Issues related to backend services (OpenSearch, Langflow, APIs) bug 🔴 Something isn't working. and removed bug 🔴 Something isn't working. labels Mar 30, 2026
@mpawlow
Copy link
Copy Markdown
Collaborator

mpawlow commented Mar 30, 2026

Functional Test

mpawlow@OpenRAG1:~/git/openrag$ make health
Health check:
Frontend:   Healthy
Backend:    Healthy
Langflow:   Healthy
OpenSearch: green
Docling:    Healthy
image
{
   "cluster_name":"docker-cluster",
   "status":"green",
   "timed_out":false,
   "number_of_nodes":1,
   "number_of_data_nodes":1,
   "discovered_master":true,
   "discovered_cluster_manager":true,
   "active_primary_shards":8,
   "active_shards":8,
   "relocating_shards":0,
   "initializing_shards":0,
   "unassigned_shards":0,
   "delayed_unassigned_shards":0,
   "number_of_pending_tasks":0,
   "number_of_in_flight_fetch":0,
   "task_max_waiting_in_queue_millis":0,
   "active_shards_percent_as_number":100.0
}
  • ✅ Successfully sanity ingestion of documents from folder

Copy link
Copy Markdown
Collaborator

@mpawlow mpawlow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@lucaseduoli

Code Review 1

  • See PR comments: (a) to (d)

@github-actions github-actions bot added bug 🔴 Something isn't working. and removed bug 🔴 Something isn't working. labels Mar 30, 2026
Copy link
Copy Markdown
Collaborator

@mpawlow mpawlow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review 2

  • ✅ LGTM / Approved
  • See: PR comment (2a)

@github-actions github-actions bot added the lgtm label Mar 30, 2026
@mpawlow
Copy link
Copy Markdown
Collaborator

mpawlow commented Mar 30, 2026

Functional Test 2

  • ✅ Successfully sanity ingestion of documents from folder

@github-actions github-actions bot added bug 🔴 Something isn't working. and removed bug 🔴 Something isn't working. labels Mar 30, 2026
@mpawlow mpawlow force-pushed the fix/opensearch_yellow branch from c2707cc to 8cabf9f Compare March 30, 2026 22:00
@github-actions github-actions bot added bug 🔴 Something isn't working. and removed bug 🔴 Something isn't working. labels Mar 30, 2026
@github-actions github-actions bot added bug 🔴 Something isn't working. tests and removed bug 🔴 Something isn't working. labels Mar 31, 2026
@lucaseduoli lucaseduoli force-pushed the fix/opensearch_yellow branch from 0f9d252 to 46f7822 Compare March 31, 2026 21:17
@github-actions github-actions bot added bug 🔴 Something isn't working. and removed bug 🔴 Something isn't working. labels Mar 31, 2026
@github-actions github-actions bot added bug 🔴 Something isn't working. and removed bug 🔴 Something isn't working. labels Apr 1, 2026
@lucaseduoli lucaseduoli merged commit 3114c1e into main Apr 1, 2026
9 checks passed
@github-actions github-actions bot deleted the fix/opensearch_yellow branch April 1, 2026 17:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend 🔷 Issues related to backend services (OpenSearch, Langflow, APIs) bug 🔴 Something isn't working. lgtm tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants