Skip to content

Data Layer proposal.#49

Open
Mohammad-nassar10 wants to merge 7 commits into
llm-d:mainfrom
Mohammad-nassar10:data-layer-proposal
Open

Data Layer proposal.#49
Mohammad-nassar10 wants to merge 7 commits into
llm-d:mainfrom
Mohammad-nassar10:data-layer-proposal

Conversation

@Mohammad-nassar10
Copy link
Copy Markdown
Contributor

@Mohammad-nassar10 Mohammad-nassar10 commented May 7, 2026

What does this PR do?

Adds a design proposal for the IPP Data Layer (docs/proposals/data-layer-proposal/README.md).
Defines a background tracking pipeline that runs outside the critical request path to collect and calculate different attributes and metrics.

Why is this change needed?

The data layer provides the foundation for tracking per-model metrics without adding latency to the request hot path.

How was this tested?

  • Unit tests added/updated
  • Integration/e2e tests added/updated
  • Manual testing performed

Checklist

  • Commits are signed off (git commit -s) per DCO
  • Code follows project contributing guidelines
  • Tests pass locally (make test)
  • Linters pass (make lint)
  • Documentation updated (if applicable)

Related Issues

Related to issue #50

Signed-off-by: Mohammad <mohammad.nassar@ibm.com>
@github-actions github-actions Bot added the size/L Denotes a PR that changes 100-499 lines, ignoring generated files. label May 7, 2026
Comment thread docs/proposals/data-layer-proposal/README.md Outdated
Comment thread docs/proposals/data-layer-proposal/README.md
Comment thread docs/proposals/data-layer-proposal/README.md
Comment thread docs/proposals/data-layer-proposal/README.md
Mohammad-nassar10 and others added 2 commits May 13, 2026 14:17
Signed-off-by: Mohammad <mohammad.nassar@ibm.com>
Copy link
Copy Markdown
Collaborator

@nirrozenbaum nirrozenbaum left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you please update this PR to reflect the final updates to how we work with datastore?

Signed-off-by: Mohammad <mohammad.nassar@ibm.com>
@Mohammad-nassar10
Copy link
Copy Markdown
Contributor Author

can you please update this PR to reflect the final updates to how we work with datastore?

Sure, done.

Signed-off-by: Mohammad <mohammad.nassar@ibm.com>
Signed-off-by: Mohammad <mohammad.nassar@ibm.com>
Signed-off-by: Mohammad <mohammad.nassar@ibm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size/L Denotes a PR that changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants