Unstructured cookbook

[SIDDHAARTHAA]

Pull Request Checklist

Please ensure that your PR meets the following requirements:

• I have read the CONTRIBUTING guide.
• I have updated the documentation (if applicable).
• My code follows the style guidelines of this project.
• I have performed a self-review of my own code.
• I have added tests that prove my fix is effective or that my feature works.
• New and existing unit tests pass locally with my changes.

Description

Adds a focused Unstructured + Moss cookbook for parsing raw files, chunking extracted content, preserving metadata, and incrementally upserting chunks into a Moss index for semantic search.

The cookbook includes a runnable ingestion script, sample documents, environment template, setup/usage documentation, and a lightweight smoke test for the ingestion pipeline.

Validation performed:

• python -m py_compile examples/cookbook/unstructured/ingest.py
• cd examples/cookbook/unstructured && python -m unittest test_integration.py

Fixes #203

Type of Change

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• This change requires a documentation update

---

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[yatharthk2]

Hi @SIDDHAARTHAA , thank you very much for working on this pr. Were you able to resolve all the comments from ai ? also can you please record a short 1 min video demonstrating the demo of implementation.

[SIDDHAARTHAA]

Hey @yatharthk2, thanks for checking out. I’m working on it.

[CoderOMaster]

@SIDDHAARTHAA can you share a short 1 min video demo as well?

[SIDDHAARTHAA]

Attached a short demo video covering the Unstructured cookbook flow, the new smoke tests, and the local validation run passing.
@yatharthk2

Screencast.From.2026-05-14.12-25-56.mp4

[CoderOMaster]

@SIDDHAARTHAA I dont see the ingestion pipeline in the demo and only pytests passing

[Copilot]

Pull request overview

Adds a new “Unstructured + Moss” cookbook that demonstrates parsing raw files with Unstructured, chunking extracted content, preserving metadata, and incrementally upserting stable chunk IDs into a Moss index (with an optional post-ingestion query).

Changes:

• Added a runnable ingestion script (ingest.py) that partitions files, chunks content, attaches normalized metadata, and upserts batches into Moss.
• Added cookbook documentation + environment template + sample documents for a quick start.
• Added a lightweight unittest-based smoke/integration test that stubs external dependencies to validate chunk IDs/metadata and batch upsert behavior.

Reviewed changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
examples/cookbook/unstructured/ingest.py	Implements the end-to-end ingestion + upsert + query flow for Unstructured → Moss.
examples/cookbook/unstructured/README.md	Documents setup, usage, and stored document shape/ID strategy.
examples/cookbook/unstructured/pyproject.toml	Declares cookbook dependencies and build packaging metadata.
examples/cookbook/unstructured/.env.example	Provides required Moss environment variable template.
examples/cookbook/unstructured/test_integration.py	Adds smoke tests for metadata normalization/stable IDs and upsert batching behavior.
examples/cookbook/unstructured/sample_docs/onboarding.html	Sample HTML input document for ingestion.
examples/cookbook/unstructured/sample_docs/release-notes.txt	Sample text input document for ingestion.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.