Add Ocotillo data migration guide#671
Draft
jeremyzilar wants to merge 2 commits intostagingfrom
Draft
Conversation
Documents the full migration process: what we learned from the NM_Aquifer migration, the two types of work (Alembic vs transfer scripts), the three-tool workflow (JIRA + field mapping tracker + oco transfer-results), migration phases, transfer script conventions with a template, the audit CLI, staging/production checklists, and geothermal-specific guidance grounded in the April 2026 Geothermal Discovery Report. Includes inline Mermaid ER diagrams of the Ocotillo core schema and the NM_Wells priority source tables. A FigJam URL placeholder is left in the schema mapping section to be filled once the visual board is generated.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What this adds
A new guide at
docs/data-migration-guide.mdfor the Ocotillo Data Services team covering the full migration process. This was written in the context of the upcoming geothermal migration but is intended as the team's reference for all future migrations.Why now
The April 2026 Geothermal Discovery Report identified several process gaps from the NM_Aquifer migration: a spreadsheet tracker that became stale and untrustworthy, no clear place to track outstanding work, schema decisions that were not recorded, and no standardized way to verify a migration was complete. This guide addresses each of those directly.
What the guide covers
oco transfer-resultsfor row-count verification. Includes the 13-step workflow that connects all three and explains when each source of truth is updatedoco transfer-resultsusage, output column meanings, and the convention of committing the summary to git after every rundb/geothermal.pystubsFigJam note
A FigJam board with both schemas side by side (with source-to-target mapping arrows) is planned as a companion. A placeholder is left in the schema mapping section. The guide's Mermaid diagrams are immediately usable in the meantime.
Also includes
CLAUDE.mdunder Additional Resources