Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
59 commits
Select commit Hold shift + click to select a range
8395eeb
docs add ingest diagram
tgbugs Feb 19, 2025
89f80ad
blue hook added
tmsincomb Feb 4, 2025
372584d
.py blue format
tmsincomb Feb 4, 2025
f378006
sql whitespace rm
tmsincomb Feb 4, 2025
1977266
ingest.py needed 2nd pass
tmsincomb Feb 4, 2025
b01bae3
-X theirs with pre-commit ignore update to ingest.py
tmsincomb Apr 1, 2025
a6c144d
pre-commit try
tmsincomb Apr 28, 2025
dc0776f
accepted all incoming changes for hangnail merge
tmsincomb Apr 28, 2025
81487b7
added fastapi postgresql folder
tmsincomb Apr 28, 2025
542f773
remove ingest from blue ignore and found internal bug on why api was …
tmsincomb Apr 28, 2025
db38a8e
init for test_db
tmsincomb May 12, 2025
0e126e5
attempt at clone top 10 rows, failing
tmsincomb May 12, 2025
f2444fb
test postgres beta pass
tmsincomb Jul 2, 2025
afe15f4
test postgres alpha pass
tmsincomb Jul 7, 2025
8baa87c
f006 tests
tmsincomb Jul 7, 2025
f71e28a
f006 refactor
tmsincomb Jul 8, 2025
c5fc839
patch for root models
tmsincomb Jul 14, 2025
02b12e7
patch for leaf models
tmsincomb Jul 14, 2025
e956512
full tests passing
tmsincomb Jul 14, 2025
bb98b01
used local f006 data, ingested to test db and converted to CSVs
tmsincomb Jul 14, 2025
8497beb
fibers ingestion
tmsincomb Jul 18, 2025
c6564e3
tables.sql add site instance type
tgbugs Jul 24, 2025
0a2385d
tables.sql add record-index address type
tgbugs Jul 24, 2025
7828c87
tables.sql object_is_not_dataset distinguish object does not exist
tgbugs Jul 24, 2025
be62ba0
tables.sql values_{cat,quant} add unique constraint
tgbugs Jul 24, 2025
9fcf4db
tables.sql values_quant varchar -> text
tgbugs Jul 24, 2025
4dbd67b
api docs update support matrix for limit and count
tgbugs Jul 25, 2025
779cf2c
api update internal queries to always use capital AS
tgbugs Jul 25, 2025
c04bc75
api first pass at implementing limit and count
tgbugs Jul 25, 2025
d2517dd
api main_query remove left outer joins
tgbugs Jul 25, 2025
e57ab5d
api add desc/* endpoints to default union-cat-quant true
tgbugs Jul 25, 2025
48ec51e
api.org update union-cat-quant default values docs
tgbugs Jul 25, 2025
ff47c1d
ingest major updates for f006
tgbugs Jul 25, 2025
5117575
add inserts.sql to hold values needed for ingestion flows
tgbugs Jul 25, 2025
9e1889f
queries update orgstrap block with helper functions
tgbugs Jul 25, 2025
9be79e6
ingest remove debug breakpoint
tgbugs Jul 27, 2025
e746381
tables.sql check values desc_inst against desc_{cat,quant} domain
tgbugs Jul 27, 2025
199b8f2
inserts.sql placeholder aspects, test.sql volume/cross-section hierarchy
tgbugs Jul 27, 2025
bf4c0f9
test.sql update reva ft anat index domain for consistency
tgbugs Jul 27, 2025
cf4b456
ingest update fasc fib with more fasc values, fix demo ingest
tgbugs Jul 27, 2025
986e548
ingest allow path_from_blob to work when no sparcur paths exist
tgbugs Jul 28, 2025
4df4dbb
ingest extract demo fix souce path
tgbugs Jul 28, 2025
c73a982
ingest demo reorder ops to ensure cache is populated
tgbugs Jul 28, 2025
196d4b0
sync with ingest-f006 upstream branch
tmsincomb Jul 28, 2025
0042d68
rework main_query to improve performance and consistency
tgbugs Jul 30, 2025
518e28f
revamping yaml
tmsincomb Aug 11, 2025
0ece435
Merge branch 'master' into reva-generic
tmsincomb Aug 11, 2025
7f0b605
api add /api/1/db-name endpoint for database sanity checks
tgbugs Sep 8, 2025
939f4a3
ingest first pass at vagus scaffolds and referenced datasets
tgbugs Sep 22, 2025
899fd35
sql inserts first pass at sub/sam/site and vagus scaffold needs
tgbugs Sep 22, 2025
1815fb3
api first pass at implementing include-equivalent
tgbugs Sep 22, 2025
f757ac9
sql move used inserts from test to inserts, dbsetup run inserts
tgbugs Sep 22, 2025
3b82025
api align dataset_objects variable name
tgbugs Sep 23, 2025
793c02d
Cleanup: update gitignore, remove obsolete test files
tmsincomb Dec 17, 2025
0b72d4b
Merge upstream/master to sync with SciCrunch/quantitative-db
tmsincomb Dec 17, 2025
9a84518
newer files some may be pruned
tmsincomb Dec 17, 2025
34b0bb7
f006 pass finished; no sparc
tmsincomb Dec 22, 2025
ac8c0e8
how-to for backprop
tmsincomb Mar 2, 2026
4577c19
how-to for backprop
tmsincomb Mar 2, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
189 changes: 189 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,189 @@
# Byte-compiled / optimized / DLL files
__pycache__/
*.py[cod]
*$py.class

# C extensions
*.so

# Distribution / packaging
.Python
build/
develop-eggs/
dist/
downloads/
eggs/
.eggs/
lib/
lib64/
parts/
sdist/
var/
wheels/
share/python-wheels/
*.egg-info/
.installed.cfg
*.egg
MANIFEST

# PyInstaller
# Usually these files are written by a python script from a template
# before PyInstaller builds the exe, so as to inject date/other infos into it.
*.manifest
*.spec

# Installer logs
pip-log.txt
pip-delete-this-directory.txt

# Unit test / coverage reports
htmlcov/
.tox/
.nox/
.coverage
.coverage.*
.cache
nosetests.xml
coverage.xml
*.cover
*.py,cover
.hypothesis/
.pytest_cache/
cover/

# Translations
*.mo
*.pot

# Django stuff:
*.log
local_settings.py
db.sqlite3
db.sqlite3-journal

# Flask stuff:
instance/
.webassets-cache

# Scrapy stuff:
.scrapy

# Sphinx documentation
docs/_build/

# PyBuilder
.pybuilder/
target/

# Jupyter Notebook
.ipynb_checkpoints

# IPython
profile_default/
ipython_config.py

# pyenv
# For a library or package, you might want to ignore these files since the code is
# intended to run in multiple environments; otherwise, check them in:
# .python-version

# pipenv
# According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
# However, in case of collaboration, if having platform-specific dependencies or dependencies
# having no cross-platform support, pipenv may install dependencies that don't work, or not
# install all needed dependencies.
#Pipfile.lock

# UV
# Similar to Pipfile.lock, it is generally recommended to include uv.lock in version control.
# This is especially recommended for binary packages to ensure reproducibility, and is more
# commonly ignored for libraries.
#uv.lock

# poetry
# Similar to Pipfile.lock, it is generally recommended to include poetry.lock in version control.
# This is especially recommended for binary packages to ensure reproducibility, and is more
# commonly ignored for libraries.
# https://python-poetry.org/docs/basic-usage/#commit-your-poetrylock-file-to-version-control
#poetry.lock

# pdm
# Similar to Pipfile.lock, it is generally recommended to include pdm.lock in version control.
#pdm.lock
# pdm stores project-wide configurations in .pdm.toml, but it is recommended to not include it
# in version control.
# https://pdm.fming.dev/latest/usage/project/#working-with-version-control
.pdm.toml
.pdm-python
.pdm-build/

# PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm
__pypackages__/

# Celery stuff
celerybeat-schedule
celerybeat.pid

# SageMath parsed files
*.sage.py

# Environments
.env
.venv
env/
venv/
ENV/
env.bak/
venv.bak/

# Spyder project settings
.spyderproject
.spyproject

# Rope project settings
.ropeproject

# mkdocs documentation
/site

# mypy
.mypy_cache/
.dmypy.json
dmypy.json

# Pyre type checker
.pyre/

# pytype static type analyzer
.pytype/

# Cython debug symbols
cython_debug/

# PyCharm
# JetBrains specific template is maintained in a separate JetBrains.gitignore that can
# be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
# and can be added to the global gitignore or merged into this file. For a more nuclear
# option (not recommended) you can uncomment the following to ignore the entire idea folder.
#.idea/

# Ruff stuff:
.ruff_cache/

# PyPI configuration file
.pypirc


csv_cache/
ingest_2025*
f006_csv_debug*
f006_*/
production_*/
*.md
!README.md
README.pdf
.DS_STORE
.vscode/
export*/
ingestion/data
my_export/
25 changes: 25 additions & 0 deletions .pre-commit-config.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
repos:
- repo: https://github.com/pre-commit/pre-commit-hooks
rev: v4.4.0
hooks:
- id: check-yaml
args: ["--unsafe"]
- id: end-of-file-fixer
- id: trailing-whitespace
exclude: docs/img/
- repo: https://github.com/PyCQA/isort
rev: 5.12.0
hooks:
- id: isort
name: isort (python)
args: ["-m", "3", "--tc"]
- repo: https://github.com/grantjenks/blue
rev: "v0.9.1"
hooks:
- id: blue
args: ["-l", "120"]
exclude: |
(?x)^(
quantdb/api.py|
sql;/.*
)$
Loading