me/dagster-deployment
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
No description
86 commits 1 branch 0 tags 1.6 MiB
  • Python 96.2%
  • Nix 3.8%
Find a file
Exact
Christian Lengert 5c85b38ae8 stats: exclude hive partition columns from parquet stats 
read_parquet without hive_partitioning=false caused synthetic key=value
directory columns (h3_3, res, year) to appear in _stats.json schema.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-08-24 18:29:37 +02:00
deployment stats: exclude hive partition columns from parquet stats 2026-08-24 18:29:37 +02:00
deployment_tests test: add 24 tests for geoparquet_utils; fix deprecated DuckDB API calls 2026-08-14 21:13:43 +02:00
docs docs: add DELETION_LIST.md for post-migration lake cleanup 2026-08-13 09:00:01 +02:00
nix Add OSM nature and POI silver assets (osmium pipeline) 2026-08-18 07:39:28 +02:00
plans fix: use EPSG_4326 tag format (Dagster rejects colons in tag values) 2026-08-13 08:17:01 +02:00
scripts scripts: add jrc-edo-cdi to backfill stats list 2026-08-22 08:42:30 +02:00
.gitignore init with flake 2026-08-12 18:01:30 +02:00
.pre-commit-config.yaml Set up distributed Dagster deployment scaffold 2026-08-12 19:22:38 +02:00
CLAUDE.md docs(CLAUDE.md): require Hilbert curve sorting on all GeoParquet files 2026-08-14 20:25:26 +02:00
CLEANUP.md fix(stats): add write_parquet_stats to all silver assets and one-off script 2026-08-22 08:00:40 +02:00
dagster.yaml ops: move jrc assets to fury, reduce run_monitoring poll to 30s 2026-08-13 16:10:09 +02:00
flake.lock Set up distributed Dagster deployment scaffold 2026-08-12 19:22:38 +02:00
flake.nix Add OSM nature and POI silver assets (osmium pipeline) 2026-08-18 07:39:28 +02:00
pyproject.toml add LUISA land use pipeline: raw, bronze (GeoParquet), silver (H3 distances) 2026-08-14 17:35:42 +02:00
uv.lock add LUISA land use pipeline: raw, bronze (GeoParquet), silver (H3 distances) 2026-08-14 17:35:42 +02:00
workspace.yaml Wire up NixOS deployment and fix PostgreSQL password setup 2026-08-12 19:37:25 +02:00