Add DuckDB backend

.github/workflows/ci.yml

@@ -8,6 +8,8 @@ jobs:
     uses: AustralianCancerDataNetwork/cava-devops/.github/workflows/label-gate.yml@main
   build-test-sqlite:
     uses: AustralianCancerDataNetwork/cava-devops/.github/workflows/build-test.yml@main
+  build-test-duckdb:
+    uses: AustralianCancerDataNetwork/cava-devops/.github/workflows/build-test-duckdb.yml@main
   build-test-postgres:
     uses: AustralianCancerDataNetwork/cava-devops/.github/workflows/build-test-postgres-v2.yml@main
     with:

README.md

@@ -13,7 +13,7 @@ The library focuses on:
 * loader and validation infrastructure
 * operational helpers that work across supported backends
 
-At the moment, the built-in backends are SQLite and PostgreSQL.
+The built-in backends are SQLite, PostgreSQL, and DuckDB. See [oa-configurator's supported dialects](https://AustralianCancerDataNetwork.github.io/oa-configurator/config-reference/#supported-dialects) for the dialect list this is built against.
 
 
 ### What this library provides

docs/index.md

@@ -13,7 +13,7 @@ It focuses on:
 - model-agnostic validation scaffolding
 - operational helpers for supported backends
 
-It currently ships with backend implementations for SQLite and PostgreSQL.
+It ships with backend implementations for SQLite, PostgreSQL, and DuckDB. See [oa-configurator's supported dialects](https://AustralianCancerDataNetwork.github.io/oa-configurator/config-reference/#supported-dialects) for the dialect list this is built against.
 
 ---
 

pyproject.toml

@@ -10,7 +10,7 @@ license = { text = "Apache-2.0" }
 requires-python = ">=3.12"
 dependencies = [
     "chardet>=5.2.0",
-    "oa-configurator>=2.0.0,<3",
+    "oa-configurator>=2.1.0,<3",
     "pandas>=2.3.3",
     "pyarrow>=23.0.1",
     "sqlalchemy>=2.0.45",
@@ -49,8 +49,11 @@ packages = ["src/orm_loader"]
 postgres = [
   "psycopg[binary]>=3.2",
 ]
+duckdb = [
+  "duckdb-sqlalchemy>=1.5",
+]
 dev = [
-    "oa-configurator[postgres]>=2.0.0,<3",
+    "oa-configurator[postgres,duckdb]>=2.0.0,<3",
     "pytest>=9.0.3",
     "ty>=0.0.59",
     "ruff>=0.14.11",

src/orm_loader/backends/__init__.py

@@ -1,3 +1,4 @@
+from .duckdb import DuckDBBackend
 from .postgres import PostgresBackend
 from .resolve import resolve_backend
 from .sqlite import SQLiteBackend
@@ -20,6 +21,7 @@
     "ConcurrentRefreshNotEligibleError",
     "DatabaseBackend",
     "Dialect",
+    "DuckDBBackend",
     "MaterializationError",
     "MaterializationFailure",
     "MaterializationOperation",