DataOps & CI/CD for the Modern Data Stack
Every dbt PR run on a legacy warehouse costs real credits. Every environment clone takes hours. HatiData gives you git-driven environments with per-second billing — built for the speed of modern data engineering.
THE PROBLEM
What You're Dealing With
Environment Cloning Takes Hours
Need a staging environment? Clone your production warehouse. Wait 2-4 hours. Pay for the storage. Repeat for every feature branch.
CI Runs Burn Credits
Every dbt PR run spins a full warehouse cluster. At 50+ PRs/week, your CI pipeline costs more than production workloads.
60-Second Tax on dbt Models
Each dbt model execution is billed at a 60-second minimum. A 3-second model? Billed for 60. Multiply by hundreds of models per run.
THE HATIDATA FIX
How HatiData Solves It
Instant Environment Cloning
Iceberg metadata makes environment cloning near-instant. No data copying. A feature branch environment is ready in seconds, not hours.
Per-Second CI Billing
dbt runs are billed per-second. A 3-second model costs 3 seconds. No 60-second minimum. Your CI budget drops 90%.
dbt-Native Workflows
pip install dbt-hatidata. Update profiles.yml. Run dbt build. Same models, same tests, same macros. Zero refactoring.
Side-by-Side Comparison
| Feature | Legacy Warehouse | HatiData |
|---|---|---|
| Environment Clone | 2-4 hours (full copy) | Seconds (Iceberg metadata) |
| CI Cost per PR | $5-20 (60s billing) | $0.10-0.50 (per-second) |
| dbt Compatibility | Native | Native adapter |
| Min Billing per Model | 60 seconds | Per-second (actual) |
| Environments | Manual provisioning | Git-driven, instant |
| Storage Format | Proprietary | Open (Apache Iceberg) |
CODE EXAMPLES
Drop-In Integration
name: dbt CI
on: [pull_request]
jobs:
dbt-test:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- name: Install dbt
run: pip install dbt-hatidata
- name: Run dbt
env:
HATIDATA_HOST: hatidata.internal
HATIDATA_PORT: 5439
run: |
dbt deps
dbt build --target ci
dbt testlower CI costs
environment clone time
code changes required
Stop Paying the 60-Second Tax.
Run the free audit script. See what you're really spending. Switch in 14 days.
EXPLORE MORE