Materialize + dbt Transform streaming data with SQL
Materialize and dbt work together to power the transformation process (the T in ELT) for your streaming data.
The dbt you know and love is not only fully compatible with Materialize, but is also supercharged with new functionality that is enabled by streaming — like incremental updates and continuous testing.
With our dbt adapter, teams can bring the best benefits of dbt to Materialize, and enhanced capabilities as well, such as:
- Out-of-the-box incremental updates - Materialize can keep your data up-to-date without the need to maintain complex incremental model logic in dbt. Run dbt once, and all your models are incrementally updated as new data arrives.
- Standard workflows - Build versioned, testable, and documented pipelines with the same tools that keep users productive in batch. The dbt Materialize adapter makes streaming accessible to all, from data engineers to analytics engineers and analysts.
- Best practices from software engineering - Apply best practices from Software Engineering to your day-to-day data work with Materialize, like version control, testing, linting, and CI/CD.
- SQL templating - Keep your codebase DRY by templating repetitive code with CTEs, macros, packages, and custom operations.
Try the Materialize dbt adapter now to unlock the full potential of your streaming data.
Get a Demo
Materialize dbt adapter
The Materialize dbt adapter brings you the best functionality of dbt, along with new functionality that is enabled by streaming. Read the list below to find what’s the same, and what’s different, when using dbt with Materialize.
What’s the same?
Model definition -> Users define data transformations using SQL.
dbt commands -> Support for most common dbt commands: dbt run, dbt test, dbt docs, and more.
dbt documentation -> Users document their streaming pipelines and can generate a lineage graph, as usual.
What’s Different?
Materialization types -> Custom materialization types (docs).
How some dbt commands work:
- dbt run once, and your models will be kept up to date incrementally, with strong consistency.
- dbt test also for continuous testing.