Materialize + dbt Transform streaming data with SQL
Materialize and dbt work together to power the transformation process (the T in ELT) for your streaming data.
The dbt you know and love is not only fully compatible with Materialize, but is also supercharged with new functionality that is enabled by streaming — like incremental updates and continuous testing.
With our dbt adapter, teams can bring the best benefits of dbt to Materialize, and enhanced capabilities as well, such as:
- Out-of-the-box incremental updates - Materialize can keep your data up-to-date without the need to maintain complex incremental model logic in dbt. Run dbt once, and all your models are incrementally updated as new data arrives.
- Standard workflows - Build versioned, testable, and documented pipelines with the same tools that keep users productive in batch. The dbt Materialize adapter makes streaming accessible to all, from data engineers to analytics engineers and analysts.
- Best practices from software engineering - Apply best practices from Software Engineering to your day-to-day data work with Materialize, like version control, testing, linting, and CI/CD.
- SQL templating - Keep your codebase DRY by templating repetitive code with CTEs, macros, packages, and custom operations.
Try the Materialize dbt adapter now to unlock the full potential of your streaming data.
{Schedule time to meet}
Materialize dbt adapter
The Materialize dbt adapter brings you the best functionality of dbt, along with new functionality that is enabled by streaming. Read the list below to find what’s the same, and what’s different, when using dbt with Materialize.
What’s the same?
Model definition -> Users define data transformations using SQL.
dbt commands -> Support for most common dbt commands: dbt run, dbt test, dbt docs, and more.
dbt documentation -> Users document their streaming pipelines and can generate a lineage graph, as usual.
What’s Different?
Materialization types -> Custom materialization types (docs).
How some dbt commands work:
- dbt run once, and your models will be kept up to date incrementally, with strong consistency.
- dbt test also for continuous testing.
Materialize is excited to return to dbt Labs Coalesce! Come learn more about what is possible with dbt and an Operational Data Store!
👋 Stop by Booth #309 to say hello and get some amazing swag
👨🏼🏫 Join our session Powering Real-time Loan Underwriting at Vontive with Materialize on Oct. 8 @ 11:00 AM
🎉 Join us for the Coalesce After Party at FUHU on October 8
Check out our upcoming talk at Coalesce to see how Materialize and dbt allowed Vontive to power real-time loan underwriting!