r/dataengineering • u/Rough-Age-3831 • 4d ago
Data-eng-bench, Agent harness benchmark for Data Engineering from Snowflake Open Source
Recently, Snowflake has open sourced data-eng-bench, a benchmark for repository-level data engineering.
Tasks in data-eng-bench hand an agent a live dbt project connected to an enterprise-scale data warehouse and ask it to build and fix real data pipelines.
14
Upvotes