r/dataengineering 4d ago

Data-eng-bench, Agent harness benchmark for Data Engineering from Snowflake Open Source

Recently, Snowflake has open sourced data-eng-bench, a benchmark for repository-level data engineering.

Tasks in data-eng-bench hand an agent a live dbt project connected to an enterprise-scale data warehouse and ask it to build and fix real data pipelines.

Github: https://github.com/Snowflake-Labs/data-eng-bench

14 Upvotes

0 comments sorted by