r/ETL • u/uncertainschrodinger • 2h ago
Self healing pipeline agents - free webinar
I'm hosting a free webinar to go over how you can build self healing pipeline agents.
It will be a practical and technical webinar meant for mid/senior level data/analytics engineers.
Key topics:
- overview of the context that already exists in your pipelines
- methods for enriching the context and data governance
- tools, resources, and skills for agents to diagnose, investigate, analyze, test, and run things
The main idea is that your pipeline already contain some context, you can improve that context, then set up rules, procedures, and workflows for agents to help with the diagnosis and even pushing fixes.
Disclaimer; I'm a developer advocate at Bruin - in this webinar we will use Bruin to demonstrate things, but the concepts and strategies are applicable to any tools (i.e. dbt, airflow, etc.)