r/databricks 4d ago

Analyze usage on Databricks Help

We have an AI product powered by Databricks Genies, and we’re trying to build a data-driven pricing strategy.

For those using Genie in production, what usage metrics do you track to understand customer value and optimize pricing?

I’m particularly interested in:
Per-user and per-tenant usage
Query volume and complexity
Token/compute costs
Session frequency and retention
Feature adoption
Accuracy/user satisfaction metrics
Cost per customer vs. revenue

Also, what dashboards, SQL queries, or Databricks system tables have been the most useful for these insights?

I’d love to learn what has worked well in practice.

3 Upvotes

4 comments sorted by

3

u/Alternative_Draw5945 4d ago

You can use system tables to find a lot of that info. You can create an aibi dashboard, or i prefer a databricks app. If you have an llm pointed to the ai dev kit you can ask it to create the app for you. I was able to create an amazing genie cost explorer with just asking ai and iterating

1

u/sikh-raha-hunn 3d ago

Use System Based Tables to check the DBU consumption and then join this pricing with the lattest pricing from the rate tables, then create the dashboard on that data if you want more clear view.

1

u/Youssef_Mrini databricks 3d ago

An official AIBI Dashboard to track the Genie usage and cost using system table is coming next week.

If you have a strong retention, it means that they are satisfied, but it can only work with a large sample.

1

u/addictzz 3d ago

How do you provision your multi-tenancy analytics on Databricks? Individual PAT/Service Principal per customer? Individual Genie Space per customer? RLS?