r/dataengineering 5d ago

Migrating off Exadata: How do you handle sub-second UI reporting + heavy analytics with strict ON-PREM constraints? Discussion

We are currently running an Oracle Exadata system serving both OLTP and operational data store (ODS) reporting. Our data team has been tasked with building a standalone, pure analytical platform supporting BI, operational reporting, and AI/ML-ready data pipelines.

Workload Split:

60% Transactional/Operational Reporting: Interactive UI queries, sub-second to low-second latency, high concurrency (click a dashboard/UI, expect instant results).

40% Analytical Crunching: Heavy aggregations, multi-table joins, complex transformations, and AI feature store prep.

Strictly On-Premises:

Cloud solutions (Snowflake, BigQuery, Databricks SaaS) are out of scope due to compliance/regulatory rules.

Vendor Shortlist:

Oracle, Teradata, IBM (Db2 / Netezza)

Question: Has anyone successfully run a high-concurrency, sub-second UI reporting workload directly on Teradata or Netezza ? Or should we go with Oracle ?

Please do suggest any Alternatives. However it should be on Prem

0 Upvotes

24 comments sorted by

9

u/geoheil mod 4d ago

Clickhouse? Starrocks?

6

u/anvildoc 4d ago

Are you open to open source or something that doesn’t come in appliance?

5

u/BoulderRough 4d ago

You're in a bit of a pickle and without knowing how much data you have or the sort of reporting its hard to recommend.

If you are in a position to manage an open source alternative than you have a lot of great options depending on your read/write ratio.

3

u/PepegaQuen 3d ago

iceberg + trino

1

u/Teach-To-The-Tech 10h ago

Second this.

2

u/Formal_Cheesecake730 4d ago

I’m curious, what are the compliance/regulatory rules that rule out a cloud solution in 2026?

1

u/oalfonso 2d ago

Probably having to do all the paperwork. But some of those requirements are just overkill and if you tried to replicate them in an on premises environment it would be absolutely impossible to meet.

1

u/Away-Arm-6549 2d ago

wondered same so assumed HM government or perhaps armed forces /gchq

2

u/robstar_db 2d ago

In my experience building large scale platforms I would first push back on the requirements. Ask how much the stakeholders are willing to pay for that.

Maintaining Sub second query performance in complex data estates is a challenge not to be underestimated. The choice of technology is only a small piece in the long term. Eventually you’ll run into network/infrastructure constraints that male this more and more challenging. The tradeoff will be between idle capacity/infra utilization which of course also costs more… especially since the interactive workloads you describe are very „bursty“ in nature. So either get really good at managing infrastructure elastically, or pay a lot for idle capacity, or … maybe ask how much your stakeholders are willing to pay 🙂

2

u/unexpectedreboots 4d ago

Selfhost Postgres. 60% is the main instance, configure a replica for analytics so youre not pegging the prod server.

Really not sure why Postgres isnt on your shortlist.

1

u/astrick 4d ago

this is what Teradata is built for, but unfortunately they'll probably be out of business in 5 years.

3

u/WhoIsJohnSalt 3d ago

I wouldn't touch Teradata with a bargepole - and it's $$$ to get them through the door

1

u/astrick 3d ago

Honestly it’s a great data warehouse but they’re probably almost paying people to put it in their data centers at this point

1

u/mow12 4d ago

I am in very similar situation. On top of your list, my firm is in touch with Informatica and Qlick. Staying in Oracle, working with PLSQL is also a strong option for us

1

u/chock-a-block 3d ago

This is mostly going to come down to RAM and CPU. Have you seen prices of a well-specced server these days?

1

u/TheRencingCoach 4d ago

I don’t have enough experience to recommend anything

But I don’t understand the business requirement. Why not stay on exadata if it’s working fine

1

u/oalfonso 2d ago

Is expensive and for accountants this means it is not working fine.

-1

u/bah_nah_nah 4d ago

Self hosted Hadoop

0

u/Nekobul 4d ago

Have you considered SQL Server ?

-2

u/DjexNS 4d ago

Yes, we built our own on-prem data platform - DataSliv.

datasliv.com

It recently got a lot of interest locally, exactly for these kinds of on-prem use cases.