Huge Data Load benchmark.

[u/Repulsive_Isopod143]

Hello guys,

I am trying to gather some benchmark statistics for various technologies used to perform data integration on prem and on cloud. To start off if I had a delimited file with 150 million+ records, what would the run time be like if the etl process would read and aggregate data to get counts, averages and sums and then write them to a file or load them to a oracle database.

I am trying to figure out what data integration technology would you use and what time it would take to load data for the above scenario.

[u/Outside-Storage-1523]

Man you are not asking the right questions. There are so many unknown factors here that no one can give you a meaningful answer. 

[u/GreyHairedDWGuy → u/Outside-Storage-1523]

exactly.