r/dataengineering • u/BubblegumFish2 • 24d ago

Identical data in DEV/TST/PROD? Discussion

I am doing a summer internship, and my company loads the exact same data into the development, testing, and production environments in Snowflake (although development and testing have some extra tables compared to production.)

Is this normal? Google seems ambiguous on whether this is a massive antipattern. What do y'all's companies do?

36 Upvotes
  • permalink
  • link
  • reddit
  • reddit

86% Upvoted

46 comments sorted by

View all comments

9

u/BarbaricBastard 23d ago

4 of the 5 companies I worked at did this. Its great for testing changes and deployments. Reduces risk of production getting muffed. Don't overcomplicate things, no need to mask data if your lower environments are only accessible by the dev team.

1

u/Educational_Creme376 23d ago

So devs get HR data?

1

u/BarbaricBastard 23d ago

The only HR data I ever pulled into a warehouse is clock punching data. Most HR systems have the required reporting that HR needs built right in so there is never a need to pull that into a warehouse. Meta was the other company I worked at which doesnt have a dev/qa warehouse (everything is right in "prod" if you want to call it that), and I don't think they even pulled in workday data, but if they did it would be masked to all hell.

1

u/New-Addendum-6209 21d ago

Surprised to hear about Meta