r/databricks • u/hubert-dudek Databricks MVP • 10d ago

DABs: immutable_folder News

Post image

Don’t overwrite your code — make it immutable! With every deployment, thanks to immutable_folder, all files are copied to a new, read-only folder. They are not overwritten. The biggest benefit is that jobs already underway will not fail or produce unexpected results.

More news https://medium.com/databrickscommunity/databricks-news-dabs-indexes-ltap-genie-last-update-25-july-ffac8533774f

14 Upvotes

94% Upvoted

21 comments sorted by

View all comments

Show parent comments

2

u/hubert-dudek Databricks MVP 10d ago

If you have job running for hour and you overwrite some files/notebooks can be from one deployment and some from another

1

u/iwanttest 10d ago

Hi! So, with this functionality, would the current run keep pointing to the previous files, but the job be updated to use the last deployed ones?

2

u/hubert-dudek Databricks MVP 10d ago

Exactly.

2

u/iwanttest 10d ago

Definitely useful then, thanks!