Apache Spark Delta Lake transaction log to achieve source code analysis
We have this in detail what Apache Spark Delta Lake transaction log, the main purpose of the article and how it works. The article can be a good tell you about the inner workings of Lake Delta, the atomicity guarantee, for the purposes of this paper to learn, and lead us to look at the source code level to achieve Delta Lake transaction log. When looking at this article, I strongly recommend a look at "in-depth understanding of Apache Spark Delta Lake transaction log" on the article.
Delta Lake update data transaction implementation
Delta Lake which all updates to the table data (insert data, update data, delete data) need to be following these steps, its main purpose is to write what files to delete, which files to add to the transaction log and other records inside, that is, _delta_log json file in the directory, this realization by De