This is the second part of the series. In Part 1 [https://boristyukin.com/building-near-real-time-big-data-lake-part-i/] I wrote about our use-case for the Data Lake architecture and shared our success story. Requirements Before we embarked on our journey, we had identified high-level requirements and guiding principles. It is crucial to think

Preface A lot has been said and done about a Data Lake architecture. It was 10 years ago when James Dixon defined a Data Lake concept in his viral blog post [https://jamesdixon.wordpress.com/2010/10/14/pentaho-hadoop-and-data-lakes/]. I know more people who can explain what a Data Lake