➔ Lakehouse: The Next Step in Data Warehousing
| 3 minute read
As we keep making strides in today’s data-driven world, businesses need new ways to efficiently store large amounts of raw data while making good use of it. In response, Databricks presents a new data warehouse architecture called Lakehouse. This idea is intended to overtake the popular two-tier architecture of data lakes with data warehouses and set a new standard for data engineering for customers and businesses.
As a brief background, the journey of data repositories for companies starts with on-premise solutions.
Read More >>➔ DAGs Are Cool
| 1 minute read
[REUPLOAD FROM LINKEDIN]
I found an interesting topic from my discrete math class while exploring ways to design tools for data engineers. When designing data pipelines, it is common to visualize them as DAGs or directed acyclic graphs.
To break it down, a graph is essentially a collection of points or nodes that are connected by edges. When those edges have a specific direction, the graph is said to be directed.
Read More >>