An ETL (extract, transform, load) pipeline is a fundamental type of workflow in data engineering. The goal is to take data that might be unstructured or difficult to use or access and serve a source of clean, structured data. It’s also very straightforward and easy to build a simple pipeline as a Python script. The […]

Introduction Do you ever wonder how your organization gets all employee information, salary, project details on a beautiful dashboard? Do you wonder how a Chef gets all his ratings, reviews consolidated as a single grade? Do you wonder how you will get a credit score based on all your credit history put together? Of course, […]

Introduction: As the mathematician and data science entrepreneur Clive Humby said in 2006 ”Data is the oil” to say how important data is nowadays; data now feeds entire industries and has enormous value, so we will talk about two topics around data, namely data science (or data science) and data engineering (or data engineering). First […]