Building and Orchestrating Big Data
Pipeline – Part 2
In the world of big data, raw, unorganized data is often stored in relational, non-relational, and other storage systems. The data is staying at different places. However, on its own, raw data doesn't have the proper context or meaning to provide meaningful insights to analysts, data scientists, or business decision makers. Azure Data Factory is a managed cloud service that's built for complex hybrid extract-transform-load (ETL), extract-load-transform (ELT), and data integration projects. This series on “Building and Orchestrating the Big Data Pipeline” of Azure Data Factory walks you through from the start, and covers most of the common scenarios you're likely to encounter.
This session will show you a demo of the Azure Data Factory (ADF) to help you understand:
- The capabilities of ADF
- How ADF can help you with data management
Senior Software Engineer
Sudhir works as a Sr. Software Engineer with Microsoft Corporation. He has spent 14 years in the industry, and has been involved in development, consulting, troubleshooting as well as tech evangelism. He is also the author of "Operationalizing Big Data and Advance Analytics Solution using ADF". Having worked extensively on Data and AI platforms, he has presented at major conferences on various topics like BI, Big Data and IOT. He is a certified Azure Data Scientist Associate, Azure AI Engineer Associate, Azure Data Engineer Associate, MCITP, MCTS, MCT, MCPS and MS.