Call databricks scripts from Aure data factory



Azure data factory is a wonderful tool to co-ordinate the entire EL and TL process. Using ADF, we can pull the data from the file stored in ADLS, FTP, web service, blob storage etc. transform the data using databricks/usql/hdinsight clusters and load into sqldb, azure sql dw, adls etc.

Please go through the video below to understand how we can call databricks script from ADF and load the transformed output into Azure sql db.








Comments

  1. The representation of this article is actually superb. I think this is a genuinely beneficial and instructive article for everyone. I appreciate this kind of writing. Thankful to you for sharing an article like this.shipment data

    ReplyDelete

Post a Comment

Popular posts from this blog

Hadoop - Hive - Load data from csv/xls files

Microsoft BI Implementation - Cube back up and restore using XMLA command