Azure - Databricks (Forbidden. ACL verification failed. Either the resource does not exist or the user is not authorized to perform the requested operation)

I was trying to access the file stored in Azure data lake store from databricks. this is required to implement the business logic on top of the stored file. databricks helps to apply business logic to the big data quickly and I believe spark is the best tool available today to implement this.

followed the documentation provided inside Microsoft as well as Databricks to complete app registration and mounting of data lake store from Databricks.

App registration - https://docs.microsoft.com/en-us/azure/azure-databricks/databricks-extract-load-sql-data-warehouse

Mount ADLS - https://docs.databricks.com/spark/latest/data-sources/azure/azure-datalake.html

I received the error message ("ACL verification failed. Either the resource does not exist or the user is not authorized to perform the requested operation" ) when I tried to execute the below command

sparkDF= spark.read.format('csv').options(header='true',inferSchema='true').load('/mnt/mountdatalakejithesh/01.csv')

when I carefully rewind the steps that I took to complete, realized that access provided to the application was not on the root but to the child folder.

followed the below steps and I was able to access the file stored in ADLS. select the root folder.

click on the Access button and provide access permission to the application registered.