Jun 15 (edited) in Technical
Write from Azure Databrick to onelake gives BadRequest 400
Hi have somebody face this issue when writing form an azure databrick notebook to onelake (same region same and with the same azure entra id account). the databricks cluster is created with auth passtrough for this account.
This is (snap) what is wanna to do (as first step);
oneLake = "abfss://databricks_to_fabric_test@onelake.dfs.fabric.microsoft.com/from_databricks.Lakehouse/Files/fromdatabricks"
df_p.write.format("csv").option("header", "true").mode("overwrite").csv(oneLake)
I got this error;
Py4JJavaError: An error occurred while calling o448.csv.
: Operation failed: "BadRequest", 400, HEAD, https://onelake.dfs.fabric.microsoft.com/databricks_to_fabric_test/from_databricks.Lakehouse/Files/fromdatabricks?upn=false&action=getStatus&timeout=90
even if I used the id's instead of the names it gives the same error
oneLake = (f"abfss://{workspace_id}@onelake.dfs.fabric.microsoft.com/{lakehouse_id}/Files/fromdatabricks")
What did I miss here ? (btw no (azure) firewall is active only nsg on databricks side)
2
8 comments
Write from Azure Databrick to onelake gives BadRequest 400
skool.com/microsoft-fabric
Helping passionate analysts, data engineers, data scientists (& more) to advance their careers on the Microsoft Fabric platform.
Leaderboard (30-day)
1
+29
2
+26
3
+23
4
+22
5
+19
powered by