HELP!!!!!
My production ETL stopped working last night.
The Stored procedure transferring from the delta table in the lakeouse to the "silver" layer in the warehouse could not see the delta table.
The upshot is I can (could!) visually see the tables in my SQL endpoint (via web UI or SSMS), but if I query them I am told the table is not there (which is correct).
When I view the lakehouse via the Lakehouse view, it correctly only shows the only 2 tables that are there.
As I am typing, the situation has changed (after over an hour of trying to understand the problem whilst it persisted). However, there is definitely something wrong with the lakehouse.
I have just triggered the ETL again (but for 1 table I know will only generate a single row delta), and it is continuing to show the same behaviours.
Is there something I need to do to "tidy up" the lakehouse.
The ELT literally drops all previous deltas, then copies the fresh delta. Every 15 mins. has been running fine for weeks.
Anything anybody can point me to?
2
6 comments
John OCallaghan
2
HELP!!!!!
Learn Microsoft Fabric
skool.com/microsoft-fabric
Helping passionate analysts, data engineers, data scientists (& more) to advance their careers on the Microsoft Fabric platform.
Leaderboard (30-day)
powered by