Need help on lakehouse incremental update

Jul 11 (edited) in Technical

Hi Everyone,

I'm trying to figure out what's the best way to update some data in a Fabric lakehouse. Unfortunately I'm not able to paste a sample grid table here so I pasted a screenshot explaining the problem I'm having.

Basically I would like to run an incremental update to a Fabric lakehouse table based on data I'm receiving from the source system, but the 2 methods I can think of (merge statement, and delete/insert wrapped in the same transaction) does not work.

EDIT: For the delete/insert option I did think of using delta table history to handle failure and rollback but that could make the solution quite complex, so that would be my last resort option

Is there any other solution that can help achieve this update?

Thanks in advance

2 comments