Private Endpoint, Data Connect and Blob Storage

[andrewsschmidt]

Receiving 403 error when my pipeline reads from DataConnect and saves into Blob.

{
"errorCode": "2200",
"message": "ErrorCode=UserErrorOffice365DataLoaderError,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Office365 data loading failed to execute. office365LoadErrorType: PermanentError. Operation on target 67a42e0a-145a-495c-9cb6-103d5c556609_Activity failed: ErrorCode=AzureBlobFailedToCreateContainer,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Unable to create Azure Blob container. Endpoint: 'https://gbusmgdcconvlineage01.blob.core.windows.net/', Container Name: 'managers'.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=Microsoft.WindowsAzure.Storage.StorageException,Message=The remote server returned an error: (403) Forbidden.,Source=Microsoft.WindowsAzure.Storage,StorageExtendedMessage=RequestId:0b5d4c5a-801e-0012-7e4d-00367a000000 Time:Mon, 16 Oct 2023 16:25:27 GMT,,''Type=System.Net.WebException,Message=The remote server returned an error: (403) Forbidden.,Source=System,',Source=Microsoft.DataTransfer.ClientLibrary,'",
"failureType": "UserError",
"target": "M365ManagersToAZBS",
"details": []
}

I know my Private endpoints are correct, synapse can test connectivity and I can create a simple copy job but when reading from data connect then writing to blob i get this.

Are these technologies not compatible? Is there a work around?

[vipulkelkar]

I have also hit this issue. @andrewsschmidt did you get any solution/workaround for this ? I am able to copy blob between folders from my synapse pipeline with private endpoint connectivity and public access fully 'Disabled'. It seems the copy from M365 dataset fails.

My setup is aligned with the documentation : https://learn.microsoft.com/en-us/graph/managed-private-endpoints-overview
Additionally, I have tried several permutations of the networking settings - 'Enabled from selected networks' as suggested in documentation, 'Disabled' etc. No luck.