Hello,
I'm trying to copy data between azure storage accounts and decided to use the az storage blob copy start-batch command. I noticed on Microsoft's documentation you can check the status of an individual blob, but you cannot check the overall status of the command, so it feels like I'm just sitting in limbo until it either succeeds or fails.
More detailed command below:
az storage blob copy start-batch --account-key 'key' --account-name 'name' --destination-container 'container' --source-account-key 'key1' --source-account-name 'name1' --source-container 'container1'.
I originally tried using azcopy for this but it was painfully slow, so I've been searching for an alternative that might work faster. AzCopy shows the status as it's copying the files and it also shows the speed at which it's copying. This just hangs on the screen, and I'm still waiting for it to complete with no idea if it will finish properly or will time out. Also on the documentation it says you can use az storage blob show to check the status of the blobs(screenshot below).
Also, I should add these containers have subdirectories inside them that are being copied over, so even if we could specify a particular directory instead of the only option being a specific blob.
Another note is that the destination storage account is a premium data lake gen 2 account. I don't think that should make a difference, but I wanted to include any & all information.
Did I miss something in the documentation? If not, I think this could be a very useful feature to see the status of the copy operation as a whole.
Hello,
I'm trying to copy data between azure storage accounts and decided to use the az storage blob copy start-batch command. I noticed on Microsoft's documentation you can check the status of an individual blob, but you cannot check the overall status of the command, so it feels like I'm just sitting in limbo until it either succeeds or fails.
More detailed command below:
az storage blob copy start-batch --account-key 'key' --account-name 'name' --destination-container 'container' --source-account-key 'key1' --source-account-name 'name1' --source-container 'container1'.
I originally tried using azcopy for this but it was painfully slow, so I've been searching for an alternative that might work faster. AzCopy shows the status as it's copying the files and it also shows the speed at which it's copying. This just hangs on the screen, and I'm still waiting for it to complete with no idea if it will finish properly or will time out. Also on the documentation it says you can use az storage blob show to check the status of the blobs(screenshot below).
Also, I should add these containers have subdirectories inside them that are being copied over, so even if we could specify a particular directory instead of the only option being a specific blob.
Another note is that the destination storage account is a premium data lake gen 2 account. I don't think that should make a difference, but I wanted to include any & all information.
Did I miss something in the documentation? If not, I think this could be a very useful feature to see the status of the copy operation as a whole.