Come to talk about the issue Azure storage data migration, and when we need to migrate data to storage, we in fact there are many ways to choose from, each method is applicable scenario is not the same, then summed up can be divided into the following
network transmission
-
Graphical interface
AzCopy
PowerShell
CLI
SDK
Azure Data Factory
Physical transmission
-
Azure Import/Export
Azure Databox
We can choose a lot of ways, but what specific appropriate, or to look case by case
First, the network transmission of one of the biggest drawbacks is the slow, poor stability, if we have a large-scale data needs to be transmitted to the cloud of words (such as 10T +), it would be best not to use the transmission network, uncontrollable speed, bandwidth-dependent very strong, and there is the risk of transmission interruptions, for such large-scale data, it is recommended to use Azure import / Export this physically transmitted directly to copy data to the hard disk, and then sent directly to the data center encryption, speed definitely be much faster
Second, if the data was relatively low, then the transmission network will be more obvious than the physical transport advantages, in such a variety of network transmission solutions, the more recommended azcopy, azcopy been a long time out of time, and now after a large version of the update after, the latest version is now azcopy v10, v10 easier to use than ever before, but also supports the use of Azure AD for authentication
Global actually have a picture of how we can be a good guide to select the data transfer mode
Of course, in addition to that there are other third-party products can also be used, such as cloudberry, but many of them are paid for such products, are interested can try next
Next, we will focus on the use of under AzCopy, AzCopy v10 and compared to the previous one big difference is that it does not require installation, it's just an executable file, so only need to be copied to the server can run
Download AzCopy v10 are as follows:
https://aka.ms/downloadazcopy-v10-windows
Use this address to each download will be the latest version of azcopy
If we want to download a fixed version of azcopy, you can first obtain azcopy fixed url, use this url to download each download
You can obtain relevant information on Windows 10 directly curl
(curl https://aka.ms/downloadazcopy-v10-windows -MaximumRedirection 0 -ErrorAction silentlycontinue).RawContent
After the download is complete, you can see the true capacity azcopy
Before making a copy of the data, we first understand azcopy be authenticated under way. Overall, azcopy supports two authentication methods, Azure AD and SAS, this and previous versions of azcopy is completely different, the previous azcopy directly with the storage of key authentication to do, but there is more recommended azcopy v10 SAS and the Azure AD
| Storage Type | Supported authorization methods |
| Blob storage | Azure AD & SAS |
| Blob storage (hierarchical namespace) | Azure AD & SAS |
| File Storage | SAS |
We can use a lot of data AzCopy complete copy of the task, covering a variety of scenarios, very powerful, then we are ready to take the actual case to illustrate in the end when the next best thing in the end how with the use azcopy and azcopy
1. Local file / folder -> storage
2.storage-> local files / folders
3.storage->storage
4.S3->storage