Copying all files from a on-prem server to Azure container [closed] - azure

Question

Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 3 days ago.
Improve this question
I am new to Azure and request help on below issue.
I have multiple servers on-prem.
My requirement is to copy all files and folders for all of the servers to an Azure storage account / container.
basic queries:
a) what is the best practice - create one container per server?
b) how to ensure that all files / folders are copied recursively from all disks on a server?
b) How to schedule the copy from server to container on daily basis with the requirement that date is appended in file name?
I am looking at https://learn.microsoft.com/en-us/azure/storage/common/storage-use-azcopy-migrate-on-premises-data?tabs=windows for a possible solution.
Will appreciate if you can share your thoughts / experience on the above.
I am looking at Microsoft learn for the time being and looking to install AZCopy.

Answer 1

a) The decision to create one container per server or to store all files in a single container depends on specific needs and use case.
One container per server can help with organization and management but may result in a larger number of containers to manage. Storing all files in a single container can simplify management but may require additional organization within the container.
b) One way to ensure that all files and folders are copied recursively from all disks on a server is to use a command-line tool such as Robocopy, which is built into Windows. To copy all files and folders from a server, you can use the following command:
AZCopy
you can use Azcopy to copy to containers, directories, and blobs
azcopy copy 'https://mysourceaccount.blob.core.windows.net/' 'https://mydestinationaccount.blob.core.windows.net' --recursive
And from local to containers, directories, and blobs
azcopy copy 'Local path' 'https://mydestinationaccount.blob.core.windows.net' --recursive
RoboCopy is also an approach to copy files to azure.
robocopy C:\ \\azurestorageaccount.blob.core.windows.net\container /S /Z /B /MT:16 /XD pagefile.sys /XF *.log /LOG+:C:\logs\robocopy.log
This command will copy all files and folders from the C:\ drive to the specified Azure storage account container. The /S switch tells Robocopy to copy subdirectories and files, the /Z switch allows the copy to be resumed if interrupted, the /B switch ensures the copy is performed with administrator rights, and the /MT switch specifies the number of threads to use for the copy. The /XD switch excludes the specified file from the copy (in this case, the pagefile.sys), and the /XF switch specifies files to exclude from the copy (in this case, all files with a .log extension). Finally, the /LOG+ switch logs the results of the copy to the specified file.
To schedule this copy on a daily basis with the date appended to the file name, you can use a batch file with the following content:
#echo off
setlocal
set DATE=%date:/=-%
set DATE=%DATE: =_%
set DATE=%DATE:,=_%
robocopy C:\ \\azurestorageaccount.blob.core.windows.net\container /S /Z /B /MT:16 /XD pagefile.sys /XF *.log /LOG+:C:\logs\robocopy_%DATE%.log
This batch file will set the DATE environment variable to the current date in the format of YYYY-MM-DD, with the slashes replaced by hyphens and spaces replaced by underscores. The Robocopy command is the same as before, but the log file will be named with the current date appended to the file name. To schedule this batch file to run daily, you can use the Windows Task Scheduler.
You can use AzCopy to transfer data from your on-prem server to an Azure container. AzCopy is a command-line tool that you can use to copy data to or from a storage account.
For more information refer below blogs
Thanks to Robert Allen for the blog - Robocopy examples
Robocopy Scheduled jobs.