I would like to use AppCenter to collect information about our Desktop-Product (Windows), but the data protection team (GDPR) is wondering if it will not cause problems because of the place where the data are located.
Is it any way to store data from AppCenter in a different country than the USA (App Center API Documentation)?
Is it possible to store the data ONLY on my azure blob storage?
Related
I wanted to check with you all just to confirm some final numbers.
I would like to migrate around 20 TBs of data (around 40 million files) into Azure File Share or Blob.
I am getting a little confused with the Azure Cost Estimator since it seems to talk about Azure transactions/Operations fees and storage at rest but not the cost to migrate data from On-prem file server to Azure Files.
Am I wrong to Assume all data migrations to Azure Files (Hot, Cool, Transaction Optimized) and Azure Blob (Archive or Cool) are free of charge? Cost will only start after the migration is completed and users start interacting with the data?
Please let me know what the correct answer is here.
Thank you all in advance!
There's nothing special about migration. If you copy files from on-prem to Azure the normal billing meters will charge you for it. You could use something like Azure Data Box to migrate data, but that's a separate service with its own billing.
Is anyone aware of a way to anonomise data within a storage account container on Azure?
I was assuming no but wanted to see if anyone had any ideas on this?
I'm aware of data masking on SQL databases on Azure but within containers we have files with data that are used within a data lake.
I know my details a little sparse... But I'm still trying to understand the underlying architecture I'm working with atm.
Any questions/ideas/thoughts, throw them at me!
Azure storage account(data lake) don't support data masking. so mask at the source of the data is not possible.
You can create app to mask the data and put it in the same VNET with your data lake(In this way, the others can not access the primary data). And then send the data to target storage.
But maybe what you need is customer managed keys to do data encryption？
We are working on implementing a new project in Azure. The idea is to move out of on-premise systems into the cloud as we have our vendors, partners and clients moving into the cloud. The option we are trying out is to use Azure Data Share and have Azure SQL Database subscribe to the data.
The thing we are now trying to explore is once a new data snapshot is created how do we import this data into Azure SQL Database?
For instance we have Partner information and this information is made available via Azure Data Share and new data snapshot is created daily.
The part that I am not sure of is how to synchronize this data between Azure Data Share and Azure SQL Database.
Also, Is there an api available to expose this data out to external vendors, partners or clients from Azure SQL Database after we have data sync to Azure SQL Database from Azure Data Share?
Azure Data Share -> Azure SQL Database
Yes, Azure SQL Database is a supported.
Azure Data Share -> SQL Server Database (on-prem)? Is this option supported?
No, SQL Server Database (on-prem) is not supported.
Is there an api that could be consumed to read data?
Unfortunately, there is no such API that could be consumed to read data.
Azure Data Share enables organizations to simply and securely share data with multiple customers and partners. In just a few clicks, you can provision a new data share account, add datasets, and invite your customers and partners to your data share. Data providers are always in control of the data that they have shared. Azure Data Share makes it simple to manage and monitor what data was shared, when and by whom.
Azure Data Share helps enhance insights by making it easy to combine data from third parties to enrich analytics and AI scenarios. Easily use the power of Azure analytics tools to prepare, process, and analyze data shared using Azure Data Share.
Which Azure data stores does Data Share support?
Data Share supports data sharing to and from Azure Synapse Analytics, Azure SQL Database, Azure Data Lake Storage, Azure Blob Storage, and Azure Data Explorer. Data Share will support more Azure data stores in the future.
The below table details the supported data sources for Azure Data Share.
How to synchronize this data between Azure Data Share and Azure SQL Database.
You need to choose “Snapshot setting” to refresh data automatically.
A data provider can configure a data share with a snapshot setting. This allows incremental updates to be received on a regular schedule, either daily or hourly. Once configured, the data consumer has the option to enable the schedule.
I am looking to use Azure Machine Learning Services (the one with the new drag and drop feature; still in preview) in a new data science project.
I have realised that I can preview the data when I connect a data set; I am able to do this using the option 'Dataset output' which is available as part of the dataset.
To be able to see this data, the data needs to be cached some where.
Can someone advise where this is cached?
Data is cached by default in a storage account that is created along with the the ML service workspace. It has the same name as the workspace plus some numbers. Inside the account there is a blobstore called azureml-blobstore-{GUID} Inside of that container your data is cached, organized by runs.
This data is made available to ML service as a Datastore that you can navigate to in the UI by clicking "Datastores" in the blade on the left-hand of the Studio.
In our company want to use the Azure Speech service for ASR of Kids' speech. In our agreement with the parents for this project (and also per company policy), we need to be sure the WAV data (and transcriptions) we send to Cloud based services like this one are not stored nor logged nor kept in any way by the service provider. i could not find information of what info is stored when we use the REST API or Speech API going to the Azure Speech service. any help appreciated.
In addition to the other comment, if you want to have complete control over the data and when it gets deleted you can create your own storage account and use Azure's Bring Your Own Storage feature. This way your speech services account use the storage account that you created for all storage instead of having its own internal storage.
You can then do something like setting up a storage policy that deletes everything inside the storage after x number of days to make sure nothing is being kept.