I did some research and found that there are some options to migrate on-premises QlikView reports to Azure data lake , using the IaaS approach.
Is there an PaaS component for QlikView in Azure ?
As of today , there is no PaaS component in Azure for QlikView . We have to go for the IaaS option, while migrating.
I can't find any Azure PaaS component to bind Qlik and ADLS, except using REST API from this link. The details of authentication of REST API could be referred in that case.
Here are some third-party tools to implement the transmission:
1.Dremio: https://www.dremio.com/, which supports ADLS connector.
2.Panoply: https://panoply.io/integrations/azure-blob-storage/, which supports Azure Blob Storage connector. Next step, you could move data from Azure Blob Storage into ADLS with ADF copy activity.
Related
How to store data from Azure Analysis services into Azure Datalake using Azure Data Factory?
I have two tables in Azure Analysis service and I need to copy and store those data into Azure Datalake using Azure Data Factory.
Could you please help me or share the reference url.
There is no direct connector for Azure analysis services in ADF but there are some ways via which you can copy the data :
1 such way is to create a linked server across a on prem/IaaS or SQL MI database instance and analysis services and get the data from the SQL instance through ADF.
Can we copy data from Azure Analysis Services using Azure Data Factory?
The above links explains it in details w.r.t the setup.
https://datasharkx.wordpress.com/2021/03/16/copy-data-from-ssas-aas-through-azure-data-factory/
May I ask what is the security protocol (Https/TCPIP etc) applied in the following scenarios in Azure? I need these details to write my design document.
Between Azure Services
Azure Data Factory interacting with Azure Storage
Azure Databricks interacting with Azure Storage
Azure Python SDK connecting to Storage Account (Is it TCP/IP ?)
If there is any support page in MS Azure, please direct me there.
Inside the Azure data centers used TLS/SSL for communication between
services and you can read about it "Encryption of data in transit"
section on this page.
The main SDK implementations are wrappers around the REST API and
Python SDK is one of them.
How to connect Data Lake store in Azure analysis services
Can we use HIVE ODBC or any other options?
I assume you want to use Azure Data Lake as a data source for Azure Analysis Services (e.g. you have fact and dimension files in the Data Lake).
There is no connector in Azure Analysis Services to pull data directly from Azure Data Lake at present, although hopefully this is something Microsoft will address soon.
As a workaround you could try the following:
Azure Analysis Services will allow you to use Azure Blob Storage as a data source. So once you have transformed your data in Azure Data Lake you then need to copy the fact and dimension files into Azure Blob Storage (e.g. using Azure Data Factory) and then you should be able to use Azure Analysis Services to build your model.
Note that the Blob Storage data source option is only available if you build a 1400 compatibility model in Azure Analysis Services. This option is only available if you have the latest version of SQL Server Data Tools for Visual Studio (you may need to upgrade to version 17.1 of SSDT).
I hope this helps
We use Azure Table storage in our project and we want to migrate to SQL Azure. Is there any simpler way to migrate ?
The simple way to move data from Azure Table Storage to SQL Azure is using Azure Data Factory. You can refer to the tutorials Build your first Azure data factory using Azure Portal/Data Factory Editor &
Move data to and from Azure Table using Azure Data Factory to know how to do it.
Is there any API or powershell cmdlet available for configuring the Azure stroage account for Monitoring?I mean monitoring blobs,queues and tables.
There are many ways by which you can configure storage analytics on a storage account:
Using Storage REST API.
Using Storage Client Library. Look for GetServiceProperties and SetServiceProperties.
If you're looking for a 3rd party tool, there's a free tool available from Cerebrata - http://blog.cerebrata.com/articles/2011/08/11/cerebrata-windows-azure-storage-analytics-configuration-utility-a-free-utility-to-configure-windows-azure-storage-analytics/. Using this tool, you can configure storage analytics.
If you're looking for a tool to view this data, try this tool: https://github.com/mogliang/Azure-Storage-Analytics-Viewer.