I work in a small company and we develop PowerBI dashboards for a few clients. Data sources tend to change with each client from MySQL, MariaDB, SQL Server, Excel etc. Most clients want to setup scheduled refreshes but in order to do that we need a Data Gateway. So far i've used my machine as a gateway but that requires my computer to be on all the time which is not ideal. Since our clients data is usually stored in their own networks I believe we need an enterprise data gateway to manage all those scheduled refreshes for our current and future projects.
We don't have any physical on prem infrastructure, most of the company's developemnts are managed through AWS linux cloud servers. From what I've read a possible solution is to have a VM running 24/7 with the enterprise data gateway installed, although this seems a bit expensive taking into consideration Azure VM prices. Is there any other solution to my situation or is a VM the only path I can take?
There is no other option available, On prem data gateway requires installation and configuration to connect your data sources to powerBI, for this we require onprem machine or a VM in azure.
As you are aware the recommended machine configuration is:
An 8-core CPU
8 GB of memory
A 64-bit version of Windows 8 or Server 2012 R2 or later
Solid-state drive (SSD) storage for spooling.
If in case, your resources are running in azure you can use vnet data gateway,It doesn’t require any installation Create virtual network data gateways
Related
I wanted to pull the data from my on-prem server ( hive or oracle ) to Azure data factory. Whereas i am facing issues can you help me in this?
I am asking this on the basis of enterprise issue. I wanted my integration Runtime to be in Onprem server , currently we are installing it in our own laptops and if our laptop is shut down then obviously IR is stopped and data won't be loaded this can't be feasible in production.
Do anybody know that what is meant installing IR in my on prem server? that means in my hive server?
Your help will be really appreciated.
Your SHIR server does not have to be on the same server as your data source. But it should be close to it. Same region or same data center.
You need a server that is always powered and running. Refer to the documentation.
If you want high availability you should refer to this link.
If you want DR, you will need another SHIR on a DR server in your secondary region.
You can also install the SHIR onto a VM running on the cloud. But your Onprem network needs to be connect to the Cloud VNET using Express route or a VPN.
Laptops is fine for testing but as you said, not for production.
Your IT team should also take care of the patching and updates/maintenance of the new server whether it is on prem or on cloud.
I'm in the process of migrating an existing website into Azure for a client. The current architecture is 4 web vm's mated to 4 sql server vms. One web vm per sql server vm. Complexity and cost is prohibiting us from migrating the sql server vm's into azure sql servers. These are read only databases and use log shipping to keep them synced.
I have easily published the asp.net application to an azure web app. My question is, how do I evenly distribute the web app instances to the 4 sql server vm's?
Depending on hourly traffic, I can see anywhere from 2 to 8 web app instances running at any given time. How can I evenly distribute the load to the 4 database vm's?
Depending on how you setup your environment you could put an Azure Internal Load Balancer (ILB) in place to load balance TCP 1433 across the four back-end SQL Database Servers.
You might need to tweak the distribution mode, but I'd run it first to see what the performance is like. If the Database is relatively static perhaps you could even consider using a VM Scale Set to scale out SQL based on load.
We are planning to migrate our Enterprise Application(s) from on-premises to Azure. Below are the high level details about our current infrastructure.
One Web Server hosting multiple WebSites (around 30 websites)
One Server with SSIS installed in it which processes huge data coming from multiple data sources and dumps the data into Pre-production database server explained in #3 below
Two Servers (Pre-production and Production) with SQL Server hosted in them where some jobs run on Pre-Produciton Server and the data gets replicated to the Production database server.
One Server where SSRS is hosted that uses data (and stored procedures) from Pre-Production database Server.
Could you please let us know if it is a good option to migrate the current infrastructe to PAAS? Is it really possible? We are also planning to leverage the other Azure features like Load Balancing on Web Servers and High availability on Production Database server with Active-Passive servers.
For migration scenarios, please see the following: https://azure.microsoft.com/en-us/documentation/articles/sql-database-cloud-migrate/
I have a virtual machine with CentOs in Azure. Running a web-based application with a connection to the database (via public endpoint).
There is one machine with CentOs, which runs a database (MySQL). Approximately 30% of the connections to the database from the web application failed.
I also use API Facebook, and there are also problems with the connection.
What is the size of your Azure VM? Please note that there are I/O quotas applied to each VM size. Thus XS sized VM has just 20mbps connection, where XL can be up to 1Gbps.
Also please make sure you have Azure VM in an Azure Data Centre location which is closest to your MySQL Db.
I run a code that utilizes FB API on Medium sized VM (Worker Role) and don't have issues with it.
Is there any performance penalty to using Windows Azure SQL Database (formerly known as SQL Azure) from within a Windows Azure VM hosted web app? I would like to know if the performance of this is any worse than using Azure SQL database from a website running on Azure reserved instance. The assumption in both scenarios is that Azure SQL Database is deployed in the same region as the app.
There should not be any difference with respect to utilization of SQL Azure
As #Igorek pointed out, there's no difference (assuming same data center) between using a Virtual Machine and a Website for accessing Windows Azure SQL. That said: One thing that may not be so obvious is that, today, Virtual Machines (and Cloud Services) support XL instances (meaning 800Mbps on the NIC) vs Websites, which are currently limited to Large reserved instances (400Mbps). So... if you're moving a considerable amount of data, you'll get better throughput with an XL Virtual Machine vs. a Large Website instance.
I realize this is an edge case, but just thought I'd throw it out there...
There may be some difference in performance which depends on the configuration on the Virtual Machine and the Website Infrastructure where the Website is Hosted.
The connections in-bound and out-bound performances depends on the load balancing which is abstracted in Azure. This relates to the infrastructure which is in place.
For instance if the VM is in Basic Tier More on VM Sizing, and the website is hosted with a higher configuration, you may get some variance in Performance.