How can I link Applications Insights to Tableau so I can visualize my data?
Application Insights supports continuous export (https://learn.microsoft.com/en-us/azure/application-insights/app-insights-export-telemetry).
I expect Tableau to have some import capabilities. You probably will need to write an adapter from AppInsights data scheme to Tableau.
Application Insights also supports a REST API to query metrics, items (as ODATA), queries, etc.
https://dev.applicationinsights.io/documentation/Using-the-API/Events
that might be better than paying extra to duplicate (export) all your telemetry?
Related
So I am building a application in azure and I am using Azure Log Analytics and I am trying to find s good way for people on my team that dont have access to azure but need to be able to access the Logs. Does anyone have simple fast ways to create something like this. Good techinologies good ways to give people access to it?
Is using Power BI to ingest your log analytics queries an option?.
The caveat here would be the need to redo any potential charts and graphs however Power BI offers a lot of functionality as well as opportunities to join with other day sets.
In your scenario the trick would be using a service account credentials when publishing the dataset.
You may try to use Azure Log Analytics rest api.
Then you can provide the authentication(it only authenticates to log analytics, not the entire azure) to the end user, and let them write query to fetch the logs; Or you can write a middle-ware, which can process the query request from end users.
So there are a few ways to do this:
You can use the ALA api to generate a home grown log portal
There are multiple SAS options out there
DataDog
Splunk
AppDynamics
Power Bi
Not specifically logs but prometheus and grafa for matrics and alerts and its dirt cheap compared to app insights
I was reading some on the Prometheus time-series database, on what their core model was. I've never understood what exactly a time-series database was until then. Excited enough, I started wondering about Azure Application Insights. Sure enough, Application Insights is a very powerful tool and easy to use for .NET Core devs, especially ASP.NET Core. I've used it for years and like it a lot.
I haven't found any official docs (nor un-official) that states whether Application Insights is a time-series database. From looking at the portal, it's atleast presented as a "normal" relational storage.
This brings us to my question - anyone know what kind of database Application Insights actually is?
Thanks for your help!
I think the reality is more complicated (disclaimer: I'm a part of Azure Monitor team) =) There are many underlying databases to power various experiences. Metrics and Logs are powered by different solutions. Recently we released Azure Data Explorer (https://learn.microsoft.com/en-us/azure/data-explorer/). Essentially this is a backend which powers both Application Insights and Log Analytics.
Re: time-series. Azure Data Explorer stores all ingested data. Timestamp is one of columns.
I have about 350GB of exported data that dates back to last june from my application insights. How can i analyze it?
How can i tell the portal to look back into that data and not only the last 90 days?
It is not possible to use exported data to power portal UX. Export feature is for integration with 3rd party services/backup/audit purposes/etc.
Well you could, but you'd have to write all of it yourself, and there'd be limitations.
you'd have to do the export which you're doing
you'd have to write something to parse and import that data back into your application insights resource into a custom schema (see https://learn.microsoft.com/en-us/azure/application-insights/app-insights-analytics-import)
and then you'd have to write tools/queries to join between old data in the custom schema and current data in the ai schema, being careful to de-dup any items that are in both places.
you wouldn't be able to use most of the built in portal tools, as they don't know about the custom schema. but analytics queries in tools like the analytics portal or workbooks could see both sets of data.
since a couple of weeks I'm working with Microsoft Azure and I wonder if there is a possibility to create realtime charts in my Web App for external customers.
I know Microsoft provides two different services called 'Power BI', which supports realtime charts and 'Power BI embedded'. But my problem is that, as far as I know, Power BI is only intended for internal users and Power BI embedded, which is inteded for charts e.g. in Web Apps for external customers, only provides reports which are not realtime.
Am I missing something or is it currently not possible to provide realtime charts inside web apps with the given services of Azure? If yes, what would be alternatives to achieve my goal?
Thank you very much in advance.
Kind regards,
Felix
I would look at Power BI Embedded, with the data source using a Direct Query connection to Azure SQL Database or Azure SQL Datawarehouse. Every user action in the report (filtering, drilling etc) will generate a query against the database.
That Power BI Embedded architecture is explained on this page:
https://learn.microsoft.com/en-us/azure/power-bi-embedded/power-bi-embedded-what-is-power-bi-embedded
Direct Query is explained on this page:
https://powerbi.microsoft.com/en-us/documentation/powerbi-azure-sql-database-with-direct-connect/
1) Consider that Real Time is like in an IOT scenario where you see your graphics on your dashboard moving in Real Time and not after a refresh. So in this context you should consider using Azure Stream Analytics Jobs. It's get an input from a blob storage, an event Hub, ..., and then in output you can use your power BI account to write in real time events ingested from Azure Streaming Analytics. Very powerfull! you use SQL for querying the input, the only thing to be aware is the thumbling time window that is somehow new to the SQL language.
2) Letting your customer access to the dashboard I would suggest you to pubblicate your dashboard for free access, and then secure your dashboard inside a web app on which you can apply a security pattern. You can also invite people outside of your organisation via email. Which is faster than the previous solution, but people accessing to your report must have a power BI Pro license. You can use the free trial for 60 days.
Hope that helps!
Cheers!
I use continuous export to pull in my Application Insights data into Power Bi. However, all of the data seems to be either 7-day or 30-day - how would I be able to view a chart with a longer-term timeframe (aka users over the last year)?
Update
Here is what I see in Power Bi:
From the screenshot, it looks like you're not using Continuous Export for this, but instead are using the Application Insights Content Pack for Power BI. The content pack has predefined views which us what you circled in your screenshot.
You can easily create your own viewed using the almost-ready-to-release Application Insights REST API (tracked with this UserVoice suggestion).
If you want to try this with the API, please send me a note at dalek#microsoft.com and I'll set you up. In the API documentation I show step-by-step how you can create charts from metric data in Power BI.
Thanks
Dale Koetke