I'm trying to automatically download data from this website https://usafacts.org/visualizations/coronavirus-covid-19-spread-map/ daily to be able to use it in PowerBI and have my dashboard update as new data is added.
I just don't know what the best way to go about this is, any help is greatly appreciated.
You don't have to download the data each and every day, you just need to click
Get data-> Other-> web and provide the URL there, every time the data is update, you will get the latest values.
If you have the Power BI service you can create the report in Power BI Desktop, load it to the service and set up a dataset refresh, so the day will update for up to 8 times a day at times you can set. If you do not have the service (You can use the free version) you will have to update the data manually.
The MS Docs website goes through the set up here
Please use "Get Data -> Web" and provide the URL from where you want to fetch data. The will get downloaded into your dashboard.
Related
The problem:
I have some Azure workbook queries pinned to my Azure Dashboard. The problem I found is that manually refreshing the Dashboard or the Workbook queries doesn't give me the updated data. However, reloading the Dashboard web page does give me the updated data.
What I have tried:
Use a chrome extension to automatically reload the page at set intervals. This helps me create a self-updating dashboard. However, I was wondering if there's a solution to this that doesn't involve third party tools.
Workbook parts pinned to azure dashboards will autorefresh with the azure dashboard's timerange and autorefresh settings if they are configured to use time range parameters:
https://learn.microsoft.com/en-us/azure/azure-monitor/visualize/workbooks-overview#dashboard-time-ranges
without a time range parameter, the dashboard doesn't know how to correctly modify user queries to use the dashboard's time range. (not all of the workbooks data sources support query text, so it isn't just parsing/modifying text)
for some data sources, like Azure Resource Graph, that itself have no built in concept of time, if you wanted the part to autorefresh, the simplest workaround is to add a comment in the query text that references the time range parameter. the query won't actively use it, but the step then knows it depends on a time range parameter and will be autorefreshed.
I have Spotfire dash boards that are connected to the data in our database through Microsoft SQL Server. I have to go into Spotfire dashboard everyday and hit "reload all data" under the data tab.
Is there a way to have that run automatically everyday?
I do have access the automation service but am not sure if I need to learn how to use that or not.
Any help is appreciated!
For what you are describing, you will want to use scheduling and routing, not automation services. This functionality will allow you to set a schedule at which analysis will be loaded and data refreshed.
https://docs.tibco.com/pub/spotfire_server/11.0.0/doc/html/TIB_sfire_server_tsas_quick_start_help/server/topics/scheduled_updates_to_analyses.html
I'm trying to get data to auto refresh on a map layer I have added on ArcGIS. The information shows up just fine but does not refresh automatically as it does on the web page.
I have tried converting from its original source (XML on a web page updating every 15 minutes) to Excel, CSV (Both also update just fine) as well as trying to pull from Google Drive. I should mention I am using a free trial to test this program out so there's probably a little handcuffing.
Any help would be appreciated.
Found a method that resolved my own issue. ArcGIS Onlines auto update/refresh apparently only works for layers published by ArcGIS. Got around this by saving my CSV file to google drive and modifying the shareable link. process shown here I then added the layer from web by using the modified link from Google Drive. Now the data on my map updates with whatever was last saved on the spreadsheet at the refresh interval I set.
I have some industrial data that i wish to present in a spotfire dashboard to a client. I want to make the dashboard so that it would update automatically and I have not been able to find a tutorial on Tibco's site or here for how to do this.
It would be great if someone could tell me how to make spotfire look in a particular place (server, desktop, wherever) for a new .csv file, open it and create a defined set of visualizations and then mail a pdf to the client.
I have been through the spotfire automation services manual but I can't find a specific guide to what I need it to do.
All help appreciated.
I went back and read thru the whole question again, including the other person's answer. In order to be able to do what you want to do, you need to have Spotfire Server and Spotfire Automation Services. Automation Services in a product that you have to purchase separately from Spotfire, although it is bundled with the Analyst client.
In your question you said -- It would be great if someone could tell me how to make spotfire look in a particular place (server, desktop, wherever) for a new .csv file, open it and create a defined set of visualizations and then mail a pdf to the client.
I made the assumption that you knew you needed Automation Services to do this. All of my answers have been based around the use of Automation Services. That's the only way to push an email to a user that I know of. After you setup the Automation Services job, you also have to use Active Batch to schedule the Automation Services job, which I noted as part of the original 3 step process.
I want to make the dashboard so that it would update automatically and
I have not been able to find a tutorial on Tibco's site or here for
how to do this.
What you want to do is schedule updates to your linked data. What this will do is re-query the data-source at the specified schedule (once a day, twice an hour, etc) that you specify and cache it on the web server.
Here is the documentation for that.
Schedule Updates
Scheduling updates using Spotfire Server (be sure to navigate down the sub items on the left)
Monitoring Schedule Updates
It would be great if someone could tell me how to make spotfire look
in a particular place (server, desktop, wherever) for a new .csv file,
open it and create a defined set of visualizations and then mail a pdf
to the client.
For this, you still want to use scheudle updates for the first part after you have linked your analysis to your csv file. Your file name will have to remain the same for spotfire to pick it up unless you customize this with some scripting. Once that is complete, you'll want to use Automation Services to complete your mailing a pdf.
Automation Services Tutorial
Automation Services User Manual
Generally speaking, this is a three step process.
1. In the desktop app, create a report (File -- Export -- to PDF -- prepared report. In this step you are creating the export and telling Spotfire specifically what to export. Where to find the report
2. In the desktop app, create the Automation Services Job (Tools -- Automation Services Job Builder). All jobs start with opening the file. Then you create the export. Then send the email. Sample active batch jobe
3. Now, you have to automate the task. This can be done with Windows Task Scheduler or Active Batch.
Those are the high-level steps. There is a lot of syntax and detail in each of the steps, but this should get you started. Please reply with more detailed questions on any one of the steps.
I'm hoping this is possible.
The organization I work for has a Sharepoint site and I am able to Upload Files to pages, however I am not an admin on our Sharepoint. I'm not sure what the version is, I think its older (ie: 2005).
I have some Excel Reports I've built. The data for these reports is pulled from a SQL Server Database which I have full control over. I have setup a Job in SQL Server to run every 12 minutes, this procedure pulls in some data and updates a few tables. These tables are used to feed my Excel Reports.
I have a separate Scheduled task set to open my excel report(s) refresh the data connections and save as a PDF.
I would like to link to these PDF Files via our Sharepoint so that the VIPs can access the reports as they want, but they always see the most up to date report.
I was trying to link to a Shortcut to the PDF Files but SharePoint doesn't seem to like that. How do I make the SharePoint link point to the PDF File that is saved over every 15 minutes?
Thanks in advance,
Any insight is greatly appreciated.
The way I do it (newish version of Sharepoint) is make the save location for the PDF the network location where Sharepoint keeps the files for that site. Usually you'll have access to those if you can edit the Sharepoint site.
Here is a tutorial to find that network location.
EDIT: It very well may be disabled by the admin at the moment. But it looks like the functionality is there.
Given the age of your SharePoint (either 03 or 07), most of the modern tools that you could use to do this don't exist for you (Excel reporting, BI tools, etc). The easiest solution I can think of is to actually modify the other side of the equation. A few options:
Change your report to output two copies of the same file. One entitled (as an example) currentreport.xls and the other report20150626.xls . Put the link to the currentreport.xls in SharePoint.
Build an ASP.net page that runs the SQL query you have built and pull the data through a view. Since this would be pulled on demand, it may be a few more cycles of your SQL code, but indexing, caching and selective data pull can prevent this from being an issue. Put the asp.net code in an iFrame in a SharePoint content editor web part.
Build your report using SSRS and host the output of that in SharePoint using an iFrame.
Run a scheduled job in SQL that copies your current report data to a table and query that table instead of your normal report table. That way you only have one Excel file that points to a specific table so no need to update links. You can always keep copying data to specific files if you need a historical record and can't use the DB to store this data for you (though the amount of space that it would take to do so would be minimal).