There does not seem to be a way to set up automatic refreshing of data from Sharepoint like there is with a SQL server.
The main difference from what I can tell is that Sharepoint is only listed as a Data Table, with no Data Connection Settings.
Data Connection
Data Table
How can I can I set up Spotfire to automatically update the data from Sharepoint once a day? I've tried various JS and IronPython scripts, although not specifically designed for Sharepoint data updates and I've had no luck so far.
I had contacted Spotfire support and at the moment is it not possible to do automatic updating from Sharepoint. They may or may not add it in the future.
Related
We have 5 tables inside a database and we want to sync the data inside those tables to SharePoint online lists. All the modifications will still happen on the database tables, so the sync should only sync New/edited/Deleted data from the database to SharePoint and not from the other side.
The database tables can be accessed using ODBC. So what are the approaches we have to do such a sync:-
Using Power Automate Flow which runs on schedule basis?
Write a .net console application which reads the data from the database and update SharePoint using CSOM?
Other approaches
Any advice?
Thanks
I've been working on a PowerAutomate sync between an Excel Table and a bundle of Sharepoint lists, and one component that is proving quite useful for the Excel -> Sharepoint update direction is the "Sharepoint File or Folder Created or Modified" trigger.
If your database platform has the capacity to create small csv or json files corresponding to the changes you want to make, then one option might be to set aside some "new, change, delete" folders accessible to your PowerAutomate profile and to have your system pass in files with the records to be changed. Particularly if your db tables are particularly large, this might be a more efficient solution than periodically scouring the whole table to try to identify those changes proactively.
I am completely new Office 365 (and SharePoint) but have been asked to create a site that will display a range of data in the form of graphs and tables etc The data will change daily and therefore it must be possible for members of the team to enter new raw data, for the results to then be displayed through Office 365.
I realise this might sound a little vague but my initial thoughts are that SharePoint is what I should use to display the data and to have a SQL backend database that stores the data for SharePoint to connect to. Having done some reading on the topic and I am still a little unsure if this is common practice or even possible.
Any inital pointers would be greatly appreciated.
This can be done with Power BI. The data sources can by almost anything, SQL, spreadsheets, online sources, you name it. Create queries to get the data, model it (if required) and build reports and dashboards that display in a browser (or on a phone).
I just recently realise, while using Excel, it lacks on features for being able to update SQL server data through their worksheet.
I have tried using Data-->From other sources--> SQL Server data; that works like a charm but as it has limited ability (View and only get the latest data but not update).
I don’t know if this is done purposely by Microsoft as a money making schemes.
But through my research today, I also came across PowerQuery, and It seems to do pretty much what Data add-in did escape it has few new extra features and sounds pretty advance, therefore, I was wondering if this add-in has the ability to update SQL server data using excel sheet, if so can you guys advise me to the right direction:
I came across lots of commercials products that did the job but frankly speaking, I cannot afford it.
The best solution for in this space that I've seen is the Master Data Services component included in SQL Server (Business Intelligence or Enterprise Edition). This includes an nice Excel Add-In for maintaining data, a Web UI and SQL Views and Staging Tables for data integration.
It doesn't have any direct integration with Power Query, but I would let PQ dump data into Excel Tables, then copy and paste the data into Excel tables using the MDS Add-In.
I'm hoping this is possible.
The organization I work for has a Sharepoint site and I am able to Upload Files to pages, however I am not an admin on our Sharepoint. I'm not sure what the version is, I think its older (ie: 2005).
I have some Excel Reports I've built. The data for these reports is pulled from a SQL Server Database which I have full control over. I have setup a Job in SQL Server to run every 12 minutes, this procedure pulls in some data and updates a few tables. These tables are used to feed my Excel Reports.
I have a separate Scheduled task set to open my excel report(s) refresh the data connections and save as a PDF.
I would like to link to these PDF Files via our Sharepoint so that the VIPs can access the reports as they want, but they always see the most up to date report.
I was trying to link to a Shortcut to the PDF Files but SharePoint doesn't seem to like that. How do I make the SharePoint link point to the PDF File that is saved over every 15 minutes?
Thanks in advance,
Any insight is greatly appreciated.
The way I do it (newish version of Sharepoint) is make the save location for the PDF the network location where Sharepoint keeps the files for that site. Usually you'll have access to those if you can edit the Sharepoint site.
Here is a tutorial to find that network location.
EDIT: It very well may be disabled by the admin at the moment. But it looks like the functionality is there.
Given the age of your SharePoint (either 03 or 07), most of the modern tools that you could use to do this don't exist for you (Excel reporting, BI tools, etc). The easiest solution I can think of is to actually modify the other side of the equation. A few options:
Change your report to output two copies of the same file. One entitled (as an example) currentreport.xls and the other report20150626.xls . Put the link to the currentreport.xls in SharePoint.
Build an ASP.net page that runs the SQL query you have built and pull the data through a view. Since this would be pulled on demand, it may be a few more cycles of your SQL code, but indexing, caching and selective data pull can prevent this from being an issue. Put the asp.net code in an iFrame in a SharePoint content editor web part.
Build your report using SSRS and host the output of that in SharePoint using an iFrame.
Run a scheduled job in SQL that copies your current report data to a table and query that table instead of your normal report table. That way you only have one Excel file that points to a specific table so no need to update links. You can always keep copying data to specific files if you need a historical record and can't use the DB to store this data for you (though the amount of space that it would take to do so would be minimal).
One of my customers is very impressed with the capabilities of PowerPivot, particularly the analysis capabilities but even more the publishing capabilities. With that I mean the ability to publish a dashboard to a SharePoint site, after which it can be experienced directly in the browser, including filtering and slicing for end-users.
As we publish our PowerPivot results to a SharePoint site, we get the following error for any action that triggers the data connection to refresh:
The data connection uses Windows Authentication and user credentials
could not be delegated
I've done a lot of research on this one and it seems it is a configuration issue on the SharePoint side. Note though that we are using a cloud hosted SharePoint thus the environment is not under our control. In addition, even our own team mentions this to be a security restriction that will not be lifted.
Therefore, I'm not working on solving the above problem, rather on avoiding it alltogether:
My first experiment was to build a "normal" Excel file without PowerPivot. Same data and I managed to build the same pivots. Both the data and the pivots are in the same file, without a data connection. Publishing it works just fine. The error is not experienced this time, and even interacting with the report via slicers works.
As a second experiment, I wanted to follow the same scenario, but this time using PowerPivot. From data in an Excel sheet I created a so-called "linked table" in PowerPivot. Next, I created some pivots that make use of this table. The pivots are in the same Excel file as the original data. When I publish this file to SharePoint, I get the same error mentioned before when doing anything that refreshed the data connection. Even though the data and pivots are in the same file, it still pops up with this security error, which surprises me.
How can I work around this data connection issue when a PowerPivot is published? We'd like to have both the analytical power of PowerPivot as well as having the rich publishing options of Excel, without running into the data connectivity issue. Is it possible to "flatten" a PowerPivot file to "normal" Excel, since experiment #1 shows that this works fine. How can I remove the data connection from PowerPivot and tell it to just use the Excel data in the very same file?
Do you have PowerPivot for Sharepoint installed?
Is it Pivotstream providing the cloud service?