Export Data Connection Query from Excel to CSV (>2M rows) - excel

I have a spreadsheet that is using power query in a data connection to execute modelling on CSV files that have more than 2M rows.
This works fine and I can run analysis on this data as needed.
However, now I want to export the resulting data after all the manipulations have been made.
I can't see a way to export the data query result without outputing to a sheet... which I can't... because the row count is >1M.
Can I export the data without outputting to a sheet/multiple sheets?
If so, what tool would I need (if any) and what are the general steps?
I've been trying to work this out on my own for months but I have to recognise my limitations and ask for help now.
Many thanks in advance.
DD

You need to use an external tool like DAX Studio (free) to connect to the Power Pivot data model and export the tables to CSV.
https://daxstudio.org/

As David mentioned above, Dax Studio will output the results of the data model.
Steps as follows:
Download and install the Dax Studio plugin for excel
Make sure the connection you are trying to extract is in the data model.
Launch Dax Studio.
!!!Dax Studio will only be able to read your data if you launch it from the Add-ins tab of Excel. This is the only data source type where access to the data is dependent on how Dax Studio is launched. Again, YOU MUST LAUNCH THIS FROM THE ADDINS MENU OF THE EXCEL DOCUMENT CONTAINING YOUR QUERY/CONNECTION.
A dialogue box will appear. It should show data source "Power Pivot Model" as the radio selection. If it is greyed out, it means that you have not added your query/connection to the data model.
Select "Connect". You will now see all the tables in your data model on the left hand side and may now extract to csv.

Related

Excel PowerPivot - change data source type

I have an Excel 2016 with 30 graphs based on PowerPivot. PowerPivot fetches the data from another Excel sheet, but I want it to get the data from a SQL server table instead.
How can I change the data source type in PowerPivot? I've tried looking in the Excel xml without any luck. Would be a lot of work re-creating all graphs over again just to switch data source
Thanks
Dennis
One suggestion I would make for the future, if all the users are using 2016 is to use Power Query which comes standard with that version of excel. In the Power Query loading data into Power Pivot scenario, all Power Pivot cares about is the column names. This means that the query can be changed between data source types without causing issues, as long as the same column names are changed.
As an example, I have one file that based on a parameter flag rips data out of a series of excel files on a shared network drive or Share Point. Both of which would be different data sources. The first opening a folder as the data source, then excel files listed within the folder. The other opening a share point list as its data source, then navigating though excel files.

Spreadsheet with relationships

I have to work with data CSV file. They look like this
sample
It represents products with options/cars etc. at the web-store.
It has a lot of columns with duplicated values and in my work in often need to copy some part of this data to another sheet, deduplicate it, edit and then paste it back by matching it for one of the columns that were untouched. More this purpose I'm using Ablebits Excel suit.
Is it possible by any excel function to automate this process or maybe there is some other software that could handle this? Something not so complicated as relational databases like Access, but something close to spreadsheet editor with relationships
I already tried Power Query in Excel and Power Bi, but they seem to be more analytics tools and not the data edit
2nd edition:
Data has a layer structure with duplicates.
Title1|Part number 1|Car1
Title1|Part number 1|Car2
Title2|Part number 2|Option1
Title2|Part number 3|Option2
I want to have opportunity to:
Edit values that duplicate without using "Replace All" or at least have more flexible "Find&Replace".
Extract columns with deduplicating them and saving a reference to the place they were taken. So if you edit some data there it was changed in the 1st place. For example, I have titles(a lot of titles) but need to edit it. Instead of copying it with some id to reference it I want to open it like they appears in filters, edit it, confirm and get it edited in all column
I would use Power Query (aka Get & Transform on the Data ribbon in Excel 2016). The only limitation I see with what you want to do is that Power Query will deliver a new Excel Table with the output of a Query - it can't update existing cells.
If you can get past that, Power Query is very flexible, easy to learn (WYSIWYG query editor), scales well and is integrated with other Microsoft products (as well as Power BI, there is integration with SQL Server Analysis Services in preview and hopefully SQL Server Integration Services one day).

Export large Powerpivot table without data connection

I'm on Excel 2013
Is it possible to EXPORT a powerpivot table and have FULL pivot table drop down functionality without the connected data?
1) I'm using slicers as filters and want to export specific files based on the Filtered Names
2) Would non Power Pivot / Power Query users be able to view my workbook? (I'm thinking probably not)
I've scoured forums and stackoverflow and was unable to find a clear answer.
I've tested it myself and disabled connection and it looks like the LAST format the PowerPivot table was showing would be the view/data that the user sees.
I agree with your test results. Anyone on Excel 2016 / Office 365 should get full functionality.
You might want to try the free Power BI service, where you can upload your Power Pivot model to the cloud and then connect to it using the Power BI Publisher Add-In.
https://powerbi.microsoft.com/en-us/documentation/powerbi-publisher-for-excel/#connect-to-data-in-power-bi
You can set a CSV file with your data as your data source in powerpivot and just point your data model at the CSV. I do this to slim down big models. The data lives in the powerpivot cache level but is not a literal tab in your workbook also much smaller footprint. Works like a tiny database connection. Go to the powerpivot screen choose "From other sources" on the home ribbon, and scroll to the bottom for a text file or CSV. Easiest way to make a pseudo-data mart.
I guess I am not sure what you mean by export the table, The pivot would show without the data connection, but without the full model behind it in the data layer changing anything would just lock it up.

Tabular SSAS Analyze in Excel error

I've created a new Tabular Project with SSDT2015 and deployed it on a SSAS2012 named instance, from Management Studio I'm able to connect to the SSAS database and with an EVALUATE command I can see the rows of deployed tables.
If I press Analyze in Excel from SSDT appears a window Analysis Services Connector 13 asking me to choose between Analysis Server and Cube file.
I've tried both options but clicking on finish I can see a grayed out Excel sheet with no connection available.
If I try to connect to SSAS from a fresh Excel using From Analysis Service option, filling the required info leads me to the following message "No data fields are available in the OLAP Cube". Can someone suggest me a way to solve this issue ? Best regards Fabrizio
I was able to solve this problem by adding a Measure to a table in my cube, something like AVERAGE('Table'[Field]) or SUM('AnotherTable'[AnotherField]) over a number of rows. After I added this I was able to load my cube in Excel as a pivot table.

Has anyone achieved to use ODBC connection from Excel file into Powerpivot?

I have installed Powerpivot for Excel 2010. I don't have Access 2010 so I thought could I arrange the data in the similar manner as I would for a database.
I'm wanting to query an excel file that has rows of self-generated data into Powerpivot in order to perform simple pivot table. In a sense attempt to get an overview of information about a data set.
At the moment, I'm unable to get set up correctly the ODBC I'm hoping I need to accept an Excel file and to get PowerPivot to accept a database from an Excel file.
Edit: I come to understand that I need to set up a table correctly in Excel so that the ODBC works correctly. Does the picture I provided be right manner to set up a table or any other manner?
Has anyone attempted to do this and if so what would the steps be?
Thanks,
Peter.
Peter, I am working on the basis that your data is in a recognizable table on a worksheet (and that you are not interested in using the standard Excel import method through 'From Other Sources')
If you create the connection to the Excel file in a very particular way it is possible to then query it as if it were a database.
Create a Connection to the spreadsheet in question in Excel through Data>Connections>Add.
In the PowerPivot window on the Design tab click on existing connections and find the connection you just created. Select the connection and Open.
You need to name the connection and then you will be offered the normal import options. Select the sheet you want to get the table from (its actually not important which one you choose at this point).
Once the table has been imported you can re-enter the setup through the 'table properties' on the design tab and you will now be able to 'Switch to' the query editor at which point you can not only write SQL to query your DB but reference any other .xlsx you like.
Jacob
the easiest way is to use a linked table from the excel sheet which has the data - is there any reason why you have not considered this as an option?

Resources