big data base problems using clasic pivot table in excel - excel

If I've a data base of 600M lines in excel and everytime i try to use a pivot table in clasic mode excel just broke, now I'm trying to split the data in 4 or 5, but don't know how to combine the data in one pivot table so I'd filter it with a common characteristic

Related

Extract data underlying Excel pivot tables with many records

I have an .xlsx with a pivot table but not the Access database that it links to. However, I believe all of the "raw" data underlying the pivot table is in the cache somewhere within the spreadsheet. My end goal is to create a CSV with the raw data. The issue with double-clicking the 'totals' row is that I'm limited to 2^20 (~ a million) rows, and the data has around 8 million. I'm currently manually filtering on a specific field foo in the pivot table then double-clicking the totals rows for each value of foo. Is there a more elegant way to do this?
As far as I know, it's not possible to save data directly from the PivotCache into a CSV. Looks like you'll have to dump the data from Access.

Is Power Pivot Multi Dimensional?

I created a multi dimensional pivot table in Excel and then used the following add on to generate the MDX: http://olappivottableextend.codeplex.com/releases/view/618637
The MDX was generated by Excel as follows:
SELECT NON EMPTY Hierarchize(DrilldownMember({{{DrilldownLevel({[Customer].[Customer Geography].[All]},,,INCLUDE_CALC_MEMBERS)}}}, {[Customer].[Customer Geography].[State Province].&[New South Wales]&[Australia]},,,INCLUDE_CALC_MEMBERS)) DIMENSION PROPERTIES PARENT_UNIQUE_NAME,HIERARCHY_UNIQUE_NAME,[Customer].[Customer Geography].[State Province].[Country-Region],[Customer].[Customer Geography].[City].[State Province] ON COLUMNS , NON EMPTY Hierarchize({DrilldownLevel({[Customer].[FullName].[All]},,,INCLUDE_CALC_MEMBERS)}) DIMENSION PROPERTIES PARENT_UNIQUE_NAME,HIERARCHY_UNIQUE_NAME ON ROWS FROM [Adventure Works DW2012] WHERE ([Measures].[Sales Amount]) CELL PROPERTIES VALUE, FORMAT_STRING, LANGUAGE, BACK_COLOR, FORE_COLOR, FONT_FLAGS
I then opened the Power Pivot windows and copied and pasted the MDX. It generated a two dimensional data structure.
I realise that Power Pivot is available because of the max row limitation in Excel i.e. it can deal with more rows. Is Power Pivot just a two dimensional data source? i.e. it is used to get all of the data into one place so that a standard Pivot Table can be used to analyse the data from a multi dimensional perspective?
It is the pivot table which is using mdx. Pivot tables came about around the same time as olap - they use the same technology. I think even if we create a pivot and point it at a server-side tabular model then the xl pivot will still be talking in mdx.
So the pivot table needs to work with mdx irrespective of the data source.
Power Pivot and Tabular models use a language called DAX. Tabular uses analysis services but is different from multi-dimensional .... it is tabular

sending a table of data in Microsoft Excel Power Pivot including all calculated fields back to excel as a linked table

I have used Power Pivot to create some calculated fields from a table of data.
Then I use the modified table, with the calculated fields to create some pivot charts back on the excel workbook.
In the same way I linked the original dataset (excel table) to Power Pivot, I would like to link the table in powerpivot with the calculated fields back to excel. Is this possible?
yoshiserry, the best way to share PowerPivot stuff is PowerView (Excel 2013). If you want to share just the table, regular Excel file should be fine -- people even without PowerPivot installed will be able to work with it (with some limitations).

Is it possible to filter data used by pivot table based on filtering the rows in a source table in Excel?

I have developed a dashboard in Excel 2007 that uses one source table in a sheet (being filled with a query on our data warehouse) and multiple pivot tables making different cross sections on this data.
I use the GETPIVOTDATA in almost a hundred formulas to give me the right value for a specific indicator in my dashboard.
This all works fine. However I now have received the question to make the dashboard for 5 different segments. As you can imagine I don't want to create 5 different workbooks for this and need to maintain the dashboard logic on all of them.
So my question is the following. Is it possible to automatically (through VBA or any other means) filter the results in my source table which is the source for my pivot tables and thus for my dashboard values.
So schematically:
DATABASE_VIEW --> SOURCE_TABLE --> 12 pivot tables --> 100 GETPIVOTDATA functions
Preferably I would like to load all the segments in the source_table (one view on my database) and then filter the data in the source table, which results in filterd source_dat for my pivots. This way I can (without requerying the db) quickly change between segments in the dashboards (refreshing pivots only).
Data in the source table has the column: CUSTOMER_SEGMENT available to filter upon.
Any help is appreciated.
Geoffrey
You can manipulate all external data connections and internal pivottables through VBA.
To make it a double learner for you I recommend using the Record Macro button and then changing a filter in your pivot table and also change your SQL query a bit.
You will now see that in the recorded macro the related properties of that Pivottable/query are stated. Filters and SQL are simply Strings in the VBA code, thus you can alter certain bits to get different filters or "WHERE Cust_ID = " comboboxCust.Value kind of things.
Doing it through VBA codes to change the filters and SQL is usually more speedy then having it all interactively related with the standard Excel tools (Functions, parameters, linked filters, ...)

How to add data to an existing power pivot table?

I'm looking for a way to load more recent data as date x in Power Pivot and link/add them to an existing table.
Background:
The user downloads data from a datafeed and saves them in Excel Power Pivot.
The data will be deleted from the server afterwards.
In the next step, new data must be added to the existing table in Power Pivot,
so that the workbook graphics can access the complete dataset.
I know there is no API for VBA access to Power Pivot. Is there a
workaround with linked tables and direct access to the database?
1) you create one table just containing the dates from earliest to far into the future
2) you import every new set of data into a new power pivot table
3) you link the dates for a record in the newly imported table to the dates in the power pivot table containing the dates
so the backbone of your whole data is the dates table, while your tables keeping the actual data are treated as lookup tables.
this is hacky and I didn't try it, but it should work

Resources