I have an excel file that collects data from multiple txt files into connected individual tables (1 table per each file) as connection only tables. I have done this because some of them contain >1m tables. In excel, I have appended those tables using Power Query/Apend function. I need to create a new table that contains all the data, however the resulting data is >1m rows, and I can't load it back to excel.
Is there a way to load my connection (summary of all tables) to access?
When I try to do that using import function in access, it does not recognise the connection as a table so I am not sure how to do this.
Thank you,
Load it to the Excel data model which doesn't have a 1m row limit.
You cannot load from PQ to Access (nor would you want to).
Related
I need to delete query steps after loading the data into model. The reason is to hide the sources, protect our know-how, or maybe I'm just not very proud of what I've done ;).
But when I delete PQ connections or change "Load To" option, also the tables disappear from data model and pivot table becomes unresponsive. It's also not possible to modify or delete the connection created in Power Query from Power Pivot window, or even view table properties.
I could use Review > Protect Workbook > Protect Structure to disable viewing and editing queries / connections, but the steps are still visible, and the user cannot modify the workbook; even pivot table drill-through function doesn't work as it needs to create a new sheet to show data rows.
If you need to remove the query steps, then you have to store the data within the Excel file (since a query is just a set of instructions for how to connect to the data and transform it).
What you can do is create a query, load it to a table in an Excel sheet and then delete the query, leaving a static table. You can then create a pivot table using this static table as the source and it should function normally (though you obviously won't be able to refresh the data). I.e. don't create a data model until you've loaded your data and removed the query.
I have an Excel file that contains a few Power Queries from other local workbooks.
Is it possible to save the file in a way to include the actual data of the queries where my users wouldn't need to have the other local workbooks for it to work? Essentially, creating a snapshot in time?
If you mean raw data, it's not possible - Power Query queries don't keep external data. But, of course, you may save results of queries in various forms (flat tables, pivot tables, data model).
I have around half a dozen Powerpivot files containing data extracted from an SQL database. Each file has around 30 million lines of data in an identical format. I do not have access to the underlying database but each powerpivot file contains the data.
I would like to connect to all of these files in one new workbook using Powerquery so that I can append them, add them to the data model and work with them in Excel.
I have found various solutions on how to get the data into CSV format using DAX studio but I would prefer to avoid this as it seems an unwieldy solution to export hundreds of millions of lines of data to CSV and then import it back to Powerquery when I already have the formatted data in Powerpivot.
I also don't have any experience of using SQL so would prefer to avoid that route.
I've tried creating a linkback as described here https://www.sqlbi.com/articles/linkback-tables-in-powerpivot-for-excel-2013/ but when I connect to this it only returns 1,048,576 lines of data (i.e. what Excel is limited to).
Is there an option for Powerquery to use Powerpivot data in a separate workbook as a source or another straightforward solution?
Thanks
You can either materialise the data (which you've tried, using Linkback tables), or you can copy the queries. There's no other way to reference powerpivot model data.
I have a ton of records across 5 different tables in Access that I'm consolidating in one query.
I want to now be able to connect that query to excel and pivot the data that is in the query. Is that possible? If so, is there a way to do it without added VBA? I was thinking of slowly exporting the consolidated data into a new table in access but with over 7 million records, it'll take some time. Anyway to save myself that headache? When I connect the DB to excel, the only tables that are coming up are the 5 tables and not the query.
We use a MS Access database which has a linked Excel table. This Excel linked to a SQL database report. From this Excel file we load the data to an internal table of the Access database. The loading process is the following:
run a delete query (this delete all data from internal table)
run an append query which loads the data from excel to the emptied internal table
These two steps cause the file size to grow (~1150 kb/running) even though the amount of data does not change after loading!
Because of this, we need to compact and repair the database frequently.
How can I stop this growth?
Don't import the file.
You have it already linked, so create a simple select query with the linked file as the only source source, and use this to filter and convert (for example text dates to true Date values) the data and create the expressions you may need to proceed.
Then use this query as source for your further processing.
If this is not possible, (re)create a temporary database from scratch, fill a table in this, and link this to your main database.
That said, any Access database will grow when used if it is not write protected. This normally causes no harm.