Data import from new reports and automatically update existing records in existing data - excel

I seek expert advice of all of you in accomplishing my work related task.
Task : Task it to perform Analysis on reports obtained to WorkSafe Monthly and weekly and getting valuable information out.
For example :
Number of injuries on monthly basis drilled down by department and divisions.
Total days lost in year
Count of type of claims
Possible return date.
So i receive these reports and i add some modified columns to it. Like Correct employee names and their ID's just to create a relationship between Employee database in Powerpivot so that i could get their position, dept and division.
Now every month in new report there could be 2 or 3 new claims added to it, and some existing claims with updates info. like Updated return to work date, Short term disability days etc.
Currently i go through them manually and it's really time consuming and tiring. if there there was older claims weren't getting updates i could've just imported from a folder using power query and added steps to remove duplicates. However, if i remove duplicate claims using powerquery now, basically i'll be removing same claims with updated info.
Could anyone you here suggest an efficient way to do it with power query or with other approach?
Thanks in Advance. I'd appreciate your time and effort.

If you use PowerQuery and select your source From File -> From Folder, when you choose to combine and edit you will get a table with its first column named Source.Name; which you could use to differentiate the updates.
For instance: If I start with two excel files in the same folder (theoretically, they could be different date source files for you)...
WS1.xlsx:
WS1 - Copy.xlsx:
Then I use the folder they are both in as the source...
(Navigate to your folder as appropriate.)
...and select Combine & Edit...
...and select the worksheet...
Then I get this:
...and it is clear what information came from what source file.

Related

MS Excel Data for CRM Upload - Merge Comments from Multiple Rows into 1 Cell on Multiple Lines and Maintain Comment Creator and Associated Contact

Overview:
We’re in the process of switching to a new CRM. Importing Contacts and Companies - Easy. Importing the notes associated with those Contacts - Not so easy. For reference, there’s over 100,000 Contacts.
The Problem:
When I export Contacts from our old CRM, I get a .csv file that includes all Contact info and Note info for that Contact. Every Note that was created for a Contact is logged on a new row that includes: Contact First Name / Contact Last Name / Note Author / Note Create Date / Note. This is what a current export would look like:
Current .csv Export Example
This means that if a Contact had 8 Notes in the CRM, this Contact is duplicated for every Note.
If I upload this file to the new CRM, this contact is created 8x in the new CRM. Meaning I would have to merge this Contact 8x to merge all notes into one instance. This is clearly isn’t a sufficient solution.
What I’ve Tried:
I figured out how to combine comments from multiple rows into one cell on multiple lines using a =TRUEJOIN formula.
Ex: =TEXTJOIN(CHAR(10), TRUE, U12:U18)
I also figured out how to merge and combine data from 2 cells using a =CONCAT formula. 
Ex: =CONCAT(TEXT(R4, "mm-dd-yyyy h:mm AM/PM")," - ",S4,": ",U4)
Goal:
What I’d like to do is identify the duplicate names, merge the Notes for that Contact into 1 Cell on multiple lines, while maintaining Note Creator and Create Date per comment. So I would have 1 Contact with all associated comments loaded to the new CRM. I would like to achieve something that would look like this:
.csv Example of What I Think it Should Look Like
I need help with a formula that would:
Identify duplicate names and remove all of the duplicate data from comment rows while maintaining the separate Note Creator, Note Create Date, and Note associated with that Note Creator.
There’s over 100K Contacts so conditional formula seems like the only way to achieve this.

Reconciliation between Sharepoint List and monthly excel file uploaded to Sharepoint

I am quite new to power apps and trying to determine the best course of action for my below scenario. I want to identify which users submitted to List A and which haven't based on each new monthly file.
I have a List(List A) on Sharepoint I created where users go in and input information, I want to come up with a list of users who have submitted to this list.
I want to reconcile with this monthly file excel that is dropped into a sharepoint link by another user with updated information. So essentially it would be doing a Vlookup into List A to determine who has submitted a record. .
So what I have done:
Created List B manually (from the excel file dropped)
using Power automate/Flow do a vlookup from List B to A whenever a record is created in A.
I created a column in List B that is not within the standard excel file (Column name Submitted, answers would be either Yes/No based on the vlookup) , Vlookup is something like if A.ProjectID = B.ProjectID then B.Submitted = Yes otherwise No.
Problem:
What are my options to get around the fact this file is uploaded monthly? I dont want to recreate List B each month and have to setup the "Submitted" Column each time. I want this to work in an automated fashion.
Some Questions/Ideas:
Is there a way I can overwrite List B and keep the "Submitted" column each month automatically? It is dropped into a new folder each month on SP. ie "Aug 2021" , "Sept 2021", etc.
Can I do the recon in the sharepoint excel file itself automatically each month? Ie When the excel file is created run a macro to create the new column and do a vlookup?
Can a 3rd List be created as some master tracker page to hold all project status'?
Any ideas or suggestions are welcome. Looking for the best way on how to do this. Thanks
I think you should approach this from PowerAutomate.
I'd start off by creating a flow with a SharePoint trigger to catch when the Excel file is uploaded.
You should then get the content from the Excel with Excel Online / List Rows in a Table
Use 'Apply to Each' to loop over each user in the table. Inside the loop do the lookup.
Write back the result to the Excel with Excel Online / Update a Row action.
I'd recommend you create a separate thread for the project master list problem and elaborate your goals thereto.

How to create a List Price Sheet filtered with Last Date Modified column in Dynamics-NAV

I'm trying to generate a List Price Sheet report using the Dynamic NAV gui, which is located under Departments > Sales & Marketing > Inventory & Pricing.
Under the Reports and Analysis there is an option called List Price Sheet, which we use to create the price lists as Excel Files.
What I would like to do is to return only items that has been created or modified during an specific year, instead of having a list of all Items in the ItemCard.
When I add the Last Date Modified as a filter, it does not matter what value I enter, it keeps giving me a warning saying...
One or more filters are not valid and will be ignored. Do you want to continue?
Is there's a way I can accomplish that using the GUI or this is something that needs to be done with a custom function?
this "List Price Sheet" is not a standard report (NAV has a standard set of reports for every modules) therefore we can't help. You should contact your (=your company's) NAV partner for help.
Maybe if you can share the warning/error what you getting when entering the date I can help. Here is a link which maybe helps : Entering Dates and Times in Dynamics NAV
Cheers!
Sorry I did not provided more depth information, the problem was, that I was trying to search as string the value "2015", which is not a valid parameter to pass when searching a DateTime column. I have to search using a Date range, cause I wanted to get the result for the specific year 2015, in my case, the value I should've pass was:
01/01/2015..12/31/2015
Which return all items that has been modified during this specific year. After doing that I found out that every time NAV developers updated the production site with the test site, all items were marked as modified the date the update occurred. So was not of use for me any way.

how to call and sort data in a view?

I have two view, one is sorting 2011 data and the other one is sorting the 2012,
2013 is coming and I think, create another view is not good. Then I tried to code a formula to call the data in my database and send to view but it's not working .
please help me :)
I think your best option is to create another view. Notes doesn't do well with dynamic view selection formulas.
Another alternative to consider is to use categories to group data by year. You could then set up an embedded view that shows only a single category, which could be determined by a drop-down field that shows the available years.
A solution I have used when dealing with weekly or monthly date is to use an agent to create a new folder every week and to put the correct documents in the folder. But this is a lot of work and if there is a high volume of data you can run into problems with some of the internal limits of the Notes database structure. Someone with expert level knowledge of Notes can probably manage this, but I do not recommend it as a general solution -- and certainly not for yearly data.
Adding a view once a year is really not that bad. It's two minutes of work every 12 months, just copying and renaming the previous year's view and changing the selection formula.

Need to delete old SKU# and enter new SKU # onto a master sheet

This project keeps throwing new and exciting things that I am having a good deal of trouble with.
I am hoping that there is an easy solution but I am starting to suspect it may be a macro problem.
What I have is...a master list of products, 10,000 of them. It is now end of season and we are moving a range of products to a discontinued section.
So what I need to know is how can I delete all the SKU's I need to...and then as an added bonus feature...add the NEW SKU's for this season into the master list.
What I am hoping to do is create something that when we have to do this again in six months...we dont have to enter the data individually and just add a discontinued list...and a new list and it will auto update the main list.
I will have to add SKUS and the data they contain and my only knowledge of this is using Vlookup.
Thanks.
There are a lot of ways to tackle this, but you haven't given enough info to get a specific answer.
For example, if you have that list of discontinued product numbers somewhere, you could easily run a vlookup formula against that data source to the master data source. Then, just sort out the stuff you want and delete it or move it or whatever.
It also begs the question of why you have a 'discontinued' section. I loathe 'sections' in a database. If it's a real DB table, there shouldn't be any breaks anywhere....you'd deal with 'discontinued' versus 'active' with an additional field (column) and mark things as such there.
If the table and the data is organized well, you can easily do these tasks you are talkign about.

Resources