Creating tables for clean Data - python-3.x

let me start out by saying I have a basic understanding of python and excel. What I’m trying to do is take a CSV file with data points for voltages along side with date in mm/dd/yyyy in a separate column, and averaging the data points for each day into a chart. There’s roughly 10000 data points for the month each separated by 5 minute increments. I don’t know where to start. I also have to do this about 12 separate times so if I can just feed a program an excel file or data from notepad that would help me tremendously.
I’m a bit rusty with python but I can read it pretty well to figure out what does what. Any help would be greatly appreciated.
If I can do this all in excel then that would be amazing. But I would like to brush up on my coding. If someone can point me in the right direction, I’m using Jupyter notebook and excel for reference. I tried starting with just opening the file with open() but now I don’t even know where to begin. Should I install pandas? Selenium?
I tried grouping the data in excel manually by using group. I tried opening up files in Python and creating a list of values to go through and average them. I also looked into using pivot tables to group the data as well.

No coding needed for that. Excel pivot can solve it.
Bring your date column in a format excel understands as date.
Insert pivot from the range that contains your data
Drag the Date to lower left quadrant rows
Drag the voltage to lower right quadrant values
Change aggregation of values from sum to average
The result will be this table:

Related

Is there a way to create a dynamic bell curve in Excel?

I have a report that is generated weekly with productivity numbers for employees in Excel. I am wanting to create a bell curve for several data points where the viewer can select the week time range and the bell curve will be updated. I have figured out formula wise how to make the mean, standard deviation, norm.dist, etc update when the date range is updated. The issue I have yet to solve or find an answer to though is how to graph this data without having to manually update the ranges of the graphs. Once this is accomplished I'd also like to be able to add vertical lines for the average and 1 standard deviation on either side of the average. Is this a possibility in Excel or any other program? I was hoping to be able to use Excel, but am happy to explore other options if that's the only way to do it. Thanks!

Excel - A row in my Pivot table calculates sum wrongly only for some entries (same data type/format)

I created a tracker of learning hours in order to conduct an experiment.
For the purpose of the ticket, there is a time series that does not sum correctly data in Pivot table.
Some other tickets on Stack Overflow mention how to correctly sum. Here's what I tried:
considered blank spaces > the Pivot does not consider them anymore, yet the issue persist.
data type & format > the whole column is set for data type short date
labeling > I use to copy-paste the category for each learning and I double checked if there was no typo in them.
Here's how the file works. There are 3 sheet in my Excel file. The core of it is "Data" where I do track the time spent for each learning / exercise. The columns marked in red are the ones used for the next Pivot Table.
These information are consolidated in another sheet, called SuperLearner Review. I use this one to display overall learning hours by type and category. Numeric outputs here are looked up from Data (or calculated accordingly).
After several checks, I cannot retrieve the issue. All I know is that for February data are not tracked correctly.
Originally I attributed either to wrong data labeling or format, but I can manually see what is the real sum of learning done in February:
In the data-series those hours seem not to display. This is what the Pivot table returns instead:
Whereas, for the consolidated information (coming from the same source) does not seem there are problems in calculation:
When I tried to cancel and build up again the same Pivot Table, the same error occur. So I am not getting out of this wrong calculation. Therefore it must not be a problem of calculation, rather than Excel does not retrieve some data entries at one point.
What would you recommend? Thanks for the help.

Does anyone know why my pivot table is changing a time value into a date?

[
[
I'm trying to make a pivot table that organizes the 15-minute time increments and shows average pedestrian count for each street recorded. I have been able to do this for smaller sections of the set but for some reason when I try to do the whole thing (about 288,000 rows), it will automatically add 'Years' and 'Quarters' to the table and instead of displaying times, it will just say "Jan, Apr, May, Jun".
It's worth noting that it still recognizes the 'dates' as a time because when I try to format it, it still says 'Time'. Is this just an issue caused by trying to work with too large of a data set? Any help would be hugely appreciated!
Working on Excel for Mac version 16.16.4
Thanks in advance!
The new Excel 2016 time grouping enhancements are here. You can read about it here - Time grouping enhancements in Excel 2016. If automatic grouping is not required, you can remove it by right-clicking on the time column in pivot and selecting Ungroup.

Excel vba to work out average score

the attached shows a small example of a scorecard i have at work for drivers, the list is many lines long, around 120 drivers, i export a report each week and it produces the attached, i have added code to tidy it up and work out scores. I then have to work out an average score for the week for each driver but can't for the life of me think how to do it using code. Any help would be appreciated.
Fill the empty cells with the respective driver names and then build a pivot table. No code required to calculate averages per driver per week. That's just a few clicks. Add more data and refresh the pivot table. No VBA. Just Excel out of the box.
You may not even have to produce the report in the screenshot, but start with the original data. Pivot tables are used for exactly that: aggregate, slice and dice large amounts of data.

Excel creating graphs for each row new

I have to make a project for biology.
I need to create 21 graphs. Each one for one row.
The graphs will be the same, but only changed data from in each row.
That's mean, If I have a table with 21 rows I need 21 graphs and only change value from each row.
You could literally create a set of graphs - one for each line if you wished however, this would be a fair pull on your processor so probably isn't the best of ideas.
If you are using Excel 2013, I'd have a look at the 'Sparklines' portion of the insert tab, where you can add a couple of different mini one line graphs.
Hope this helps

Resources