Screen scraping a separate program - excel

I have this application called IRESS that has data that I then manually copy and paste to a spreadsheet to do certain calculations. I was wondering if there is any possible way of automating this process.

There is a web services interface to IRESS which you can find more about here. So if you send a correctly formatted message to IRESS, it will respond with a message containing the data you requested and you can then update your spreadsheet with that data

Related

Is it possible to get data from a webpage in real-time to an excel file?

I would like to create an Excel Tool that would act as a Monitoring Tool for our agents on the floor.
Right now we don't have an exclusive WFM tool that would monitor and call out agents with their activities and productivity, the only thing we have is a dashboard to view all agents status and the durations of their status or calls. This is a web-based viewer of our dialer that would only shows agents with their current status but they won't trigger or notify if an agent is going over our set thresholds for their wrap up time, over breaks or lunch.
Currently, I have an existing excel file that would look up values from another sheet to populate the table with information that I need such as the name of agent, their current status and current duration of the call.
The another sheet I've mentioned above is a blank sheet where I would simply paste all the data from the webpage of our dialer. So basically I am just doing copy-paste method where I am selecting all the contents from this webpage which is our dialer and pasting it in on the blank excel sheet that I created and the table that I made will find all the values that I setup from that blank sheet.
I really don't have enough knowledge but I still tried Data>Get Data>From Web and I am not getting anything.
I tried pasting the web link, but I don't seem to pull up any data.
I know as I've mentioned, I don't really have enough knowledge and maybe I need some basics doing this method.
What I would like to happen is if there's a way to link a webpage, sync its data to an excel sheet and is it possible to make it real-time so that way I can have an improvised WFM Tool that would help me monitor our agents activities?
Thank you in advanced!
Getting data from the Internet through a standard mechanism (Data >Get Data > From Web) is not always successful. Excel can recognize tables on a web page, but not always in the way that the human eye recognizes them.
Actually, there are two options here:
write a macro that parses specifically those pages from which you are currently getting data manually (“…I am just doing copy-paste method…”).
prepare web pages so that data from them can be automatically downloaded via Data >Get Data>From Web via standard Excel functionality.
Both require programming specifically for your task.
For example, I could write a parser, but for this I need access to the web page from which you are copying and pasting.
Or the programmer who wrote the web page can create new pages with the same data, but in a format that Excel understands. But this programmer needs to specify exactly how to design web pages.

What is the best way to work with manually Excel collected data from different sources?

I have been tasked with creating Power BI KPI reports and the data to feed those reports comes from different sources and is collected manually.
There is one person responsible per KPI. That person collects the KPI's data monthly and puts it in an Excel file. Then, that person sends the xlsm file to another person, who is responsible of organizing multiple KPI's into one Excel file. Ultimately, that person sends it to me and I use that xlsm file to create the report. The same process goes on per area of the company (6 in total) every month.
As you can see, there is a lot of copy/paste going on which can indice errors.
What is the best way to approach this?
I can't comment, so I will explain here what I think you can do.
I will ignore the collecting of data by person responsible per KPI.
You can use a database connection, using plugins or VBA, to send the Excel data to a database. Create a VBA Excel file with a script to send the data to a database and there you can do whatever you want. The most important thing that you need to do, is limit the 'columns' of data that Excel will have, or find a way to get the data directly from the source, using an API or whatever you find.
Another approach is creating a web form to send data directly to you, but i don't know if this is possible in your case.
It's the only thing I can think, given the limited options.

How to send data to Excel function to modify sheet via interface?

I have a team that has to collect data outputs from various inputs (all the data will have the same format). They collect this info in a notebook, and then input it and format it in Excel. I want them to be able to input this info from tablets on an interface, maybe a web page via a POST form, maybe a Excel form, maybe use SharePoint; and send it to the Excel sheet, and format it to match the current format.
Is there a way to do this? There will be multiple people using the interface at the same time, I don't know if this is going to be a problem.
Thanks in advance!

Trying to access data from a google forms gsheet, from a local Excel sheet

Yes, similar questions are all over this site. My issue is the responses on the Gsheet contain info that would GDDPR relevant and so can't be published for public access.
I need a way to read the data without giving access to anyone who manages to find the sheet online. I have tried to sync the gsheet to my local Google Drive, however, I don't know how to access that data from excel without manually converting the gsheet.
The reason is:
I have a consent webform, users fill it out, it takes their email address. I have an excel VBA module that will loop through the email address, check the date the were provided and send an update to each user when so many days have passed. the excel sheet will be run each day at close of business.
I need to either read or copy the data from the gsheet so I can run my mailer code. How do I do this, from within Excel? The Person using this is not savvy enough to be manually importing data, I want them literally to open excel and push a button. So I need my VBA to go to my local google drive, and either copy over the data from the gsheet or read it in place and get the email addresses it needs.

NodeJS monitor for Google Forms submissions

I am trying to set up a NodeJS application that monitors for new responses on a Google Form so that they can be displayed on a dashboard.
My original idea was to use the responses spreadsheet, but I can't find a way to convert it into readable JSON. The next problem is identifying which responses are new. The storage of the app is very very limited and having a copy of the spreadsheet is out of the question. What I wanted to is just ping the table every 1 hour and if there's a new response, run some code to print the data.
I am open to any ideas or suggestions!
You can maintain a counter in the app, or in a shared file/database. The counter will point to number of rows seen in the spreadsheet. Next time you query the spreadsheet, you'd know rows after counter are new.
As per extracting the data, if you have the sheet as a file, you can use some package like xlsx to parse the sheet into JSON. If not, then you can fetch the spreadsheet from Google APIs in JSON format.

Resources