Web Scraping into Excel - excel

I would like to create a spreadsheet that I can refresh and pull in each weeks English premier League fixtures, each week I would like to refresh this and see the weeks future fixtures. I have tried to use the import function from Data/From Web and selected the box with the table of fixtures however no data gets pulled into the spreadsheet.
The website I am using is - "http://data.7m.com.cn/matches_data/92/en/index.shtml"
I am open to understand a better way of doing this import and also if there is a better website to use I am also happy to change. I have chosen this one as it seems to have the most simplified listing of the fixtures.
I have also tried this website - https://www.premierleague.com/fixtures
When the import completes it actually skips all the fixtures and returns all the other information.
Should i be looking to some of the HTML elements within the script of the web page to extract the data?
For example on the following site - https://www.premierleague.com/fixtures I am looking for a file received by the website that updates the fixtures each week (after some direction from Google) I hit the F12 command and look within the "Network" tab however I cant understand how the website, this or the others quoted create the weekly fixtures.
Any suggestions on how to pull this into Excel or another tool would be fantastic.

Welcome to [so]! it sounds like you haven't done as much research as you could have. Your first link, in the top corner has links to "Free Feed" which take you to customizable widgets and from there is a link to a customizable live template.The first page also has a link to "Data" , I'm not sure what that consists of or whether it will help (since I'm not much of a sports fan on my continent, and even less on yours!
As for importing into Excel, I didn't have an issue with the table I could see, but once again I'm not clear on what data you're trying to get and what you want to do with it.
On the ribbon's Data tab click From Web.
Enter the first URL from your question and hit Enter
When the Navigator window loads, click "Table 1" and then click Load.
Below is what Excel then automatically loaded as a table:
If instead of clicking Load, you were to click Edit then you are brought into the Power Query Editor, where you can customizable tons of stuff. The one I was interested in was Use First Row on Headers. After choosing that, and clicking Close & Load, and 30 seconds of formatting later I had:
With Power Query you can choose, remove, split, or combine columns from this or other tables. It's fairly advanced but you should be able to find a good Power Query tutorial online, to see examples of what you can do, to learn about other ways you can customize the import and/or analysis of the data.
Edit:
More Information:
Here are the instructions for all versions:
Office Support : Connect to a web page (Power Query)

Related

NetSuite Saved Search Print Criteria Information

I would like to be able to print the Criteria information that I used in the footer of the PDF of a Saved Search. I have tried looking at making an Advanced PDF to handle this, but I cannot find the field to pull in the criteria information into either the Saved Search or the Advanced PDF. Any assistance would be greatly appreciated.
Edit: I have created a Saved Search in NetSuite that displays all of the Inventory Receipts made the previous week. We have to print this Saved Search and check it against the actual paper receipts to verify counts and receipts. When the Saved Search prints to PDF it does not show the criteria information for which the Saved Search was run to prove to Internal Audit that we have run this report for the correct dates. I would like a way to print the Criteria information for this Saved Search along with a timestamp of when the Saved Search was run and the users that ran the Saved Search. Is there a way to pull in this additional information in a Saved Search or Advanced PDF somehow?
add a custom Print button
button goes to a suitlet that renders the PDF
before you render, load the search and pass the search.filters in to addCustomDataSource() api of the render module
Ok, I read your edit and comment with regard to my comment. There's three big things here.
I don't think you should pursue a dev route with this. You can schedule the report for automated email once a day and prove that it came from a saved search which is the same saved search every time. This will save you an infinite amount of hassle
Developing this as your first script is going to be hard. I'm happy to help. But when I tell you it's going to be a lot of code, I mean it. See this old post I did https://stackoverflow.com/a/61066928/11323304
If you still want to pursue a dev route with this (which is totally fine), start with emulating the user event code on a custom suitelet like I posted above in my answer. You're going to need N/serverWidget/ui N/search and N/xml. The rest is all in the UserEvent functions and global context variable.
If all this still goes well over your head. Don't sweat it. Comment back, and we'll build something step by step. But, I highly, highly, highly encourage you to check out the automated email capabilities of NetSuite before trying to develop something special.

SharePoint Online chart

I would like to display a graph on the home page of my sharepoint online site. I can add in a quick chart but it does not fit my requirements.
Basically, I have a task logger where i log all incoming tasks, they are assigned a status - closed, completed, in progress, on hold, and pending.
I would like to display this visually on the home page so we can see how many tasks per status.
I think the x axis would the status and the y axis would be the value.
I'm not sure how to achieve this? i've seen multiple examples of coding for this but being inexperienced in coding, i'm not sure how to amend or adapt the codes for my requirements.
If someone could please provide a solution or have any ideas, that would be greatly appreciated.
We can use the solution below from GitHub to achieve it.
Modern Charts
Or we can use modern script editor web part with chart js plugin and REST API to achieve your requirement.
In classic site page, we can use script/content editor web part with custom JavaScript code to achieve it.
If You don't plan to code the solution I would suggest two different then quick chart webpart approaches:
File Viewer webpart - You could create some excel file to store all Your task list there. This file could be stored on some document library. The excel file could have data in one tab and chart in other. Using File viewer You could add this excel file on any SharePoint page. On one Page You could present the tab to change data (tasks), on other the tab that has the chart. I know..a bit of a workaround but this is one of the simplest solutions I thought of without coding :)
Power BI- this tool for sure may will fit any needs as in this tool You may do almost anything. Of Course You need Power BI server for this. You may create any chart/report with this also from data taken directly from SharePoint
Hope this will be of any help to You

Pulling data into Excel from multiple pages

I’m currently trying to pull data from an internal website. However, a few challenges stand in my way. For clarity, I’ve attached a screenshot of the interface I’m working with. I’ve removed all of the text and added my own references for confidentiality purposes.
The data I need to pull is in Tab1 > TabD. I then apply a filter to it (not sure if that’s relevant here). In this example, there are 16 pages and it is these 16 pages of data (headers 1 to 5) that I need to pull into an excel sheet.
There’s no API for this and the page number doesn’t change in the URL so it can’t be used (to my knowledge).
With all these conditions, is this even feasible with VBA?
Thank you all for your time.
I WOULD just comment on this. But I don't have enough reputation to do so. Come on StackOverflow, I want to help people! I'll leave an answer instead, though I may need more information.
I am assuming this is done in Internet Explorer. In which case if you press Ctrl+U you can bring up the source for a page. Bring up the source to the page shown in your screenshot. You'll need to look for a javascript button that changes the page, which is the tricky part. The syntax for such a button in javascript looks like this:
<button onclick="functionToRun()">Button Text</button>
The button in the example above runs the function "functionToRun." Once you find the function that changes the page, insert it into the VBA line below, once you have IE properly initialized in your script:
Call IE.document.parentWindow.execScript("functionToRun()", "JavaScript")
The line above runs the JavaScript function in IE, effectively changing the page.

Suggestions for a custom web part in SharePoint 2010

I have a list created for the purpose of displaying news. So, the columns are: Title, Content and Created. For example, I'd like the list to let people know when there is a server outage planned.
What I want for the functionality of the web part is to display the title only and only the month/day the news item created in the list. I'd like a picture of a small arrow in the front of the items also (left side).
Example:
"
News Web Part
=> Server outage planned for this Saturday (06/23)
=> Server updates today (06/22)
"
I would like the user to be able to click on the titles of these items and it will go to a page that gives more information (Content column, rich text), instead of pop that AJAX window like what happens by default when you click on a list item.
Does this require Visual Studio? If not, is something like this possible?
Thank you!
I would recommend making a list to store the information that you want to provide to the end user via the SharePoint UI. Once you have your list create a view, Order it by most recently created and limit the number of items displayed to as many as you wish to display to the user.
Add a list web part(XSLTListViewWebPart) and point that at a view you have created.
This will give you something pretty basic visually.
You will then need to look in to XSLT to apply a style to that web part. There are loads of articles on google of how to do this.
You do not need to do this in visual studio, I sometimes just use notepad ++ for small things like this. The above should be enough for you to get started.
Cheers
Truez

Excel web query providing the incorrect table

I am using excel's web query feature for the first time. The site I am using it on is here. I put a check mark next to the table TTM Yield Load etc.. I click import, but a different table than the one I selected is produced in excel. It's one far down the page. What am I doing wrong?
After further reflection, I discovered that it is the dynamic nature of this web site that appears to be causing some trouble. I have opted to use selenium for vba and so far the solution has proven to be effective, yet slow. If anyone out there would like to offer some other avenue to web scraping dynamic pages using vba for excel, I am all ears. Thanks.

Resources