I have a website and a chrome extension. The extension is scraping data from whatsapp. On website I want something like that if someone visit website there is a button to scrap data. When someone click on that button I want the data to be scraped from whatsapp and displayed on my website. How can I do that. Please answer that question.
I want to scrape data from whatsapp by clicking a button on my site
Related
I have no knowledge of networking and programming. So I will describe what I do and what I want to happen.
I open a browser (for example, Firefox or Google Chrome).
Open the developer menu with the F12 button.
I load a link to a given site in the url bar.
In the developer menu in the Networking tab there is a response with status code 101.
After each click of a certain button on a site, a new row of data appears in the list of web socket messages on response 101.
I can see the raw data for each click of the button and I can copy this data. But I can't copy all data for all button clicks at once.
My question is - how from the response with status code 101 can I copy or extract from a browser the data that the server returns after each click of the button?
[FOR ADMINS]
I don't know if this question is appropriate for this site. If not, please admins move it.
I don't know if the tags I put are correct for my question.
I apologize for my bad English. I use google translate.
Is there a way to get data from other pages? I mean when you open specific page, the script runs a search on the web to look for data and then you insert that data into the loaded page you loaded before?
Example would be say you looking to buy a chair, you looking at one seller web page but the extension looks up prices from other sellers and shows a graph or values, then you click on the value to go to that other seller page.
From what i understand you can manipulate DOM of opened tabs, but is there a way to load DOM from another page that is not in the opened tab?
I have a scraping project I threw together with scrapy in python. Now I've come across certain data that are only loaded onto the page as a user scrolls down. How do I emulate this in my scrapy spiders?
Inspect the page (Press F12) in Google Chrome or similar.
Click on the Network tab.
Scroll down on the page until you the new data is rendered.
At the same time the new data is rendered in your browser you should see a new file pop up in the inspection panel.
The file could be anything depending on the site but most of the time it's JSON.
Click on the file in inspection panel and copy the Request URL.
Back in scrapy you can send a request to this URL the get the dynamically rendered data.
I'm on the web page with the url=x
The url of that particular web page doesn't change after giving my preferences(like selecting options,..) or after clicking the button on that web page.
Problem:
Before performing the above mentioned actions i will not be displayed with any data; but post actions the web page displays the data.
Context:
I'm trying to scrape data from a web page using python
And i'm struck at providing the request_url with the above mentioned specification
if i'm providing request_url=x it is fetching no data because i have provided no specifications
How to provide those specifications while requesting with the url?
kindly address the specification of pressing the button also
Sounds like you're trying to scrape data through real navigation actions, like filling form data and clicking on buttons and/or posting some data, considering whatever javascript scripts contains in the page, but you don't have the specifications to post the data.
My approach would be automating a real browser using selenium, finding the button via xpath or id and calling a click function to it.
driver.get("http://www.google.com")
# Assume the button has the ID "submit" :)
driver.find_element_by_id("submit").click()
I want to have a text in the hyperlink without showing the HTML tag.
Other than editing Watson Conversation
"The link to go to Temasek Poly is: click https://www.google.com.sg\">Google."
Other than showing in the web application, can I show in facebook messenger?
I tried in facebook messenger but cannot, why? how can I do this same matter and can apply in facebook messenger
Facebook does not support your example, just paste the URL that you want to send for the user, like:
Search about this on https://google.com.br
And then, Facebook will transform in a hyperlink.
Done a lot of research on this...
Facebook doesn't seem to support the usual codes which create
hyperlinked text (e.g. "Click here") that links the clicker to your
specified external website. for now, you can only attach a link in
it's full form (e.g. "www.blahblah.com")
Reference: Facebook forum here.