I want to download this website
Abd i tried idm and httrack but didn't work for javascript content
http://websdr.uk:8074/
Anyone can help me to download this frequency streaming content,
Thank you
In order to capture the javascript actions, you'll need Selenium. It's a browser automation tool, used for Automated testing and data parsing from webpages.
https://www.selenium.dev/
Downloading an entire site is possible only if the website has static pages (HTML, CSS, Img). But Javascript-based content is loaded dynamically, which would be difficult to download.
Related
I have a couple of HTML files, some styles, scripts, images and videos. Is there a way to move them to Sharepoint online and have them work the same way they were working as an independent website?
YOu can Use the modern Script editor web part to embed the ASPX file (as I tested HTML files get downloaded as well), or add the HTML source code directly.
To embed a images and videos to a modern page, see this: How to Embed a Video to SharePoint Online Modern Pages?
I'm using js-crawler to crawl websites, and encountered now with CNN, that part of its landing page links are inside (urls that are generated dynamically, for some reason).
Thing is crawler don't really touch scripts - how should I address it? should I write my own code in addition to my node.js crawler? is there advanced crawler that knows how to handle this dynamic behavior?
Making my comment into an answer:
Crawling content that is generated by client-side Javascript is a complicated problem that not even Google has fully solved.
The only way to truly do it is to use some sort of head-less browser that is safely sandboxed on your server where the page is loaded into a browser-like environment where it can run its own scripts and generate its own content and then you can examine the resulting DOM.
Even then, it won't necessarily generate content that requires user interaction (like clicking on a tab to show some content).
So I've built the main functionality for an extension already, and have it uploaded as a web page on my server. I'd like to have it interact with any page a visitor goes to though and not just my page on the server. It's just the HTML/CSS/Javascript and jQuery.
I've been reading the documentation, and it says/implies I need to use a content script. I do have this script included as a content script as well though, however I'm probably doing it wrong. Mainly looking for some guidance/direction as to where to go on this.
The extension is to be one that removes all images from a page.
The site is http://199.127.226.221/testsites/chromeapp/
This is the manifest file: http://199.127.226.221/testsites/chromeapp/manifest.json
This is the .crx file: http://199.127.226.221/testsites/chromeapp/chromeapp3.crx
You should supply the extension as a .crx file.
Also it seems you should specify desired urls for content scripts in permissions of manifest
I would like to create a shockwave file that can display a website with an internal webbrowser or something similar. The final target to display the website in a pdf file, but I think the only way to do this, is the swf trick.
I tried to find resources for this on the web, but found nothing.
UPDATE:
I am looking for a way to display a website in a downloadable pdf file. The website is only one html file fuelled by jquery and css.
Download SWF template for your website and edit it in macro media flash editor.
I would use a PHP script to create a PDF file (my choice for this kind of stuff is TcPDF, which has many example/how to scripts ready to use), and I'd put a captured image of my website in it; there are several websites offering this service for free, just google it, for example webthumbnail.org.
Disclaimer: I'm not linked to TcPDF nor Webthumbnail.org in any way, they are just the first examples that came into my mind.
I have this website which I frequently visit to lookup a German language word meanings in English. I want to save the text from each webpage I visit of the site in a json file by highlighting it. How do I go about doing this? Which api of google chrome extension should I refer to?
Also will a firefox addon be faster to learn and develop? I have some programming exp in html, JS and CSS.
If you just need to store data between browser restarts then take a look at LocalStorage API. If you actually need to create a file there is a FileSystem API, but it has its limitations and not very easy to use.
Chrome extensions are much easier to learn and create than Firefox.
I would use pure HTML5 web storage.
Its already been answered here:
https://stackoverflow.com/questions/1194784/which-browsers-support-html5-offline-storage
- or take a look for more reference in most HTML5 tutorials:
http://diveintohtml5.ep.io/storage.html
http://www.webreference.com/authoring/languages/html/HTML5-Client-Side/
http://www.w3schools.com/html5/html5_webstorage.asp