I have absolutely no experience using docker, but I'm trying to build a robust website scraper using Puppeteer.
Can I run it in a Windows Server 2003 environment running SQL Server 2008 R2 without having to go back and keep tweaking it later?
If yes, then how? Just as I would in a normal Node environment (i.e. NPM)?
I personally have no experience running puppeteer on windows, but I think you can do it connecting to a "remote instance of chromium" (in the same machine), the "browser" that launched puppeteer, this is the thing that have problems working in windows.
You can follow this examples to make this connection.
https://www.sitepen.com/blog/2017/10/04/browser-automation-with-puppeteer/
https://blog.rnsloan.com/2017/10/27/puppeteer-windows/
Let me know if this works.
Related
This is a general question, but I want to run my Selenium tests on a cloud Linux Server. I am accessing this server using PuTTY, which is just a terminal.
I was wondering how I could get my Selenium scripts to run on this VM.
Currently I have a Selenium Grid set up with physical machines, I just do not know how to set one up through a server where the only communication I have with it is through PuTTY and a terminal.
To run Selenium from a Linux server that is "terminal only", as you put it, is to install a GUI inside of the server.
The most common GUI to use, is Xvfb. There are plenty of tutorials out there on how to run GUI programs like Google Chrome and Mozilla Firefox through Xvfb.
You can also use PhantomJS to do a headless Automation, that doesn't need any GUI installation on Server.
I have searched the questions and have not found an answer to this one:
I am developing an existing project (git repo) that runs only on Linux. For the time being I have at my disposal only a windows laptop which I cannot modify. This laptop has Intellij installed and internet access. I cannot, for example, create a Linux VM on this laptop.
Is there a way I can put the project code on an Amazon ec2 Linux instance and build the project on that instance, while viewing and developing the code in Intellij? All compilation and code execution has to be done remotely, on the ec2 Linux instance. I cannot build locally and push from the windows laptop.
2 possible configurations might be:
(1) install intellij on the ec2 instance and x-window in from windows to view the intellij screens;
(2) use the intellij on the Windows laptop and somehow point the intellij to the ec2 instance in order to view, edit, build, and run the project on that instance.
Any ideas are greatly appreciated!
ec2 with enough memory for development is billed / hour. For 32gb RAM it's >$80/month (always online ~450h).
You could use wls 2 under windows. You can install IDEA and use it trough X server like
VcXsrv and access to windows files. It's not the best idea to run full GNOME (even xfce4). Google chrome also works very well
Downsides are:
(still) slow access to drive compared to raw Linux
I cannot configure WSL to access same VPN as in Windows. It simply cuts off internet connection for WSL while I click connect in windows.
I am looking for the best practices for deploying an ExtJS app on a RHEL server. I tried installing sencha CMD on the server so that I could do the application build there, but I kept getting a segmentation fault with the 64-bit version and nothing happened with the 32-bit version (both as a normal user and with sudo). I even tried ssh'ing in with a -X option to enable Xterm, but that did not work. I am thinking I am going to have to do an external build and then deploy the entire contents to the server.
Ultimately, I would be doing this through a Bamboo server (same as Jenkins). For testing purposes though, I am going to use Webstorm. Anything I should be aware of/watch out for? I am deploying the entire project directory structure.
Alright: I was able to do this as root. Interesting. I should now be able to set up my Bamboo process.
I’m new to Vagrant and currently I’m using WebStorm.
The suggested workflow should be to use your editor while compiling stuff in vagrant. My question is: at what point should I stop and use my own compilers?
WebStorm is cool because it connects to your stuff and do things like REPL and autocompletion based on your code etc.
How does that works if my nodejs interpreter is on the VM? Should I install my own nodejs? If so, what’s the point of having a virtual machine?
Maybe there is a way to tell Webstorm to use the VM interpreter but how?
I'm trying to configure Magento TAF on Ubuntu, following the Installation Guide pdf.
I read on it...
Current version limitations:
Remote tests executing
UNIX running Usage
Firefox profile through configuration file
...but I feel skeptical :)
There is a main shell script prepared (runtests.sh)
if I configure everything and I execute selenium RC and runtests.sh, firefox browser opens... (but stands on empty page).
Furthermore: there are several inconsistences on the Installation Guide, that's why I suspect that Linux restrictions perhaps are deprecated. For example: on page 2 says...
At the base level, Magento Test Automation Framework will require the
following software: (...)Selenium RC 2.0.3
... but on page 4...
Download and install Selenium RC 1.0.3 (...).The latest available
version is 2.x, Download Selenium RC (Now available NEW 2.0b), but
automated test cases will probably not work with it.
The question: Is it possible to run Magento TAF on Linux?
Thanks!
Yes, it is possible.
I had the same problem using Selenium Grid in version 1.x.
Download Selenium Driver (Selenium 2). I got the tests running in Debian without modifying runtests.sh.
If you plan to test with several OS / browsers you can find a quick start tutorial for Selenium Grid 2. This may be helpful if you host your Magento code on a linux webserver. It's much easier now to set up the grid than it was with Selenium 1, fortunately.
Launch the server with
java -jar selenium-server-standalone-2.15.0.jar -role hub
By default, the server will run on port 4444. You can start the server on a Linux box without a desktop environment (e.g. a development web server).
Then you set up boxes with desktop environment (e.g. a Windows machine and a Linux machine). Now you download the server standalone library for every machine and start the client:
java -jar selenium-server-standalone-2.15.0.jar -role node -hub http://192.168.1.2:4444/grid/register
You have to change the IP to the IP of your Selenium server (and change the port if you did so in the first command). By default, the client will run on port 5555. If you want to use another port for the client or if you wish to start several client instances, you can define custom ports using the -port switch.
Note: don't care too much about the software versions mentioned in the document at all. It seems to be a bit outdated.
The latest public release works fine on Ubuntu/Debian pretty much out of the box, but the documentation is Windows-orientated.
We got the tests running on a headless Selenium installation using Google Chrome on Ubuntu server 11.04 64bit. Screen-shots are only possible when using Firefox, but Selenium requires version 3.6 of Firefox, so we'll need to downgrade the Mozilla browser to enable that.
[Update: March 27th 2012] We tried again with Firefox 10 after upgrading our packages and to our biggest surprise, it worked! We've now got screen-shots!
I wrote a tutorial (updated March 27th 2012) that outlines installing a fresh headless Selenium environment with Magento TAF on Ubuntu Server. Hope that helps.
Yes, this is possible.
I made a init script selenium-headless that simplifies running the TAF on a server.
The TAF project is under development, this is just a preview was published. The team wanted to share ideas and give valuable benefits (automatic tests) for everyone, who is developing for Magento. TAF will have changes, it will be restructured and polished before the official release.
The docs are outdated a little, they give general overview of the tests usage. Currently TAF can be run on both Windows and Linux, and both Selenium 1 and 2 can be used to run them.
Summary
Yes, TAF can be run on Linux.
Do not mind documentation inconsistences
If tests do not run - re-check your configuration and Selenium installation.
P.S. And sorry for issues - this version is just a working draft. It will be improved, documentation will be proof-read and informative messages will be provided.
Thanks for using TAF, anyway :)