Install chrome driver on Amazon Linux 2 ARM - linux

I am looking to install Chrome Driver (For my selenium project) on an Amazon Linux 2 (Arm 64).
I have done this on Ubuntu and seems pretty straight, it also seems straight on AL2 x86, like this script from Intoli but it 404 when looking for Chrome on ARM :(. So far I see Chrome is not available for ARM so I see the alternative is to use Chromium.
I tried installing it manually but it seems there is no compiled on Chromium downloads page for ARM.
Finally i found the Electron's unofficial webdrivers, which seem to be the answer, and after downloading, installing dependencies (libXcursor, libXfixes, libXdamage) and running it:
[ec2-user#scraping1 current]$ chromedriver
Starting ChromeDriver 100.0.4896.143 (6bf1afe83487405ea0aff37182f05e3db45559c2-refs/branch-heads/4951#{#831}) on port 9515
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully.
And run my project I get:
2.7.3 :004 > Selenium::WebDriver::Service.driver_path = "/usr/bin/chromedriver"
=> "/usr/bin/chromedriver"
session = Capybara::Session.new
Webdrivers::BrowserNotFound: Failed to find Chrome binary.
Which means i don't have Chrome installed, but then how to install it? I have seen this question which seems to be my same problem but it is unclear to me how to install Chromium; I see it is needed to download and use the chromedriver compiled for ARM64 which I have done already.

Related

Flutter extremely slow on linux

Flutter application is extremely slow on linux. The performance tab shows 15fps and it never goes beyond that. I was unable to find any explanation or possible solution for this issue. Any suggestions?
clang version 10.0.0-4ubuntu1/
cmake version 3.16.3/
ninja version 1.10.0/
pkg-config version 0.29.1/
OS : Fedora Linux
For anyone potentially running into the same problem, this was either an issue with my OS or my flutter SDK. I initially installed the SDK using snap but after reinstalling my OS I installed it by cloning the github repo and setting the path variable etc... (the way explained in the official website) and the issue was resolved.

Python 3 - selenium on xvfb-run- cannot process extension

I need to automate tasks to extract information from websites using the uBlock plugin with Chrome driver using the selenium module in Python 3.
I am running my code remotely without a GUI on the remote machine - for that I am using xvfb-run to simulate a desktop environment where Chrome launches with a specific window size.
The remote machine has the following Debian operating system:
uname -a
Linux mem 4.19.0-10-amd64 #1 SMP Debian 4.19.132-1 (2020-07-24) x86_64 GNU/Linux
These were the steps I took to configure my environment and code on the remote machine:
1 - To configure my environment, I installed this version of Google Chrome:
google-chrome --version
Google Chrome 86.0.4240.111
2 - Check the versions of Python 3 and selenium I installed:
python --version
Python 3.7.3
pip freeze
selenium==3.141.0
3 - Check the xvfb-run version:
apt-cache policy xvfb
2:1.20.4-1+deb10u1
4 - With these packages configured, I obtained the chromedriver_linux64.zip from this list (the version 86.0.4240.22 below is the most recent one that is the same major version of the installed google-chrome):
https://chromedriver.storage.googleapis.com/index.html
https://chromedriver.storage.googleapis.com/index.html?path=86.0.4240.22/
5 - To be able to use the uBlock extension of Chrome, I needed to install an extension that is able to produce a .crx archive file of other installed extensions.
For this, I used CRX Extractor/Downloader:
https://chrome.google.com/webstore/detail/crx-extractordownloader/ajkhmmldknmfjnmeedkbkkojgobmljda
6 - After using that extension, I got my ublock.crx file to test.
I managed to use the binary in chromedriver_linux64.zip without the extension to launch a Chrome instance and do some basic crawling.
But when I tried to use ublock.crx in my code, I got an exception.
The code was this:
This is the exception produced:
ublock.crx error
selenium.common.exceptions.SessionNotCreatedException: Message: session not
created: cannot process extension #1
from unknown error: cannot unzip
I am launching it from my program like this:
from selenium import webdriver
option = webdriver.ChromeOptions()
option.add_extension(ublock_crx_file_path)
driver = webdriver.Chrome(executable_path=driver_path, options=option)
I have made sure the path of ublock_crx_file_path is valid and points to the file I obtained from Chrome.
Hopefully someone can shed light on this?

selenium.common.exceptions.SessionNotCreatedException: Message: session not created: Chrome version must be between 70 and 73 with ChromeDriver

I am trying to create a webcrawler using Selenium, but I get this error when I try to create the webdriver object.
selenium.common.exceptions.SessionNotCreatedException: Message: session not created: Chrome version must be between 70 and 73
(Driver info: chromedriver=2.45.615291 (ec3682e3c9061c10f26ea9e5cdcf3c53f3f74387),platform=Windows NT 6.1.7601 SP1 x86_64)
I downloaded the latest version of chromedriver (2.45) which requires Chrome 70-73. My current Chrome version is 68.0.3440.106 (Official Build) (64-bit), which is the latest. I tried downloading an "older" chrome version (71) and when I tried installing it, the installer indicated that I had a newer version already installed.
There doesn't seem to be any previous Chromedriver releases available for download, even though the website says there is. I couldn't find them.
I don't quite understand how version 71 is older than 68?
Is there a Chrome version newer than 68 actually available, or an older version of chromedriver i can use with Chrome 68?
Does anyone have any other suggestions?
This is the code that i'm trying to execute:
import time
from selenium import webdriver
from selenium.webdriver.common.keys import Keys
user = 'XXXXXXX'
pwd = 'XXXXXXX'
chromedriver = "...\...\...\chromedriver.exe"
driver = webdriver.Chrome(executable_path=chromedriver) # Error occurs at this line
driver.get("http://www.facebook.com")
assert "Facebook" in driver.title
time.sleep(5) # So i can see something!
elem = driver.find_element_by_id("email")
elem.send_keys(user)
time.sleep(5) # So i can see something!
elem = driver.find_element_by_id("pass")
elem.send_keys(pwd)
time.sleep(5) # So i can see something!
elem.send_keys(Keys.RETURN)
driver.close()
For me, upgrading the driver did the trick. Just run:
brew cask upgrade chromedriver
and then try running your test again. Hope it helps!
You can find the older versions of chrome driver here.
I dont think it is a good idea to install chrome from sources other than the official channel and installation of the same can cause issues. See if the google update service is running in your PC. This will automatically update the chrome version to latest. Mine is running Version 71.0.3578.98 (Official Build) (64-bit).
This error message...
selenium.common.exceptions.SessionNotCreatedException: Message: session not created: Chrome version must be between 70 and 73
(Driver info: chromedriver=2.45.615291 (ec3682e3c9061c10f26ea9e5cdcf3c53f3f74387),platform=Windows NT 6.1.7601 SP1 x86_64)
...implies that Chrome version must be between 70 and 73
Your main issue is the version compatibility between the binaries you are using as follows :
You are using chromedriver=2.45
Release Notes of chromedriver=2.45 clearly mentions the following :
Supports Chrome v70-72
You are using chrome=68.0
Release Notes of ChromeDriver v2.41 clearly mentions the following :
Supports Chrome v67-69
So there is a clear mismatch between ChromeDriver v2.45 and the Chrome Browser v68.0
Solution
Upgrade ChromeDriver to current ChromeDriver v2.45 level.
Keep Chrome version between Chrome v70-72 levels. (as per ChromeDriver v2.45 release notes)
Take a System Reboot.
Execute your #Test.
Alternative
Somehow I feel there are 2 versions of Chrome browser installed in your system. If that is the case you need to mention the absolute location of the Chrome binary within your program and you can use the following solution:
Code Block:
from selenium import webdriver
from selenium.webdriver.chrome.options import Options
options = Options()
options.binary_location = "C:/Program Files (x86)/Google/Chrome/Application/chrome.exe"
driver = webdriver.Chrome(chrome_options=options, executable_path="C:/Utility/BrowserDrivers/chromedriver.exe", )
driver.get('http://google.com/')
You can find a detailed discussion in Set chrome browser binary through chromedriver in Python
Note: You can find a relevant discussion in Session not created exception: Chrome version must be >= x.y.z when using Selenium Webdriver with Chrome
Reference
You can find a relevant detailed discussion in:
How to work with a specific version of ChromeDriver while Chrome Browser gets updated automatically through Python selenium
There are two options to resolve this issue:
1. If your Chrome version is not updated -> Update it
Steps: 1. Go to Help -> About Google Chrome -> Chrome will automatically look for updates(update Chrome to the latest version)
2. If your chrome version is already up to date -> Then you need to upgrade you chrome driver version
Here is the link: http://chromedriver.chromium.org/downloads
I encountered the same problem. I tried installing a downgraded version of Chrome (current stable was 74 and the driver required chrome version must be between 70-73) but I wasn't able to do so.
I found another way. This link will show you which version is compatible with your current google-chrome (to know your version the command is google-chrome --version)
This link will guide you as to how to install chrome driver with zip file. The commands are:
cd
wget <URL to zip file>
unzip chromedriver_linux64.zip
sudo mv chromedriver /usr/bin/chromedriver
sudo chown root:root /usr/bin/chromedriver
sudo chmod +x /usr/bin/chromedriver
In case the error comes No such file or directory: '/usr/lib/chromium-browser/chromedriver' OR the same error persists
Repeat the above procedure with the path /usr/lib/chromium-browser/chromedriver instead of /usr/bin/chromedriver
For me, google-chrome version 74 worked with ChromeDriver version 73
If you end up here and you're using Laravel / Dusk, try:
php artisan dusk:chrome-driver
Your chrome version is very old. Version 68 is not the latest version. For all operating systems, Chrome is currently in version 71+. Please see the list here.
Alternatively, this is the link for downloading older versions.
In Summary:
Find your chrome version (Help-> About Google Chrome)
Find your chromedriver version, if you already have one. (For me "chromedriver.exe -v" gave me the version on windows environment.)
Visit the official chrome webdriver page (http://chromedriver.chromium.org/downloads)
Download the chromedriver matching your chrome browser version, from the above download location.
Have a glance at the release notes on this download page towards lower section of the page, which gives an clear idea regarding which driver to use for which version of browser.
You can put the downloaded chromedriver binary in the path environment.
There you go. All the best!
Just download chromedriver extension 2.8 or 2.9 from here.
Extract it and add this extension to /usr/local/bin
I faced this issue due to mismatch of chromedriver and chrome version. I followed the below steps to resolve my issue:
1) First, find out which version of Chrome you are using. My Chrome version was 77.0.3865.90.
2) Take the Chrome version number, remove the last part, and append the result to URL "https://chromedriver.storage.googleapis.com/LATEST_RELEASE_". For example, with Chrome version 77.0.3865.90, you'd get a URL "https://chromedriver.storage.googleapis.com/LATEST_RELEASE_77.0.3865".
3) Use the URL created in the last step to retrieve the version of ChromeDriver to use. For example, the above URL will get your a file containing "77.0.3865.40". (The actual number may change in the future, of course.)
4) I then did :
webdriverdownloader chrome:77.0.3865.40 on my mac terminal.
After this your Chromedriver and Chrome version must be in sync and the issue should be fixed.
You have to match the chromedriver version number and your web browser chrome version ,
If both of the version match then it is best.
>
For Example -
1- your web browser chrome version is 77 ( For checking your web browser chrome version
got to your web browser help and then About Google Chrome there you will find
your web browser chrome version ) .
2- Now download same version here 77 chromedriver from https://chromedriver.chromium.org/downloads .
3- Make google chrome as your default web browser .
All done .
Your code will run fine.
from selenium import webdriver
driver=webdriver.Chrome("chromedriver.exe")
# Below line of code provide
driver.get('http://python.org')
html_doc=driver.page_source
print("Html code of http://python.org web page :",html_doc)

Firefox can't work after using splinter 0.8.0

I have just installed the splinter 0.8.0. I intalled it like this:
1.Firstly, I have had installed anaconda and the corresponding spyder supports python3.7
2.I installed the latest selenium by using "pip install selenium" on cmd.exe
3.I used "pip -m install splinter" to install splinter0.8.0
4.I installed geckodriver from the github click here
5.I configurated the environment by getting the geckodriver.exe copied to the directory which includes fiefox.exe and get the path into the PATH of the computer
6.To this, the splinter could open firefox but always got some exceptions..
7*.When I then opened the firefox with mouse clicking, the firefox started with page white. And no matter what I input into the search box, nothing happened. What's more, I found that the developer tools couldn't be opened. And all these cases happened when I started firefox through desktop shortcut. Interestingly, when I started it in its directory which it's originally at, the firefox could work. But in this case when I open a new blank page, it didn't work too...
It's so confusing!!! Thanks for help!
The reason may be that the computer had been working long and if you shut it down completely and restart it, the Firefox may come alive. (Also it may be because of Win10's needing relax).
If that doesn't work, I recommend chromedriver.

Virtual machine "pc1" Netkit error?

Introduction
I've just installed a networking simulator Called Netkit. On Debian stretch stable. Using the official installation guide here.
Installation
After setting the correct paths and installing. I then run the check_configuration.sh script.
Everything is checked OK, and it has found the terminal emulator xterm which is needed for netkit. And recieve the complete message.
[ READY ] Congratulations! Your Netkit setup is now complete!
Enjoy Netkit!
The Problem
Running netkit using the command:
vstart pc1
The xterm netkit-kernel emulator starts running. However I'm getting an infinite loop of the same error message:
ubda: can't open "home/foo/netkit/pc1.disk" failed, errno= 13
So im guessing it's because the file is missing? if so how do i obtain it? and if not, what is causing this error. I've followed the install guide completely.
I'm assuming your system is not a 32bit system. Netkit is only supported on the 32-bit architecture(unless the compatibility libraries are installed). Hence I would suggest you download a 32-bit VM(instead of installing the libraries) and run Netkit on the same(worked fine for me).
Check position of your lab-folder..

Resources