Unable to open Pyspark Shell - apache-spark

I am running ./bin/pyspark at to open the pyspark shell but I get the following error :
`py4j.protocol.PY4JNetworkError: An error occurred while trying to connect to the Java Server`
Searched about it a lot. Couldn't find a solution.
How should I resolve this ?
Thanks,

This issue seems like your Java issue
Please use commands to check your java process in your machine
ps -ef|grep java
If doesn't works then please try to update your Java JDK to new.
Download:http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html

Related

Can't find Spark Submit when using Spark shell

I installed spark and am trying to run a file 'train.py' in the directory, '/home/xxx/Desktop/BD_Project', in shell using the following command:
$SPARK_HOME/bin/spark-submit /home/xxx/Desktop/BD_Project/train.py > output.txt
My teammates who used the same page that I did for spark installations have no problem when running this. However, it throws up the following error for me:
bash: /bin/spark-submit: No such file or directory
You need to set your SPARK_HOME to where your spark is installed, typically its in /usr/local/spark/bin/bin/spark-submit
Before you set it make sure where spark is installed by going to the directory.
You can set it like this before running your command :
export SPARK_HOME=/usr/local/spark/bin/bin/spark-submit
If you are homebrew user, setting your SPARK_HOME to
/opt/homebrew/Cellar/apache-spark/3.3.1/libexec"
would solve. Sorry for too late responding. Hoping this would help someone with this odd error.

Jenkins -Selenium Webdriver-Java: Error : DevToolsActive port does not exit

I have automation scripts ready to execute in jenkins which is installed in linux server. But whenever I execute, it shows DevToolsActivePort does not exit. I tried searching for different solution but could not get the solution hence posting it as new question.
Can anyone help me with the solution.
I got the solution I downgraded the version of Chromedriver 2.45 to 2.38 and it worked.

How to run selenium server in bash

So I've been reading this article about running selenium-ide recorded tests in chrome on windows(http://www.software-testing-tutorials-automation.com/2016/08/run-selenium-ide-test-in-google-chrome.html). I'm using Ubuntu though, and I use newer selenium server version. How should I modify this command for it to work on linux:
java -jar selenium-server-standalone-2.46.0.jar -Dwebdriver.chrome.driver=chromedriver.exe
I know that i have to delete ".exe" but i get an error like this:
Exception in thread "main" com.beust.jcommander.ParameterException: Unknown option: -Dwebdriver.chrome.driver=chromedriver
at com.beust.jcommander.JCommander.parseValues(JCommander.java:742)
at com.beust.jcommander.JCommander.parse(JCommander.java:282)
at com.beust.jcommander.JCommander.parse(JCommander.java:265)
at com.beust.jcommander.JCommander.<init>(JCommander.java:210)
at org.openqa.grid.selenium.GridLauncherV3$1.setConfiguration(GridLauncherV3.java:227)
at org.openqa.grid.selenium.GridLauncherV3.buildLauncher(GridLauncherV3.java:155)
at org.openqa.grid.selenium.GridLauncherV3.main(GridLauncherV3.java:75)
The -Dwebdriver… parameter needs to be passed to java, not Selenium itself. So just switching the argument order should work for you:
java -Dwebdriver.chrome.driver=chromedriver.exe -jar selenium-server-standalone-2.46.0.jar
Relevant Github issues: 1, 2

Not able to execute groovy script from command ".GroovyRuntimeException: Conflicting module versions."

I have run groovy script for a while from command line. Recently I have started to work with spock/groovy in the eclipse. I have run couple of test using Groovy Console when console was loaded from eclipse. Any way after these activities I have tried to execute groovy from command line and it failed with the following error:
Caused by: groovy.lang.GroovyRuntimeException: Conflicting module versions. Module [groovy-xml is loaded in version 2.4.3 and you are trying to load version 2.4.1
I was using gvm tool to reinstall groovy and set is a primary version but still have the problem. Something was changed from eclipse where my groovy installation gets affected and can not be fixed by by reinstalling.
I have some search done but did not find solution. most solution were mentioning this problem but they were trying to fix this withing eclipse, where in my case I am trying to fix it outside of eclipse. Also will be nice if I be able to prevent this from happening in the future. If somebody have similar experience please share.
Thanks,
Alexander

getting error when starting xampp with error missing job name

I installed xampp in ubuntu 12.04 and everything is ok but when i am trying start it from terminal i get this error:
start: missing job name
try 'start --help' for more information.
JOB is the name of the job that is to be started, this may be followed by zero
or more environment variables to be defined in the new job. This is the information which i got from help but is my first experience with linux. all tutorials on the web tells that all the things that i need to do is just enter start...
What to do?
Thanx
When you follow this guide: http://www.apachefriends.org/en/xampp-linux.html#378
and run command:
/opt/lampp/lampp start
Or, you run some other command?(in question is not specified what you have executed). If so, most likely something is not correctly installed...
Also you should provide xampp version, how the software was installed (rpm, compiled,....)

Resources