Spark Setup: Initialize Hive Metastore - apache-spark

Error: ERROR: permission denied for schema public
Position: 14 (state=42501,code=0)
org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !!
Underlying cause: java.io.IOException : Schema script failed, errorcode 2
Use --verbose for detailed stacktrace.
*** schemaTool failed ***
When I run this command got permission denied error:
/opt/hive/lib $ schematool -dbType postgres -initSchema

Related

cassandra not working on ubuntu 18.04 LTS

I followed instruction for installing cassandra:
http://cassandra.apache.org/doc/latest/getting_started/installing.html
then i checked for cassandra service and it is active but when i try nodetool status it throws following error:
error: null
-- StackTrace --
java.lang.NullPointerException
at org.apache.cassandra.config.DatabaseDescriptor.getDiskFailurePolicy(DatabaseDescriptor.java:1955)
at org.apache.cassandra.utils.JVMStabilityInspector.inspectThrowable(JVMStabilityInspector.java:82)
at org.apache.cassandra.io.util.FileUtils.(FileUtils.java:80)
at org.apache.cassandra.utils.FBUtilities.getToolsOutputDirectory(FBUtilities.java:869)
at org.apache.cassandra.tools.NodeTool.printHistory(NodeTool.java:200)
at org.apache.cassandra.tools.NodeTool.main(NodeTool.java:168)
moreover when i run cqlsh 127.0.0.1:9042 it throws this:
error: null
-- StackTrace --
java.lang.NullPointerException
at org.apache.cassandra.config.DatabaseDescriptor.getDiskFailurePolicy(DatabaseDescriptor.java:1955)
at org.apache.cassandra.utils.JVMStabilityInspector.inspectThrowable(JVMStabilityInspector.java:82)
at org.apache.cassandra.io.util.FileUtils.(FileUtils.java:80)
at org.apache.cassandra.utils.FBUtilities.getToolsOutputDirectory(FBUtilities.java:869)
at org.apache.cassandra.tools.NodeTool.printHistory(NodeTool.java:200)
at org.apache.cassandra.tools.NodeTool.main(NodeTool.java:168)

Presto unable to create injector because Configuration property 'cordinator' was not used

Installed presto on single machine cluster when starting presto getting this error.
com.facebook.presto.server.PrestoServer Unable to create injector, see the following errors:
1) Configuration property 'cordinator' was not used
at io.airlift.bootstrap.Bootstrap.lambda$initialize$2(Bootstrap.java:234)
1 error
com.google.inject.CreationException: Unable to create injector, see the following errors:
1) Configuration property 'cordinator' was not used
at io.airlift.bootstrap.Bootstrap.lambda$initialize$2(Bootstrap.java:234)
1 error
at com.google.inject.internal.Errors.throwCreationExceptionIfErrorsExist(Errors.java:466)
at com.google.inject.internal.InternalInjectorCreator.initializeStatically(InternalInjectorCreator.java:155)
at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:107)
at com.google.inject.Guice.createInjector(Guice.java:96)
at io.airlift.bootstrap.Bootstrap.initialize(Bootstrap.java:241)
at com.facebook.presto.server.PrestoServer.run(PrestoServer.java:115)
at com.facebook.presto.server.PrestoServer.main(PrestoServer.java:67)
here is the config properties.
cordinator=true
node-scheduler.include-coordinator=true
http-server.http.port=8080
query.max-memory=5GB
query.max-memory-per-node=1GB
discovery-server.enabled=true
discovery.uri=http://localhost:8080
This should be coordinator, not cordinator.

Yocto - Try to use Realtime Kernel Version

Try
Hello there
I tried to build a linux with yocto. Usually, I use the command bitbake core-image-minimal and have no errors. Now, I'd like to use the realtime kernel version.
So I added the following lines in build/conf/local.conf according to this post:
PREFERRED_PROVIDER_virtual/kernel = "linux-yocto-rt"
COMPATIBLE_MACHINE_cyclone5 = "cyclone5"
COMPATIBLE_MACHINE_quilt-native = "cyclone5"
(I only changed the MACHINE to cyclone5 instead of beaglebone)
Error
The command bitbake core-image-rt throws the following error:
Loading cache: 100% |########################################################################################################################################################################| Time: 0:00:00
Loaded 1339 entries from dependency cache.
NOTE: Resolving any missing task queue dependencies
Build Configuration:
BB_VERSION = "1.32.0"
BUILD_SYS = "x86_64-linux"
NATIVELSBSTRING = "universal"
TARGET_SYS = "arm-poky-linux-gnueabi"
MACHINE = "cyclone5"
DISTRO = "poky"
DISTRO_VERSION = "2.2"
TUNE_FEATURES = "arm armv7a vfp neon"
TARGET_FPU = "softfp"
meta
meta-poky
meta-yocto-bsp = "HEAD:73454473d7c286c41ee697f74052fed03c79f9f5"
meta-altera = "HEAD:ab2ee2812670be650d6a722de08dff9bf05131f8"
meta-ines = "master:819761a62e69ad09a14d877e2b9d9bbd5370b9e2"
Initialising tasks: 100% |###################################################################################################################################################################| Time: 0:00:02
NOTE: Executing SetScene Tasks
NOTE: Executing RunQueue Tasks
WARNING: stress-1.0.4-r0 do_fetch: Failed to fetch URL http://people.seas.harvard.edu/~apw/stress/stress-1.0.4.tar.gz, attempting MIRRORS if available
WARNING: linux-yocto-rt-4.8.3+gitAUTOINC+83110d94ed_4057556c04-r0 do_fetch: Failed to fetch URL git://git.yoctoproject.org/linux-yocto-4.8.git;branch=standard/preempt-rt/base;name=machine, attempting MIRRORS if available
WARNING: rt-tests-1_1.1-r0 do_fetch: Failed to fetch URL git://git.kernel.org/pub/scm/utils/rt-tests/rt-tests.git, attempting MIRRORS if available
ERROR: stress-1.0.4-r0 do_fetch: Fetcher failure: Fetch command export DBUS_SESSION_BUS_ADDRESS="unix:abstract=/tmp/dbus-0nwPP5TSk1"; export SSH_AUTH_SOCK="/run/user/1000/keyring/ssh"; export PATH="/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/mc2/XYZ_Project_Verification/yocto/poky/scripts:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/usr/bin/arm-poky-linux-gnueabi:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/cyclone5/usr/bin/crossscripts:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/usr/sbin:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/usr/bin:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/sbin:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/bin:/home/mc2/XYZ_Project_Verification/yocto/poky/scripts:/home/mc2/XYZ_Project_Verification/yocto/poky/bitbake/bin:/home/mc2/bin:/home/mc2/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"; export HOME="/home/mc2"; /usr/bin/env wget -t 2 -T 30 -nv --passive-ftp --no-check-certificate -P /home/mc2/XYZ_Project_Verification/yocto/build/downloads 'http://people.seas.harvard.edu/~apw/stress/stress-1.0.4.tar.gz' --progress=dot -v failed with exit code 4, output:
--2017-11-08 17:29:51-- http://people.seas.harvard.edu/~apw/stress/stress-1.0.4.tar.gz
Resolving people.seas.harvard.edu (people.seas.harvard.edu)... 54.172.197.41
Connecting to people.seas.harvard.edu (people.seas.harvard.edu)|54.172.197.41|:80... failed: Connection refused.
ERROR: stress-1.0.4-r0 do_fetch: Fetcher failure for URL: 'http://people.seas.harvard.edu/~apw/stress/stress-1.0.4.tar.gz'. Unable to fetch URL from any source.
ERROR: stress-1.0.4-r0 do_fetch: Function failed: base_do_fetch
ERROR: Logfile of failure stored in: /home/mc2/XYZ_Project_Verification/yocto/build/tmp/work/armv7a-neon-poky-linux-gnueabi/stress/1.0.4-r0/temp/log.do_fetch.25139
ERROR: Task (/home/mc2/XYZ_Project_Verification/yocto/build/../poky/meta/recipes-extended/stress/stress_1.0.4.bb:do_fetch) failed with exit code '1'
ERROR: linux-yocto-rt-4.8.3+gitAUTOINC+83110d94ed_4057556c04-r0 do_fetch: Fetcher failure: Fetch command export DBUS_SESSION_BUS_ADDRESS="unix:abstract=/tmp/dbus-0nwPP5TSk1"; export SSH_AUTH_SOCK="/run/user/1000/keyring/ssh"; export PATH="/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/mc2/XYZ_Project_Verification/yocto/poky/scripts:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/usr/bin/arm-poky-linux-gnueabi:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/cyclone5/usr/bin/crossscripts:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/usr/sbin:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/usr/bin:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/sbin:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/bin:/home/mc2/XYZ_Project_Verification/yocto/poky/scripts:/home/mc2/XYZ_Project_Verification/yocto/poky/bitbake/bin:/home/mc2/bin:/home/mc2/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"; export HOME="/home/mc2"; LANG=C git -c core.fsyncobjectfiles=0 clone --bare --mirror git://git.yoctoproject.org/linux-yocto-4.8.git /home/mc2/XYZ_Project_Verification/yocto/build/downloads/git2/git.yoctoproject.org.linux-yocto-4.8.git --progress failed with exit code 128, output:
Cloning into bare repository '/home/mc2/XYZ_Project_Verification/yocto/build/downloads/git2/git.yoctoproject.org.linux-yocto-4.8.git'...
fatal: unable to connect to git.yoctoproject.org:
git.yoctoproject.org[0: 140.211.169.56]: errno=Connection refused
ERROR: linux-yocto-rt-4.8.3+gitAUTOINC+83110d94ed_4057556c04-r0 do_fetch: Fetcher failure for URL: 'git://git.yoctoproject.org/linux-yocto-4.8.git;branch=standard/preempt-rt/base;name=machine'. Unable to fetch URL from any source.
ERROR: linux-yocto-rt-4.8.3+gitAUTOINC+83110d94ed_4057556c04-r0 do_fetch: Function failed: base_do_fetch
ERROR: Logfile of failure stored in: /home/mc2/XYZ_Project_Verification/yocto/build/tmp/work/cyclone5-poky-linux-gnueabi/linux-yocto-rt/4.8.3+gitAUTOINC+83110d94ed_4057556c04-r0/temp/log.do_fetch.25135
ERROR: Task (/home/mc2/XYZ_Project_Verification/yocto/build/../poky/meta/recipes-kernel/linux/linux-yocto-rt_4.8.bb:do_fetch) failed with exit code '1'
ERROR: rt-tests-1_1.1-r0 do_fetch: Fetcher failure: Fetch command export DBUS_SESSION_BUS_ADDRESS="unix:abstract=/tmp/dbus-0nwPP5TSk1"; export SSH_AUTH_SOCK="/run/user/1000/keyring/ssh"; export PATH="/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/mc2/XYZ_Project_Verification/yocto/poky/scripts:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/usr/bin/arm-poky-linux-gnueabi:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/cyclone5/usr/bin/crossscripts:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/usr/sbin:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/usr/bin:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/sbin:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/bin:/home/mc2/XYZ_Project_Verification/yocto/poky/scripts:/home/mc2/XYZ_Project_Verification/yocto/poky/bitbake/bin:/home/mc2/bin:/home/mc2/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"; export HOME="/home/mc2"; LANG=C git -c core.fsyncobjectfiles=0 clone --bare --mirror git://git.kernel.org/pub/scm/utils/rt-tests/rt-tests.git /home/mc2/XYZ_Project_Verification/yocto/build/downloads/git2/git.kernel.org.pub.scm.utils.rt-tests.rt-tests.git --progress failed with exit code 128, output:
Cloning into bare repository '/home/mc2/XYZ_Project_Verification/yocto/build/downloads/git2/git.kernel.org.pub.scm.utils.rt-tests.rt-tests.git'...
fatal: unable to connect to git.kernel.org:
git.kernel.org[0: 147.75.205.195]: errno=Connection refused
git.kernel.org[1: 2604:1380:2000:f000::7]: errno=Network is unreachable
ERROR: rt-tests-1_1.1-r0 do_fetch: Fetcher failure for URL: 'git://git.kernel.org/pub/scm/utils/rt-tests/rt-tests.git'. Unable to fetch URL from any source.
ERROR: rt-tests-1_1.1-r0 do_fetch: Function failed: base_do_fetch
ERROR: Logfile of failure stored in: /home/mc2/XYZ_Project_Verification/yocto/build/tmp/work/armv7a-neon-poky-linux-gnueabi/rt-tests/1_1.1-r0/temp/log.do_fetch.25136
ERROR: Task (/home/mc2/XYZ_Project_Verification/yocto/build/../poky/meta/recipes-rt/rt-tests/rt-tests_1.1.bb:do_fetch) failed with exit code '1'
WARNING: hwlatdetect-1_1.1-r0 do_fetch: Failed to fetch URL git://git.kernel.org/pub/scm/utils/rt-tests/rt-tests.git, attempting MIRRORS if available
ERROR: hwlatdetect-1_1.1-r0 do_fetch: Fetcher failure: Fetch command export DBUS_SESSION_BUS_ADDRESS="unix:abstract=/tmp/dbus-0nwPP5TSk1"; export SSH_AUTH_SOCK="/run/user/1000/keyring/ssh"; export PATH="/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/mc2/XYZ_Project_Verification/yocto/poky/scripts:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/usr/bin/arm-poky-linux-gnueabi:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/cyclone5/usr/bin/crossscripts:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/usr/sbin:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/usr/bin:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/sbin:/home/mc2/XYZ_Project_Verification/yocto/build/tmp/sysroots/x86_64-linux/bin:/home/mc2/XYZ_Project_Verification/yocto/poky/scripts:/home/mc2/XYZ_Project_Verification/yocto/poky/bitbake/bin:/home/mc2/bin:/home/mc2/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"; export HOME="/home/mc2"; LANG=C git -c core.fsyncobjectfiles=0 clone --bare --mirror git://git.kernel.org/pub/scm/utils/rt-tests/rt-tests.git /home/mc2/XYZ_Project_Verification/yocto/build/downloads/git2/git.kernel.org.pub.scm.utils.rt-tests.rt-tests.git --progress failed with exit code 128, output:
Cloning into bare repository '/home/mc2/XYZ_Project_Verification/yocto/build/downloads/git2/git.kernel.org.pub.scm.utils.rt-tests.rt-tests.git'...
fatal: unable to connect to git.kernel.org:
git.kernel.org[0: 147.75.205.195]: errno=Connection refused
git.kernel.org[1: 2604:1380:2000:f000::7]: errno=Network is unreachable
ERROR: hwlatdetect-1_1.1-r0 do_fetch: Fetcher failure for URL: 'git://git.kernel.org/pub/scm/utils/rt-tests/rt-tests.git'. Unable to fetch URL from any source.
ERROR: hwlatdetect-1_1.1-r0 do_fetch: Function failed: base_do_fetch
ERROR: Logfile of failure stored in: /home/mc2/XYZ_Project_Verification/yocto/build/tmp/work/armv7a-neon-poky-linux-gnueabi/hwlatdetect/1_1.1-r0/temp/log.do_fetch.25140
ERROR: Task (/home/mc2/XYZ_Project_Verification/yocto/build/../poky/meta/recipes-rt/rt-tests/hwlatdetect_1.1.bb:do_fetch) failed with exit code '1'
NOTE: Tasks Summary: Attempted 1353 tasks of which 1349 didn't need to be rerun and 4 failed.
Summary: 4 tasks failed:
/home/mc2/XYZ_Project_Verification/yocto/build/../poky/meta/recipes-extended/stress/stress_1.0.4.bb:do_fetch
/home/mc2/XYZ_Project_Verification/yocto/build/../poky/meta/recipes-kernel/linux/linux-yocto-rt_4.8.bb:do_fetch
/home/mc2/XYZ_Project_Verification/yocto/build/../poky/meta/recipes-rt/rt-tests/rt-tests_1.1.bb:do_fetch
/home/mc2/XYZ_Project_Verification/yocto/build/../poky/meta/recipes-rt/rt-tests/hwlatdetect_1.1.bb:do_fetch
Summary: There were 4 WARNING messages shown.
Summary: There were 12 ERROR messages shown, returning a non-zero exit code.
I already checked the bb file. There is a linux-yocto_rt_4.8.bb file in yocto/poky/meta/recipes-kernel/linux
Any hints or suggestions how to solve this issue? Thanks in advance.
your error seems to fetching problem. Please connect internet it will solve your prblem.

Failed to connect to master, spark in docker

I am running spark on following docker image:
https://github.com/sequenceiq/docker-spark
I am trying to run the spark-bench ( https://github.com/SparkTC/spark-bench ) I tried following command:
<SparkBench_Root>/KMean/bin/gen_data.sh
I am getting the following error:
Association with remote system [akka.tcp://sparkMaster#172.17.0.3:7077] has failed, address is now gated for [5000] ms. Reason: [Association failed with [akka.tcp://sparkMaster#172.17.0.3:7077]] Caused by: [Connection refused: /172.17.0.3:7077]
16/03/16 08:00:36 WARN client.AppClient$ClientEndpoint: Failed to connect to master 172.17.0.3:7077
akka.actor.ActorNotFound: Actor not found for: ActorSelection[Anchor(akka.tcp://sparkMaster#172.17.0.3:7077/), Path(/user/Master)]
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala
Thanks
Shuja

Puppet-Master / Puppet-Agent Deployment fails due to the puppet modules metadata.json file permissions

I am using the Puppet Master / Puppet Agent deployment in CentOS 6.5 64bits.
My problem is about doing the request from Puppet Agent in order to start the puppet modules's installation. When I execute the following commandline from Puppet-Agent:
puppet agent --server <internal-puppet-server-hostname> --test
The ouput result is:
Info: Retrieving pluginfacts
Error: /File[/var/lib/puppet/facts.d]: Failed to generate additional resources using 'eval_generate': Error 400 on SERVER: Permission denied - /etc/puppet/modules/yum/metadata.json
Error: /File[/var/lib/puppet/facts.d]: Could not evaluate: Could not retrieve file metadata for puppet://<internal-puppet-server-hostname>/pluginfacts: Error 400 on SERVER: Permission denied - /etc/puppet/modules/yum/metadata.json
Info: Retrieving plugin
Error: /File[/var/lib/puppet/lib]: Failed to generate additional resources using 'eval_generate': Error 400 on SERVER: Permission denied - /etc/puppet/modules/yum/metadata.json
Error: /File[/var/lib/puppet/lib]: Could not evaluate: Could not retrieve file metadata for puppet://<internal-puppet-server-hostname>/plugins: Error 400 on SERVER: Permission denied - /etc/puppet/modules/yum/metadata.json
Info: Caching catalog for <internal-puppet-agent-hostname>
Info: Applying configuration version '1440623253'
About the returned response, I show that the problem occurs because of the permissions of metadata.json's file. Then, I've checked the permissions of metadata.json:
-r--------. 1 root root 539 2015-08-18 14:19 metadata.json
Some ideas about error occurs? Thanks.

Resources