Apache Zeppelin will not start - windows-10

Newbie here, please be gentle.
The computer in question uses Windows 10 and Apache Zeppelin(zeppelin-0.9.0-bin-all.tgz) refuses to start.
I've tried removing .template from the config files and still nothing.
It doesn't pass the line: INFO [2021-01-29 17:46:29,310] ({main} LuceneSearch.java[]:93) - Use C:\Zeppelin\tmp\zeppelin-index for storing lucene search index.
Not entirely sure what to do at this point, tried the solutions here: Apache Zeppelin not loading in a browser in windows 10 and here: https://gist.github.com/codspire/7b0955b9e67fe73f6118dad9539cbaa2 and I just cannot figure out what is wrong.
Of note, I have Spark (spark-3.0.1-bin-hadoop3.2.tgz) installed separately and it seems to work even though it throws this warning: 21/01/29 18:16:39 WARN ProcfsMetricsGetter: Exception when trying to compute pagesize, as a result reporting of ProcessTree metrics is stopped
ANY suggestions would be greatly appreciated because I'm not sure what else to try.
Microsoft Windows [Version 10.0.19042.746]
(c) 2020 Microsoft Corporation. All rights reserved.
C:\WINDOWS\system32>zeppelin.cmd
INFO [2021-01-29 17:46:18,140] ({main} ZeppelinConfiguration.java[create]:172) - Load configuration from file:/C:/Zeppelin/conf/zeppelin-site.xml
INFO [2021-01-29 17:46:18,229] ({main} ZeppelinConfiguration.java[create]:180) - Server Host: 127.0.0.1
INFO [2021-01-29 17:46:18,229] ({main} ZeppelinConfiguration.java[create]:182) - Server Port: 8080
INFO [2021-01-29 17:46:18,229] ({main} ZeppelinConfiguration.java[create]:186) - Context Path: /
INFO [2021-01-29 17:46:18,229] ({main} ZeppelinConfiguration.java[create]:187) - Zeppelin Version: 0.9.0
INFO [2021-01-29 17:46:18,258] ({main} Log.java[initialized]:169) - Logging initialized #811ms to org.eclipse.jetty.util.log.Slf4jLog
WARN [2021-01-29 17:46:18,682] ({main} ZeppelinConfiguration.java[getConfigFSDir]:694) - zeppelin.config.fs.dir is not specified, fall back to local conf directory zeppelin.conf.dir
WARN [2021-01-29 17:46:18,682] ({main} ZeppelinConfiguration.java[getConfigFSDir]:694) - zeppelin.config.fs.dir is not specified, fall back to local conf directory zeppelin.conf.dir
WARN [2021-01-29 17:46:18,683] ({main} ZeppelinConfiguration.java[getConfigFSDir]:694) - zeppelin.config.fs.dir is not specified, fall back to local conf directory zeppelin.conf.dir
WARN [2021-01-29 17:46:18,722] ({main} LocalConfigStorage.java[loadCredentials]:88) - Credential file C:\Zeppelin\conf\credentials.json is not existed
INFO [2021-01-29 17:46:18,782] ({ImmediateThread-1611960378676} PluginManager.java[loadNotebookRepo]:78) - Loading NotebookRepo Plugin: org.apache.zeppelin.notebook.repo.GitNotebookRepo
INFO [2021-01-29 17:46:18,948] ({ImmediateThread-1611960378676} VFSNotebookRepo.java[setNotebookDirectory]:69) - Using notebookDir: C:\Zeppelin\notebook
INFO [2021-01-29 17:46:18,957] ({main} ZeppelinServer.java[setupWebAppContext]:575) - warPath is: C:\Zeppelin\zeppelin-web-angular-0.9.0.war
INFO [2021-01-29 17:46:18,975] ({main} ZeppelinServer.java[setupWebAppContext]:588) - ZeppelinServer Webapp path: C:\Zeppelin\webapps
INFO [2021-01-29 17:46:19,016] ({main} ZeppelinServer.java[setupWebAppContext]:575) - warPath is: zeppelin-web-angular/dist
INFO [2021-01-29 17:46:19,016] ({main} ZeppelinServer.java[setupWebAppContext]:588) - ZeppelinServer Webapp path: C:\Zeppelin\webapps\next
INFO [2021-01-29 17:46:19,051] ({ImmediateThread-1611960378676} GitNotebookRepo.java[init]:77) - Opening a git repo at '/C:/Zeppelin/notebook'
INFO [2021-01-29 17:46:19,111] ({main} NotebookServer.java[<init>]:157) - NotebookServer instantiated: org.apache.zeppelin.socket.NotebookServer#1b2abca6
INFO [2021-01-29 17:46:19,112] ({main} NotebookServer.java[setNotebook]:168) - Injected NotebookProvider
INFO [2021-01-29 17:46:19,114] ({main} NotebookServer.java[setNotebookService]:175) - Injected NotebookServiceProvider
INFO [2021-01-29 17:46:19,115] ({main} NotebookServer.java[setAuthorizationServiceProvider]:182) - Injected NotebookAuthorizationServiceProvider
INFO [2021-01-29 17:46:19,115] ({main} NotebookServer.java[setConnectionManagerProvider]:188) - Injected ConnectionManagerProvider
INFO [2021-01-29 17:46:19,116] ({main} NotebookServer.java[setServiceLocator]:162) - Injected ServiceLocator: ServiceLocatorImpl(shared-locator,0,891095110)
INFO [2021-01-29 17:46:19,118] ({main} ZeppelinServer.java[setupClusterManagerServer]:465) - Cluster mode is disabled
INFO [2021-01-29 17:46:19,118] ({main} ZeppelinServer.java[main]:249) - Starting zeppelin server
INFO [2021-01-29 17:46:19,121] ({main} Server.java[doStart]:360) - jetty-9.4.31.v20200723; built: 2020-07-23T17:57:36.812Z; git: 450ba27947e13e66baa8cd1ce7e85a4461cacc1d; jvm 1.8.0_281-b09
INFO [2021-01-29 17:46:19,288] ({main} StandardDescriptorProcessor.java[visitServlet]:276) - NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet
INFO [2021-01-29 17:46:19,309] ({main} DefaultSessionIdManager.java[doStart]:334) - DefaultSessionIdManager workerName=node0
INFO [2021-01-29 17:46:19,310] ({main} DefaultSessionIdManager.java[doStart]:339) - No SessionScavenger set, using defaults
INFO [2021-01-29 17:46:19,313] ({main} HouseKeeper.java[startScavenging]:140) - node0 Scavenging every 660000ms
INFO [2021-01-29 17:46:19,327] ({main} ContextHandler.java[log]:2303) - Initializing Shiro environment
INFO [2021-01-29 17:46:19,327] ({main} EnvironmentLoader.java[initEnvironment]:133) - Starting Shiro environment initialization.
INFO [2021-01-29 17:46:21,130] ({main} EnvironmentLoader.java[initEnvironment]:147) - Shiro environment initialized in 1802 ms.
INFO [2021-01-29 17:46:23,071] ({main} ContextHandler.java[doStart]:860) - Started o.e.j.w.WebAppContext#4a668b6e{zeppelin-web-angular,/,jar:file:///C:/Zeppelin/zeppelin-web-angular-0.9.0.war!/,AVAILABLE}{C:\Zeppelin\zeppelin-web-angular-0.9.0.war}
WARN [2021-01-29 17:46:23,083] ({main} WebInfConfiguration.java[unpack]:662) - Web application not found C:\WINDOWS\system32\zeppelin-web-angular\dist
WARN [2021-01-29 17:46:23,085] ({main} WebAppContext.java[doStart]:533) - Failed startup of context o.e.j.w.WebAppContext#4e268090{/next,null,UNAVAILABLE}{C:\WINDOWS\system32\zeppelin-web-angular\dist}
java.io.FileNotFoundException: C:\WINDOWS\system32\zeppelin-web-angular\dist
at org.eclipse.jetty.webapp.WebInfConfiguration.unpack(WebInfConfiguration.java:663)
at org.eclipse.jetty.webapp.WebInfConfiguration.preConfigure(WebInfConfiguration.java:141)
at org.eclipse.jetty.webapp.WebAppContext.preConfigure(WebAppContext.java:488)
at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:523)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:117)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at io.micrometer.core.instrument.binder.jetty.TimedHandler.doStart(TimedHandler.java:162)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.server.Server.start(Server.java:408)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.server.Server.doStart(Server.java:372)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72)
at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:251)
INFO [2021-01-29 17:46:23,119] ({main} AbstractConnector.java[doStart]:331) - Started ServerConnector#7ce6a65d{HTTP/1.1, (http/1.1)}{127.0.0.1:8080}
INFO [2021-01-29 17:46:23,120] ({main} Server.java[doStart]:400) - Started #5677ms
INFO [2021-01-29 17:46:28,129] ({main} ZeppelinServer.java[main]:263) - Done, zeppelin server started
WARN [2021-01-29 17:46:28,151] ({main} VFSNotebookRepo.java[listFolder]:107) - Skip hidden folder: /Zeppelin/notebook/.git
WARN [2021-01-29 17:46:28,154] ({main} LocalConfigStorage.java[loadNotebookAuthorization]:77) - NotebookAuthorization file C:\Zeppelin\conf\notebook-authorization.json is not existed
INFO [2021-01-29 17:46:28,369] ({Thread-12} RemoteInterpreterEventServer.java[run]:105) - InterpreterEventServer is starting at 192.168.0.3:55104
INFO [2021-01-29 17:46:28,870] ({main} RemoteInterpreterEventServer.java[start]:133) - RemoteInterpreterEventServer is started
INFO [2021-01-29 17:46:28,880] ({main} InterpreterSettingManager.java[<init>]:197) - Using RecoveryStorage: org.apache.zeppelin.interpreter.recovery.NullRecoveryStorage
INFO [2021-01-29 17:46:28,929] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: alluxio
INFO [2021-01-29 17:46:28,932] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: angular
INFO [2021-01-29 17:46:28,936] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: beam
INFO [2021-01-29 17:46:28,941] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: bigquery
INFO [2021-01-29 17:46:28,947] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: cassandra
INFO [2021-01-29 17:46:28,950] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: elasticsearch
INFO [2021-01-29 17:46:28,954] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: file
INFO [2021-01-29 17:46:28,959] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: flink
INFO [2021-01-29 17:46:28,962] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: geode
INFO [2021-01-29 17:46:28,964] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: groovy
INFO [2021-01-29 17:46:28,966] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: hazelcastjet
INFO [2021-01-29 17:46:28,969] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: hbase
INFO [2021-01-29 17:46:28,971] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: ignite
INFO [2021-01-29 17:46:28,975] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: influxdb
INFO [2021-01-29 17:46:28,977] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: java
INFO [2021-01-29 17:46:28,980] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: jdbc
INFO [2021-01-29 17:46:28,985] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: jupyter
INFO [2021-01-29 17:46:28,988] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: kotlin
INFO [2021-01-29 17:46:28,993] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: ksql
INFO [2021-01-29 17:46:28,996] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: kylin
INFO [2021-01-29 17:46:28,999] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: lens
INFO [2021-01-29 17:46:29,004] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: livy
INFO [2021-01-29 17:46:29,010] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: md
INFO [2021-01-29 17:46:29,015] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: mongodb
INFO [2021-01-29 17:46:29,019] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: neo4j
INFO [2021-01-29 17:46:29,020] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: pig
INFO [2021-01-29 17:46:29,024] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: python
INFO [2021-01-29 17:46:29,027] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: r
INFO [2021-01-29 17:46:29,030] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: sap
INFO [2021-01-29 17:46:29,033] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: scalding
WARN [2021-01-29 17:46:29,069] ({main} InterpreterSettingManager.java[loadInterpreterSettingFromDefaultDir]:437) - No interpreter-setting.json found in C:\Zeppelin\interpreter\scio
INFO [2021-01-29 17:46:29,071] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: sh
INFO [2021-01-29 17:46:29,078] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: spark
INFO [2021-01-29 17:46:29,081] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: sparql
INFO [2021-01-29 17:46:29,084] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:540) - Register InterpreterSettingTemplate: submarine
INFO [2021-01-29 17:46:29,086] ({main} LocalConfigStorage.java[loadInterpreterSettings]:63) - Load Interpreter Setting from file: C:\Zeppelin\conf\interpreter.json
INFO [2021-01-29 17:46:29,175] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting beam from interpreter.json
INFO [2021-01-29 17:46:29,177] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting ignite from interpreter.json
INFO [2021-01-29 17:46:29,177] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting geode from interpreter.json
INFO [2021-01-29 17:46:29,178] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting jdbc from interpreter.json
INFO [2021-01-29 17:46:29,179] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting influxdb from interpreter.json
INFO [2021-01-29 17:46:29,180] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting lens from interpreter.json
INFO [2021-01-29 17:46:29,180] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting pig from interpreter.json
INFO [2021-01-29 17:46:29,181] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting file from interpreter.json
INFO [2021-01-29 17:46:29,182] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting java from interpreter.json
INFO [2021-01-29 17:46:29,183] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting jupyter from interpreter.json
INFO [2021-01-29 17:46:29,183] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting elasticsearch from interpreter.json
INFO [2021-01-29 17:46:29,184] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting submarine from interpreter.json
INFO [2021-01-29 17:46:29,185] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting sh from interpreter.json
INFO [2021-01-29 17:46:29,186] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting spark from interpreter.json
INFO [2021-01-29 17:46:29,187] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting md from interpreter.json
INFO [2021-01-29 17:46:29,187] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting hazelcastjet from interpreter.json
INFO [2021-01-29 17:46:29,188] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting alluxio from interpreter.json
INFO [2021-01-29 17:46:29,189] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting bigquery from interpreter.json
INFO [2021-01-29 17:46:29,190] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting mongodb from interpreter.json
INFO [2021-01-29 17:46:29,192] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting hbase from interpreter.json
INFO [2021-01-29 17:46:29,192] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting python from interpreter.json
INFO [2021-01-29 17:46:29,193] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting sap from interpreter.json
INFO [2021-01-29 17:46:29,194] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting kotlin from interpreter.json
INFO [2021-01-29 17:46:29,194] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting scalding from interpreter.json
INFO [2021-01-29 17:46:29,195] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting flink from interpreter.json
INFO [2021-01-29 17:46:29,196] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting angular from interpreter.json
INFO [2021-01-29 17:46:29,196] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting ksql from interpreter.json
INFO [2021-01-29 17:46:29,197] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting livy from interpreter.json
INFO [2021-01-29 17:46:29,197] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting r from interpreter.json
INFO [2021-01-29 17:46:29,198] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting groovy from interpreter.json
INFO [2021-01-29 17:46:29,199] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting neo4j from interpreter.json
INFO [2021-01-29 17:46:29,203] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting cassandra from interpreter.json
INFO [2021-01-29 17:46:29,204] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting sparql from interpreter.json
INFO [2021-01-29 17:46:29,205] ({main} InterpreterSettingManager.java[loadFromFile]:294) - Create interpreter setting kylin from interpreter.json
INFO [2021-01-29 17:46:29,211] ({main} LocalConfigStorage.java[save]:53) - Save Interpreter Setting to C:\Zeppelin\conf\interpreter.json
INFO [2021-01-29 17:46:29,310] ({main} LuceneSearch.java[<init>]:93) - Use C:\Zeppelin\tmp\zeppelin-index for storing lucene search index

I suggest you stop running Zeppelin under Windows. Besides that old versions (like 0.8.0) had Windows in the README, the new version of Zeppelin - 0.9.0 - doesn't even mention Windows in the list of supported platforms.
As far as I understand, the Zeppelin team is not as large to provide Windows support, and you will encounter a lot of bugs, and the only one who can fix it is you.
In ancient times, messengers who delivered bad news were killed. I hope something has changed since then!
You can try to run Zeppelin under Docker, WSL2, or inside the full virtual machine with Linux inside.
The easiest way to run Zeppelin in Windows is to install Docker for Windows, and then run something like docker run -p 8080:8080 --rm --name zeppelin apache/zeppelin:0.9.0

Related

Apache Zeppelin not loading in a browser in windows 10

I followed the steps mentioned here https://gist.github.com/codspire/7b0955b9e67fe73f6118dad9539cbaa2
When entered "localhost:8080" in a browser nothing happens
Hadoop version -- 3.1.3
Spark version -- 3.0.0-preview pre-built for hadoop2.7
Zeppelin version -- 0.9.0-preview1
C:\Zeppelin>bin\zeppelin.cmd
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0
WARN [2020-04-07 16:29:59,113] ({main}ZeppelinConfiguration.java[create]:159) - Failed to load configuration, proceeding with a default
INFO [2020-04-07 16:29:59,177] ({main} ZeppelinConfiguration.java[create]:171) - Server Host: 127.0.0.1
INFO [2020-04-07 16:29:59,177] ({main} ZeppelinConfiguration.java[create]:173) - Server Port: 8080
INFO [2020-04-07 16:29:59,178] ({main} ZeppelinConfiguration.java[create]:177) - Context Path: /
INFO [2020-04-07 16:29:59,178] ({main} ZeppelinConfiguration.java[create]:178) - Zeppelin Version: 0.9.0-preview1
INFO [2020-04-07 16:29:59,205] ({main} Log.java[initialized]:193) - Logging initialized #810ms to org.eclipse.jetty.util.log.Slf4jLog
WARN [2020-04-07 16:29:59,516] ({main} ZeppelinConfiguration.java[getConfigFSDir]:631) - zeppelin.config.fs.dir is not specified, fall back to local conf directory zeppelin.conf.dir
INFO [2020-04-07 16:29:59,554] ({main} Credentials.java[loadFromFile]:121) - C:\Zeppelin\conf\credentials.json
INFO [2020-04-07 16:29:59,594] ({ImmediateThread-1586257199511} PluginManager.java[loadNotebookRepo]:60) - Loading NotebookRepo Plugin: org.apache.zeppelin.notebook.repo.GitNotebookRepo
INFO [2020-04-07 16:29:59,658] ({main} ZeppelinServer.java[setupWebAppContext]:488) - warPath is: C:\Zeppelin\zeppelin-web-angular-0.9.0-preview1.war
INFO [2020-04-07 16:29:59,659] ({main} ZeppelinServer.java[setupWebAppContext]:501) - ZeppelinServer Webapp path: C:\Zeppelin\webapps
INFO [2020-04-07 16:29:59,729] ({ImmediateThread-1586257199511} VFSNotebookRepo.java[setNotebookDirectory]:70) - Using notebookDir: C:\Zeppelin\notebook
INFO [2020-04-07 16:29:59,746] ({main} ZeppelinServer.java[setupWebAppContext]:488) - warPath is: zeppelin-web-angular/dist
INFO [2020-04-07 16:29:59,747] ({main} ZeppelinServer.java[setupWebAppContext]:501) - ZeppelinServer Webapp path: C:\Zeppelin\webapps\next
INFO [2020-04-07 16:29:59,811] ({main} NotebookServer.java[<init>]:153) - NotebookServer instantiated: org.apache.zeppelin.socket.NotebookServer#683dbc2c
INFO [2020-04-07 16:29:59,812] ({main} NotebookServer.java[setServiceLocator]:158) - Injected ServiceLocator: ServiceLocatorImpl(shared-locator,0,246550802)
INFO [2020-04-07 16:29:59,814] ({main} NotebookServer.java[setAuthorizationServiceProvider]:178) - Injected NotebookAuthorizationServiceProvider
INFO [2020-04-07 16:29:59,814] ({main} NotebookServer.java[setNotebookService]:171) - Injected NotebookServiceProvider
INFO [2020-04-07 16:29:59,814] ({main} NotebookServer.java[setConnectionManagerProvider]:184) - Injected ConnectionManagerProvider
INFO [2020-04-07 16:29:59,815] ({main} NotebookServer.java[setNotebook]:164) - Injected NotebookProvider
INFO [2020-04-07 16:29:59,816] ({main} ZeppelinServer.java[setupClusterManagerServer]:439) - Cluster mode is disabled
INFO [2020-04-07 16:29:59,827] ({main} ZeppelinServer.java[main]:251) - Starting zeppelin server
INFO [2020-04-07 16:29:59,829] ({main} Server.java[doStart]:370) - jetty-9.4.18.v20190429; built: 2019-04-29T20:42:08.989Z; git: e1bc35120a6617ee3df052294e433f3a25ce7097; jvm 1.8.0_241-b07
INFO [2020-04-07 16:29:59,858] ({ImmediateThread-1586257199511} GitNotebookRepo.java[init]:77) - Opening a git repo at '/C:/Zeppelin/notebook'
INFO [2020-04-07 16:29:59,967] ({main} StandardDescriptorProcessor.java[visitServlet]:283) - NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet
INFO [2020-04-07 16:29:59,982] ({main} DefaultSessionIdManager.java[doStart]:365) - DefaultSessionIdManager workerName=node0
INFO [2020-04-07 16:29:59,982] ({main} DefaultSessionIdManager.java[doStart]:370) - No SessionScavenger set, using defaults
INFO [2020-04-07 16:29:59,985] ({main} HouseKeeper.java[startScavenging]:149) - node0 Scavenging every 600000ms
INFO [2020-04-07 16:30:02,046] ({main} ContextHandler.java[doStart]:855) - Started o.e.j.w.WebAppContext#6150c3ec{zeppelin-web-angular,/,jar:file:///C:/Zeppelin/zeppelin-web-angular-0.9.0-preview1.war!/,AVAILABLE}{C:\Zeppelin\zeppelin-web-angular-0.9.0-preview1.war}
WARN [2020-04-07 16:30:02,051] ({main} WebInfConfiguration.java[unpack]:675) - Web application not found C:\Zeppelin\zeppelin-web-angular\dist
WARN [2020-04-07 16:30:02,052] ({main} WebAppContext.java[doStart]:554) - Failed startup of context o.e.j.w.WebAppContext#229f66ed{/next,null,UNAVAILABLE}{C:\Zeppelin\zeppelin-web-angular\dist}
java.io.FileNotFoundException: C:\Zeppelin\zeppelin-web-angular\dist
at org.eclipse.jetty.webapp.WebInfConfiguration.unpack(WebInfConfiguration.java:676)
at org.eclipse.jetty.webapp.WebInfConfiguration.preConfigure(WebInfConfiguration.java:152)
at org.eclipse.jetty.webapp.WebAppContext.preConfigure(WebAppContext.java:506)
at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:544)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:167)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:119)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:167)
at org.eclipse.jetty.server.Server.start(Server.java:418)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113)
at org.eclipse.jetty.server.Server.doStart(Server.java:382)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:253)
INFO [2020-04-07 16:30:02,906] ({main} AbstractConnector.java[doStart]:292) - Started ServerConnector#4493d195{HTTP/1.1,[http/1.1]}{127.0.0.1:8080}
INFO [2020-04-07 16:30:02,906] ({main} Server.java[doStart]:410) - Started #4519ms
INFO [2020-04-07 16:30:07,924] ({main} ZeppelinServer.java[main]:265) - Done, zeppelin server started
To install Zeppelin 9.0 on Windows 10:
Unzip the wan folders (with Winrar) into bin/zeppelin-web-angular/dist and bin/zeppelin-web/dist.
Then modify the config file shiro.ini to change the user and pass (The default are admin and password1)
Possibly this workaround might help. "zeppelin-web-angular-0.9.0-preview1.war" comes along with the package as shown in below image, create required folders and then unzip the content. Post restarting the server, the web pages should be available.
Following links will be also useful to setup Zeppelin for windows 10,
https://gist.github.com/codspire/7b0955b9e67fe73f6118dad9539cbaa2
https://hernandezpaul.wordpress.com/2016/11/14/apache-zeppelin-installation-on-windows-10/
I also tried with Zepplin 0.9.0 on windows 10. working fine.
Go to bin -> mkdir -p zeppelin-web-angular/dist and mkdir -p zeppelin-web/dist
Copy zeppelin-web-angular-0.9.0-preview2.war and zeppelin-web-0.9.0-preview2.war into dist folder respectively
unzip it
remove war files from dist folder
start Zepplin.cmd
I got the same issue. I posted same query on official website of zeppelin on which some one replied that zeppelin is not supported on window 10.
https://issues.apache.org/jira/browse/ZEPPELIN-4749?filter=-2
I tried with 0.9, 0.8, 0.7 version of zeppelin, none of them working[on window 10] and show same blank url on localhost:8080. But recently now I have downloaded 0.6.2 version to find that this version is running fine. So I think we have to work on lower version of zeppelin or if you are using ubuntu all the version will run fine.
I tried this version http://www.apache.org/dyn/closer.cgi/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1-bin-netinst.tgz and it successful
Observed same issue with v0.10.0.
Followed below steps and it worked.
Create dist directories at home path(D:\Zeppline\zeppelin-0.10.1-bin-all\zeppelin-0.10.1-bin-all) as below ->
mkdir -p zeppelin-web-angular/dist and mkdir -p zeppelin-web/dist
Copy zeppelin-web-angular-0.10.1.war and zeppelin-web-0.10.1.war into dist folder respectively
unzip it
remove war files from dist folder
start Zepplin.cmd
enter image description here
Try to set ZEPPELIN_ANGULAR_WAR env variable to location of war file. E.g.
c:\zeppelin-home\zeppelin-web-angular-0.10.1.war
The current answer by the developers is that zeppelin 0.9 will not work on windows 10.
On windows 10, you can run zeppelin 0.9 in a docker container as a workaround
Refer to the instructions on this page
http://zeppelin.apache.org/download.html
If you have docker installed, use this command to launch Apache Zeppelin in a container.
docker run -p 8080:8080 --rm --name zeppelin apache/zeppelin:0.9.0

Datastax Spark: Job failed on Zeppelin

I have set up Datastax Enterprice in three nodes in the local network.
Two nodes are debian servers and i used apt package manager for installation. The last node is iMac and i used the .dmg package for installation.
Node #1:
OS: Debian GNU/Linux 8.10 (jessie)
Local IP: 172.16.21.18
Datastax Enterprice: 5.1.7
Node #2:
OS: Ubuntu 16.04.3 LTS
Local IP: 172.16.21.25
Datastax Enterprice: 5.1.7
Node #1:
OS: macOS 10.13.2
Local IP: 192.168.1.108
Datastax Enterprice: 5.1.7
Nodes are up and running in analytics and search mode: ($ dse cassandra -k -s)
Now, I'm trying to connect on Spark Cluster using Apache Zeppelin 0.7.3. Apache Zeppelin is installed and configured in Node #1.
I followed these instructions for configuration. Below you can see some basic changes in config files:
zeppelin-0.7.3-bin-all/conf/zeppelin-env.sh
[..]
export MASTER=spark://172.16.21.18:7077 # Spark master url. eg. spark://master_addr:7077. Leave empty if you want to use local mode.
export JAVA_HOME=/usr/lib/jvm/java-8-oracle
export DSE_HOME=/usr
[..]
zeppelin-0.7.3-bin-all/bin/interpreter.sh
[..]
# set spark related env variables
if [[ "${INTERPRETER_ID}" == "spark" ]]; then
if [[ -n "${SPARK_HOME}" ]]; then
export SPARK_SUBMIT="${DSE_HOME}/bin/dse spark-submit"
[..]
Zeppelin Spark Intepreter:
Zeppelin CQL intepreter works perfect with Apache Cassandra but then i'm trying to use Spark Intepreter to execute some queries i'm getting this error:
%spark
val results = spark.sql("SELECT * from keyspace.table")
java.lang.NullPointerException
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33)
[..]
complete zeppelin log file:
INFO [2018-02-21 04:25:36,185] ({Thread-0} RemoteInterpreterServer.java[run]:97) - Starting remote interpreter server on port 52127
INFO [2018-02-21 04:25:36,562] ({pool-1-thread-3} RemoteInterpreterServer.java[createInterpreter]:198) - Instantiate interpreter org.apache.zeppelin.spark.SparkInterpreter
INFO [2018-02-21 04:25:36,589] ({pool-1-thread-3} RemoteInterpreterServer.java[createInterpreter]:198) - Instantiate interpreter org.apache.zeppelin.spark.SparkSqlInterpreter
INFO [2018-02-21 04:25:36,601] ({pool-1-thread-3} RemoteInterpreterServer.java[createInterpreter]:198) - Instantiate interpreter org.apache.zeppelin.spark.DepInterpreter
INFO [2018-02-21 04:25:36,619] ({pool-1-thread-3} RemoteInterpreterServer.java[createInterpreter]:198) - Instantiate interpreter org.apache.zeppelin.spark.PySparkInterpreter
INFO [2018-02-21 04:25:36,622] ({pool-1-thread-3} RemoteInterpreterServer.java[createInterpreter]:198) - Instantiate interpreter org.apache.zeppelin.spark.SparkRInterpreter
INFO [2018-02-21 04:25:36,683] ({pool-2-thread-2} SchedulerFactory.java[jobStarted]:131) - Job remoteInterpretJob_1519205136682 started by scheduler org.apache.zeppelin.spark.SparkInterpreter269729544
INFO [2018-02-21 04:25:40,733] ({pool-2-thread-2} SparkInterpreter.java[createSparkSession]:318) - ------ Create new SparkContext spark://172.16.21.18:7077 -------
WARN [2018-02-21 04:25:40,740] ({pool-2-thread-2} SparkInterpreter.java[setupConfForSparkR]:577) - sparkr.zip is not found, sparkr may not work.
INFO [2018-02-21 04:25:40,786] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Running Spark version 2.1.0
WARN [2018-02-21 04:25:41,760] ({pool-2-thread-2} NativeCodeLoader.java[<clinit>]:62) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
WARN [2018-02-21 04:25:41,958] ({pool-2-thread-2} Logging.scala[logWarning]:66) -
SPARK_CLASSPATH was detected (set to ':/home/cassandra/zeppelin-0.7.3-bin-all/interpreter/spark/dep/*:/home/cassandra/zeppelin-0.7.3-bin-all/interpreter/spark/*:/home/cassandra/zeppelin-0.7.3-bin-all/lib/interpreter/*:').
This is deprecated in Spark 1.0+.
Please instead use:
- ./spark-submit with --driver-class-path to augment the driver classpath
- spark.executor.extraClassPath to augment the executor classpath
WARN [2018-02-21 04:25:41,959] ({pool-2-thread-2} Logging.scala[logWarning]:66) - Setting 'spark.executor.extraClassPath' to ':/home/cassandra/zeppelin-0.7.3-bin-all/interpreter/spark/dep/*:/home/cassandra/zeppelin-0.7.3-bin-all/interpreter/spark/*:/home/cassandra/zeppelin-0.7.3-bin-all/lib/interpreter/*:' as a work-around.
WARN [2018-02-21 04:25:41,960] ({pool-2-thread-2} Logging.scala[logWarning]:66) - Setting 'spark.driver.extraClassPath' to ':/home/cassandra/zeppelin-0.7.3-bin-all/interpreter/spark/dep/*:/home/cassandra/zeppelin-0.7.3-bin-all/interpreter/spark/*:/home/cassandra/zeppelin-0.7.3-bin-all/lib/interpreter/*:' as a work-around.
WARN [2018-02-21 04:25:41,986] ({pool-2-thread-2} Logging.scala[logWarning]:66) - Your hostname, XPLAIN005 resolves to a loopback address: 127.0.1.1; using 172.16.21.18 instead (on interface eth0)
WARN [2018-02-21 04:25:41,987] ({pool-2-thread-2} Logging.scala[logWarning]:66) - Set SPARK_LOCAL_IP if you need to bind to another address
INFO [2018-02-21 04:25:42,017] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Changing view acls to: cassandra
INFO [2018-02-21 04:25:42,017] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Changing modify acls to: cassandra
INFO [2018-02-21 04:25:42,018] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Changing view acls groups to:
INFO [2018-02-21 04:25:42,019] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Changing modify acls groups to:
INFO [2018-02-21 04:25:42,019] ({pool-2-thread-2} Logging.scala[logInfo]:54) - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(cassandra); groups with view permissions: Set(); users with modify permissions: Set(cassandra); groups with modify permissions: Set()
INFO [2018-02-21 04:25:42,417] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Successfully started service 'sparkDriver' on port 51240.
INFO [2018-02-21 04:25:42,445] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Registering MapOutputTracker
INFO [2018-02-21 04:25:42,476] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Registering BlockManagerMaster
INFO [2018-02-21 04:25:42,481] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
INFO [2018-02-21 04:25:42,482] ({pool-2-thread-2} Logging.scala[logInfo]:54) - BlockManagerMasterEndpoint up
INFO [2018-02-21 04:25:42,507] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Created local directory at /tmp/blockmgr-797ea400-69f1-4228-a6da-fe424edce8d4
INFO [2018-02-21 04:25:42,524] ({pool-2-thread-2} Logging.scala[logInfo]:54) - MemoryStore started with capacity 408.9 MB
INFO [2018-02-21 04:25:42,591] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Registering OutputCommitCoordinator
INFO [2018-02-21 04:25:42,700] ({pool-2-thread-2} Log.java[initialized]:186) - Logging initialized #6930ms
INFO [2018-02-21 04:25:42,864] ({pool-2-thread-2} Server.java[doStart]:327) - jetty-9.2.z-SNAPSHOT
INFO [2018-02-21 04:25:42,902] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#2cbd702d{/jobs,null,AVAILABLE}
INFO [2018-02-21 04:25:42,903] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#240b993c{/jobs/json,null,AVAILABLE}
INFO [2018-02-21 04:25:42,903] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#5b7d8292{/jobs/job,null,AVAILABLE}
INFO [2018-02-21 04:25:42,908] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#4c2353ff{/jobs/job/json,null,AVAILABLE}
INFO [2018-02-21 04:25:42,909] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#bd87e4e{/stages,null,AVAILABLE}
INFO [2018-02-21 04:25:42,910] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#73e2d470{/stages/json,null,AVAILABLE}
INFO [2018-02-21 04:25:42,917] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#44bca18c{/stages/stage,null,AVAILABLE}
INFO [2018-02-21 04:25:42,918] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#1256be4f{/stages/stage/json,null,AVAILABLE}
INFO [2018-02-21 04:25:42,919] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#5a349845{/stages/pool,null,AVAILABLE}
INFO [2018-02-21 04:25:42,919] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#3f108627{/stages/pool/json,null,AVAILABLE}
INFO [2018-02-21 04:25:42,926] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#1e01f088{/storage,null,AVAILABLE}
INFO [2018-02-21 04:25:42,927] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#390281c1{/storage/json,null,AVAILABLE}
INFO [2018-02-21 04:25:42,927] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#470ac014{/storage/rdd,null,AVAILABLE}
INFO [2018-02-21 04:25:42,927] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#7c90476c{/storage/rdd/json,null,AVAILABLE}
INFO [2018-02-21 04:25:42,928] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#6d847dc6{/environment,null,AVAILABLE}
INFO [2018-02-21 04:25:42,936] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#40a5e53e{/environment/json,null,AVAILABLE}
INFO [2018-02-21 04:25:42,937] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#513e975e{/executors,null,AVAILABLE}
INFO [2018-02-21 04:25:42,937] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#2f6b1132{/executors/json,null,AVAILABLE}
INFO [2018-02-21 04:25:42,938] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#61cf2354{/executors/threadDump,null,AVAILABLE}
INFO [2018-02-21 04:25:42,939] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#eacb646{/executors/threadDump/json,null,AVAILABLE}
INFO [2018-02-21 04:25:42,951] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#2b8d44aa{/static,null,AVAILABLE}
INFO [2018-02-21 04:25:42,953] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#5c982268{/,null,AVAILABLE}
INFO [2018-02-21 04:25:42,954] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#44556f2c{/api,null,AVAILABLE}
INFO [2018-02-21 04:25:42,955] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#2fa0ef66{/jobs/job/kill,null,AVAILABLE}
INFO [2018-02-21 04:25:42,955] ({pool-2-thread-2} ContextHandler.java[doStart]:744) - Started o.s.j.s.ServletContextHandler#6e49562c{/stages/stage/kill,null,AVAILABLE}
INFO [2018-02-21 04:25:42,970] ({pool-2-thread-2} AbstractConnector.java[doStart]:266) - Started ServerConnector#53405611{HTTP/1.1}{0.0.0.0:4040}
INFO [2018-02-21 04:25:42,971] ({pool-2-thread-2} Server.java[doStart]:379) - Started #7201ms
INFO [2018-02-21 04:25:42,971] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Successfully started service 'SparkUI' on port 4040.
INFO [2018-02-21 04:25:42,974] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Bound SparkUI to 0.0.0.0, and started at http://172.16.21.18:4040
INFO [2018-02-21 04:25:43,214] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Added file file:/home/cassandra/zeppelin-0.7.3-bin-all/interpreter/spark/pyspark/pyspark.zip at spark://172.16.21.18:51240/files/pyspark.zip with timestamp 1519205143214
INFO [2018-02-21 04:25:43,217] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Copying /home/cassandra/zeppelin-0.7.3-bin-all/interpreter/spark/pyspark/pyspark.zip to /tmp/spark-2e9292e3-8c4d-445a-92f0-7d54188818db/userFiles-4e8301a5-91bc-4753-8436-6cced0bdc5c5/pyspark.zip
INFO [2018-02-21 04:25:43,226] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Added file file:/home/cassandra/zeppelin-0.7.3-bin-all/interpreter/spark/pyspark/py4j-0.10.4-src.zip at spark://172.16.21.18:51240/files/py4j-0.10.4-src.zip with timestamp 1519205143226
INFO [2018-02-21 04:25:43,227] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Copying /home/cassandra/zeppelin-0.7.3-bin-all/interpreter/spark/pyspark/py4j-0.10.4-src.zip to /tmp/spark-2e9292e3-8c4d-445a-92f0-7d54188818db/userFiles-4e8301a5-91bc-4753-8436-6cced0bdc5c5/py4j-0.10.4-src.zip
INFO [2018-02-21 04:25:43,279] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Created default pool default, schedulingMode: FIFO, minShare: 0, weight: 1
INFO [2018-02-21 04:25:43,325] ({appclient-register-master-threadpool-0} Logging.scala[logInfo]:54) - Connecting to master spark://172.16.21.18:7077...
INFO [2018-02-21 04:25:43,391] ({netty-rpc-connection-0} TransportClientFactory.java[createClient]:250) - Successfully created connection to /172.16.21.18:7077 after 33 ms (0 ms spent in bootstraps)
INFO [2018-02-21 04:26:03,326] ({appclient-register-master-threadpool-0} Logging.scala[logInfo]:54) - Connecting to master spark://172.16.21.18:7077...
INFO [2018-02-21 04:26:23,326] ({appclient-register-master-threadpool-0} Logging.scala[logInfo]:54) - Connecting to master spark://172.16.21.18:7077...
ERROR [2018-02-21 04:26:43,328] ({appclient-registration-retry-thread} Logging.scala[logError]:70) - Application has been killed. Reason: All masters are unresponsive! Giving up.
WARN [2018-02-21 04:26:43,328] ({pool-2-thread-2} Logging.scala[logWarning]:66) - Application ID is not initialized yet.
INFO [2018-02-21 04:26:43,336] ({stop-spark-context} AbstractConnector.java[doStop]:306) - Stopped ServerConnector#53405611{HTTP/1.1}{0.0.0.0:4040}
INFO [2018-02-21 04:26:43,339] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 40068.
INFO [2018-02-21 04:26:43,498] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Server created on 172.16.21.18:40068
INFO [2018-02-21 04:26:43,499] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#6e49562c{/stages/stage/kill,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,500] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#2fa0ef66{/jobs/job/kill,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,501] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#44556f2c{/api,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,501] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#5c982268{/,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,505] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#2b8d44aa{/static,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,506] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#eacb646{/executors/threadDump/json,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,507] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#61cf2354{/executors/threadDump,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,508] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
INFO [2018-02-21 04:26:43,508] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#2f6b1132{/executors/json,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,509] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#513e975e{/executors,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,510] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#40a5e53e{/environment/json,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,511] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#6d847dc6{/environment,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,511] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#7c90476c{/storage/rdd/json,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,512] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#470ac014{/storage/rdd,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,513] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#390281c1{/storage/json,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,513] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#1e01f088{/storage,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,513] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#3f108627{/stages/pool/json,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,514] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Registering BlockManager BlockManagerId(driver, 172.16.21.18, 40068, None)
INFO [2018-02-21 04:26:43,514] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#5a349845{/stages/pool,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,515] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#1256be4f{/stages/stage/json,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,515] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#44bca18c{/stages/stage,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,516] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#73e2d470{/stages/json,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,516] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#bd87e4e{/stages,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,517] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#4c2353ff{/jobs/job/json,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,517] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#5b7d8292{/jobs/job,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,518] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#240b993c{/jobs/json,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,518] ({stop-spark-context} ContextHandler.java[doStop]:865) - Stopped o.s.j.s.ServletContextHandler#2cbd702d{/jobs,null,UNAVAILABLE}
INFO [2018-02-21 04:26:43,521] ({dispatcher-event-loop-0} Logging.scala[logInfo]:54) - Registering block manager 172.16.21.18:40068 with 408.9 MB RAM, BlockManagerId(driver, 172.16.21.18, 40068, None)
INFO [2018-02-21 04:26:43,522] ({stop-spark-context} Logging.scala[logInfo]:54) - Stopped Spark web UI at http://172.16.21.18:4040
INFO [2018-02-21 04:26:43,526] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Registered BlockManager BlockManagerId(driver, 172.16.21.18, 40068, None)
INFO [2018-02-21 04:26:43,527] ({pool-2-thread-2} Logging.scala[logInfo]:54) - Initialized BlockManager: BlockManagerId(driver, 172.16.21.18, 40068, None)
INFO [2018-02-21 04:26:43,530] ({stop-spark-context} Logging.scala[logInfo]:54) - Shutting down all executors
INFO [2018-02-21 04:26:43,546] ({dispatcher-event-loop-1} Logging.scala[logInfo]:54) - Asking each executor to shut down
WARN [2018-02-21 04:26:43,561] ({dispatcher-event-loop-0} Logging.scala[logWarning]:66) - Drop UnregisterApplication(null) because has not yet connected to master
INFO [2018-02-21 04:26:43,583] ({dispatcher-event-loop-2} Logging.scala[logInfo]:54) - MapOutputTrackerMasterEndpoint stopped!
INFO [2018-02-21 04:26:43,596] ({stop-spark-context} Logging.scala[logInfo]:54) - MemoryStore cleared
INFO [2018-02-21 04:26:43,597] ({stop-spark-context} Logging.scala[logInfo]:54) - BlockManager stopped
INFO [2018-02-21 04:26:43,605] ({stop-spark-context} Logging.scala[logInfo]:54) - BlockManagerMaster stopped
INFO [2018-02-21 04:26:43,608] ({dispatcher-event-loop-1} Logging.scala[logInfo]:54) - OutputCommitCoordinator stopped!
ERROR [2018-02-21 04:26:43,748] ({pool-2-thread-2} Logging.scala[logError]:91) - Error initializing SparkContext.
java.lang.IllegalArgumentException: requirement failed: Can only call getServletHandlers on a running MetricsSystem
at scala.Predef$.require(Predef.scala:224)
at org.apache.spark.metrics.MetricsSystem.getServletHandlers(MetricsSystem.scala:91)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:524)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2313)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$6.apply(SparkSession.scala:868)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$6.apply(SparkSession.scala:860)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:860)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33)
at org.apache.zeppelin.spark.SparkInterpreter.createSparkSession(SparkInterpreter.java:378)
at org.apache.zeppelin.spark.SparkInterpreter.getSparkSession(SparkInterpreter.java:233)
at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:841)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:491)
at org.apache.zeppelin.scheduler.Job.run(Job.java:175)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
INFO [2018-02-21 04:26:43,751] ({pool-2-thread-2} Logging.scala[logInfo]:54) - SparkContext already stopped.
ERROR [2018-02-21 04:26:43,751] ({pool-2-thread-2} Utils.java[invokeMethod]:40) -
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33)
at org.apache.zeppelin.spark.SparkInterpreter.createSparkSession(SparkInterpreter.java:378)
at org.apache.zeppelin.spark.SparkInterpreter.getSparkSession(SparkInterpreter.java:233)
at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:841)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:491)
at org.apache.zeppelin.scheduler.Job.run(Job.java:175)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalArgumentException: requirement failed: Can only call getServletHandlers on a running MetricsSystem
at scala.Predef$.require(Predef.scala:224)
at org.apache.spark.metrics.MetricsSystem.getServletHandlers(MetricsSystem.scala:91)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:524)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2313)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$6.apply(SparkSession.scala:868)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$6.apply(SparkSession.scala:860)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:860)
... 20 more
INFO [2018-02-21 04:26:43,752] ({stop-spark-context} Logging.scala[logInfo]:54) - Successfully stopped SparkContext
INFO [2018-02-21 04:26:43,752] ({pool-2-thread-2} SparkInterpreter.java[createSparkSession]:379) - Created Spark session
ERROR [2018-02-21 04:26:43,753] ({pool-2-thread-2} Job.java[run]:181) - Job failed
java.lang.NullPointerException
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33)
at org.apache.zeppelin.spark.SparkInterpreter.createSparkContext_2(SparkInterpreter.java:398)
at org.apache.zeppelin.spark.SparkInterpreter.createSparkContext(SparkInterpreter.java:387)
at org.apache.zeppelin.spark.SparkInterpreter.getSparkContext(SparkInterpreter.java:146)
at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:843)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:491)
at org.apache.zeppelin.scheduler.Job.run(Job.java:175)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
INFO [2018-02-21 04:26:43,759] ({pool-2-thread-2} SchedulerFactory.java[jobFinished]:137) - Job remoteInterpretJob_1519205136682 finished by scheduler org.apache.zeppelin.spark.SparkInterpreter269729544
What do you think?
UPDATE:
All nodes upgraded to Datastax Enterprice 5.1.7
With DSE 5.1 any reference to the Spark Master should look like this example:
export MASTER=dse://1.20.300.10
ERROR [2018-02-21 04:26:43,328] ({appclient-registration-retry-thread} Logging.scala[logError]:70) - Application has been killed. Reason: All masters are unresponsive! Giving up.
WARN [2018-02-21 04:26:43,328] ({pool-2-thread-2} Logging.scala[logWarning]:66) - Application ID is not initialized yet.
It seems the app is killed. Could you check the logs in spark master ?

Apache Zeppelin on windows 10... Not working

Intall zeppelin and make enviroment path on windows
and zeppelin.cmd on bin folder....
it's not working...
i can't find any problem path enviroment... plz help me.
just follow the install information on zeppelin website.
D:\Apps\zeppelin>.\bin\zeppelin.cmd
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/D:/Apps/zeppelin/lib/interpreter/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/D:/Apps/zeppelin/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
WARN [2017-04-18 17:09:07,601] ({main} ZeppelinConfiguration.java[create]:97) - Failed to load configuration, proceeding with a default
INFO [2017-04-18 17:09:07,657] ({main} ZeppelinConfiguration.java[create]:109) - Server Host: 0.0.0.0
INFO [2017-04-18 17:09:07,657] ({main} ZeppelinConfiguration.java[create]:111) - Server Port: 8080
INFO [2017-04-18 17:09:07,658] ({main} ZeppelinConfiguration.java[create]:115) - Context Path: /
INFO [2017-04-18 17:09:07,663] ({main} ZeppelinConfiguration.java[create]:116) - Zeppelin Version: 0.7.1
INFO [2017-04-18 17:09:07,700] ({main} Log.java[initialized]:186) - Logging initialized #708ms
INFO [2017-04-18 17:09:07,781] ({main} ZeppelinServer.java[setupWebAppContext]:341) - ZeppelinServer Webapp path: D:\Apps\zeppelin\webapps
INFO [2017-04-18 17:09:08,027] ({main} ZeppelinServer.java[main]:185) - Starting zeppelin server
INFO [2017-04-18 17:09:08,030] ({main} Server.java[doStart]:327) - jetty-9.2.15.v20160210
INFO [2017-04-18 17:09:57,251] ({main} StandardDescriptorProcessor.java[visitServlet]:297) - NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet
WARN [2017-04-18 17:22:32,504] ({main} Helium.java[loadConf]:101) - D:\Apps\zeppelin\conf/helium.json does not exists
DEBUG [2017-04-18 17:22:32,517] ({main} InterpreterSettingManager.java[<init>]:127) - InterpreterRootPath: D:\Apps\zeppelin\interpreter
DEBUG [2017-04-18 17:22:32,518] ({main} InterpreterSettingManager.java[<init>]:129) - InterpreterBindingPath: D:\Apps\zeppelin\conf\interpreter.json
DEBUG [2017-04-18 17:22:32,639] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/alluxio/zeppelin-alluxio-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:32,661] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/angular/zeppelin-angular-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:32,687] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/bqsql/zeppelin-bigquery-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:32,723] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/cassandra/zeppelin-cassandra_2.11-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:32,786] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/elasticsearch/zeppelin-elasticsearch-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:32,811] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/file/zeppelin-file-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:32,920] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/flink/zeppelin-flink_2.11-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:33,043] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/hbase/zeppelin-hbase-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:33,107] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/ignite/zeppelin-ignite_2.11-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:33,126] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/jdbc/zeppelin-jdbc-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:33,137] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/kylin/zeppelin-kylin-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:33,248] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/lens/zeppelin-lens-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:33,293] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/livy/zeppelin-livy-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:33,314] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/md/zeppelin-markdown-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:33,467] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/pig/zeppelin-pig-0.7.1.jar!/interpreter-setting.json
WARN [2017-04-18 17:22:33,498] ({main} Interpreter.java[register]:406) - Static initialization is deprecated for interpreter sql, You should change it to use interpreter-setting.json in your jar or interpreter/{interpreter}/interpreter-setting.json
INFO [2017-04-18 17:22:33,500] ({main} InterpreterSettingManager.java[init]:300) - Interpreter psql.sql found. class=org.apache.zeppelin.postgresql.PostgreSqlInterpreter
DEBUG [2017-04-18 17:22:34,239] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/python/zeppelin-python-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:34,368] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/sh/zeppelin-shell-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:34,924] ({main} InterpreterSettingManager.java[registerInterpreterFromResource]:377) - Reading interpreter-setting.json from jar:file:/D:/Apps/zeppelin/interpreter/spark/zeppelin-spark_2.11-0.7.1.jar!/interpreter-setting.json
DEBUG [2017-04-18 17:22:34,928] ({main} InterpreterSettingManager.java[init]:316) - Registered: psql.sql -> org.apache.zeppelin.postgresql.PostgreSqlInterpreter. Properties: {postgresql.password={envName=null, propertyName=null, defaultValue=, description=The PostgreSQL user password}, postgresql.max.result={envName=null, propertyName=null, defaultValue=1000, description=Max number of SQL result to display.}, postgresql.user={envName=null, propertyName=null, defaultValue=gpadmin, description=The PostgreSQL user name}, postgresql.url={envName=null, propertyName=null, defaultValue=jdbc:postgresql://localhost:5432/, description=The URL for PostgreSQL.}, postgresql.driver.name={envName=null, propertyName=null, defaultValue=org.postgresql.Driver, description= JDBC Driver Name}}
INFO [2017-04-18 17:22:34,930] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name ignite
INFO [2017-04-18 17:22:34,933] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name python
INFO [2017-04-18 17:22:34,945] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name jdbc
INFO [2017-04-18 17:22:34,950] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name psql
INFO [2017-04-18 17:22:34,953] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name lens
INFO [2017-04-18 17:22:34,955] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name pig
INFO [2017-04-18 17:22:34,965] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name flink
INFO [2017-04-18 17:22:34,967] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name angular
INFO [2017-04-18 17:22:34,970] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name livy
INFO [2017-04-18 17:22:34,972] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name file
INFO [2017-04-18 17:22:34,982] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name elasticsearch
INFO [2017-04-18 17:22:34,985] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name cassandra
INFO [2017-04-18 17:22:34,988] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name sh
INFO [2017-04-18 17:22:34,998] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name spark
INFO [2017-04-18 17:22:35,000] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name md
INFO [2017-04-18 17:22:35,004] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name alluxio
INFO [2017-04-18 17:22:35,006] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name bigquery
INFO [2017-04-18 17:22:35,016] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name hbase
INFO [2017-04-18 17:22:35,019] ({main} InterpreterSettingManager.java[init]:332) - InterpreterSettingRef name kylin
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createSingletonInstance(CXFNonSpringJaxrsServlet.java:382)
at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createApplicationInstance(CXFNonSpringJaxrsServlet.java:454)
at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createServerFromApplication(CXFNonSpringJaxrsServlet.java:432)
at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.init(CXFNonSpringJaxrsServlet.java:93)
at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:616)
at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:396)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:871)
at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:298)
at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)
at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)
at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:163)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
at org.eclipse.jetty.server.Server.start(Server.java:387)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
at org.eclipse.jetty.server.Server.doStart(Server.java:354)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:187)
Caused by: java.lang.NullPointerException
at org.apache.zeppelin.interpreter.InterpreterSettingManager.loadFromFile(InterpreterSettingManager.java:167)
at org.apache.zeppelin.interpreter.InterpreterSettingManager.init(InterpreterSettingManager.java:335)
at org.apache.zeppelin.interpreter.InterpreterSettingManager.<init>(InterpreterSettingManager.java:151)
at org.apache.zeppelin.server.ZeppelinServer.<init>(ZeppelinServer.java:141)
... 29 more
WARN [2017-04-18 17:22:35,212] ({main} ContextHandler.java[log]:2062) - unavailable
javax.servlet.ServletException: Resource class org.apache.zeppelin.server.ZeppelinServer can not be instantiated due to InvocationTargetException
at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createSingletonInstance(CXFNonSpringJaxrsServlet.java:396)
at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createApplicationInstance(CXFNonSpringJaxrsServlet.java:454)
at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createServerFromApplication(CXFNonSpringJaxrsServlet.java:432)
at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.init(CXFNonSpringJaxrsServlet.java:93)
at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:616)
at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:396)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:871)
at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:298)
at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)
at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)
at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:163)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
at org.eclipse.jetty.server.Server.start(Server.java:387)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
at org.eclipse.jetty.server.Server.doStart(Server.java:354)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:187)
4??18, 2017 5:22:35 ?ㅽ썑 com.sun.jersey.api.core.PackagesResourceConfig init
?뺣낫: Scanning for root resource and provider classes in the packages:
org.apache.zeppelin.rest
4??18, 2017 5:22:35 ?ㅽ썑 com.sun.jersey.api.core.ScanningResourceConfig logClasses
?뺣낫: Root resource classes found:
class org.apache.zeppelin.rest.ConfigurationsRestApi
class org.apache.zeppelin.rest.HeliumRestApi
class org.apache.zeppelin.rest.NotebookRepoRestApi
class org.apache.zeppelin.rest.InterpreterRestApi
class org.apache.zeppelin.rest.NotebookRestApi
class org.apache.zeppelin.rest.CredentialRestApi
class org.apache.zeppelin.rest.SecurityRestApi
class org.apache.zeppelin.rest.LoginRestApi
class org.apache.zeppelin.rest.ZeppelinRestApi
4??18, 2017 5:22:35 ?ㅽ썑 com.sun.jersey.api.core.ScanningResourceConfig init
?뺣낫: No provider classes found.
4??18, 2017 5:22:35 ?ㅽ썑 com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
?뺣낫: Initiating Jersey application, version 'Jersey: 1.13 06/29/2012 05:14 PM'
4??18, 2017 5:22:36 ?ㅽ썑 com.sun.jersey.spi.inject.Errors processErrorMessages
寃쎄퀬: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public javax.ws.rs.core.Response org.apache.zeppelin.rest.CredentialRestApi.getCredentials(java.lang.String) throws java.io.IOException,java.lang.IllegalArgumentException, should not consume any entity.
WARNING: A HTTP GET method, public javax.ws.rs.core.Response org.apache.zeppelin.rest.InterpreterRestApi.listInterpreter(java.lang.String), should not consume any entity.
WARNING: A sub-resource method, public javax.ws.rs.core.Response org.apache.zeppelin.rest.NotebookRestApi.createNote(java.lang.String) throws java.io.IOException, with URI template, "/", is treated as a resource method
WARNING: A sub-resource method, public javax.ws.rs.core.Response org.apache.zeppelin.rest.NotebookRestApi.getNoteList() throws java.io.IOException, with URI template, "/", is treated as a resource method
WARN [2017-04-18 17:22:36,250] ({main} WebAppContext.java[doStart]:514) - Failed startup of context o.e.j.w.WebAppContext#51b279c9{/,file:/D:/Apps/zeppelin/webapps/webapp/,STARTING}{D:\Apps\zeppelin\zeppelin-web-0.7.1.war}
javax.servlet.ServletException: Resource class org.apache.zeppelin.server.ZeppelinServer can not be instantiated due to InvocationTargetException
at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createSingletonInstance(CXFNonSpringJaxrsServlet.java:396)
at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createApplicationInstance(CXFNonSpringJaxrsServlet.java:454)
at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createServerFromApplication(CXFNonSpringJaxrsServlet.java:432)
at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.init(CXFNonSpringJaxrsServlet.java:93)
at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:616)
at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:396)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:871)
at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:298)
at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)
at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)
at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:163)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
at org.eclipse.jetty.server.Server.start(Server.java:387)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
at org.eclipse.jetty.server.Server.doStart(Server.java:354)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:187)
INFO [2017-04-18 17:22:36,412] ({main} AbstractConnector.java[doStart]:266) - Started ServerConnector#511816c0{HTTP/1.1}{0.0.0.0:8080}
INFO [2017-04-18 17:22:36,412] ({main} Server.java[doStart]:379) - Started #809435ms
INFO [2017-04-18 17:22:36,418] ({main} ZeppelinServer.java[main]:192) - Done, zeppelin server started
I noticed the same java exception on Windows 10 with the Zeppelin 0.7.1 release preventing the localhost from starting. My workaround was rolling back versions and running from Zeppelin 0.7.0 release. Make sure that you have Hadoop installed as well, I am using version 2.7.1-1.

Zeppelin throws java.lang.OutOfMemoryError: Java heap space

I am trying to use Zeppelin with the following code:
val dataText = sc.parallelize(IOUtils.toString(new URL("http://XXX.XX.XXX.121:8090/my_data.txt"),Charset.forName("utf8")).split("\n"))
case class Data(id: string, time: long, value1: Double, value2: int, mode: int)
val dat = dataText .map(s => s.split("\t")).filter(s => s(0) != "Header:").map(
s => Data(s(0),
s(1).toLong,
s(2).toDouble,
s(3).toInt,
s(4).toInt
)
).toDF()
dat.registerTempTable("mydatatable")
this keeps throwing me following error :
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Arrays.java:2367)
at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:130)
at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:114)
at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:535)
at java.lang.StringBuilder.append(StringBuilder.java:204)
at org.apache.commons.io.output.StringBuilderWriter.write(StringBuilderWriter.java:138)
at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:2002)
at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1980)
at org.apache.commons.io.IOUtils.copy(IOUtils.java:1957)
at org.apache.commons.io.IOUtils.copy(IOUtils.java:1907)
at org.apache.commons.io.IOUtils.toString(IOUtils.java:778)
at org.apache.commons.io.IOUtils.toString(IOUtils.java:896)
at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:38)
at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:43)
at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:45)
at $iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:47)
at $iwC$$iwC$$iwC$$iwC.<init>(<console>:49)
at $iwC$$iwC$$iwC.<init>(<console>:51)
at $iwC$$iwC.<init>(<console>:53)
at $iwC.<init>(<console>:55)
at <init>(<console>:57)
at .<init>(<console>:61)
at .<clinit>(<console>)
at .<init>(<console>:7)
at .<clinit>(<console>)
at $print(<console>)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.spark.repl.SparkIMain$ReadEvalPrint.call(SparkIMain.scala:1065)
at org.apache.spark.repl.SparkIMain$Request.loadAndRun(SparkIMain.scala:1338)
I have already set the following in the zeppelin-env.sh
export ZEPPELIN_JAVA_OPTS="-Dhdp.version=2.3.0.0-2557 -Dspark.executor.memory=4g"
any idea what I may be missing. File I am parsing my_data.txt is about 200MB
BTW I am using the Hortonworks Sandbox if that matters
EDIT 1
Here is my zeppelin-env.sh
export HADOOP_CONF_DIR=/etc/hadoop/conf
export ZEPPELIN_PORT=9995
export ZEPPELIN_JAVA_OPTS="-Dhdp.version=2.3.0.0-2557 -Dspark.executor.memory=4g"
export SPARK_SUBMIT_OPTIONS="--driver-java-options -Xmx4g"
export ZEPPELIN_INT_MEM="-Xmx4g"
export SPARK_HOME=/usr/hdp/2.3.0.0-2557/spark
Regards
Kiran
Can you try increasing the memory in SPARK_SUBMIT_OPTIONS in conf/zeppelin-env.sh:
export SPARK_SUBMIT_OPTIONS="--driver-java-options -Xmx20g"
This thread may help
http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Can-not-configure-driver-memory-size-td1513.html
Increasing the memory for the following zeppelin-env.sh var, did the trick for me. The default is 1/0.5GB, I increased it to 10/5GB
ZEPPELIN_MEM": "-Xmx10024m -XX:MaxPermSize=5120m
I was getting below error while trying to bring up Zeppelin notebook
INFO [2021-05-04 15:16:22,015] ({main} Folder.java[addNote]:185) - Add note 2G7CAFXX7 to folder /
INFO [2021-05-04 15:16:22,016] ({main} Notebook.java[<init>]:127) - Notebook indexing started...
WARN [2021-05-04 15:16:32,045] ({main} ContextHandler.java[log]:2355) - unavailable
MultiException stack 1 of 1
java.lang.OutOfMemoryError: Java heap space
at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:80)
at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:53)
To resolve this issue I tuned the ZEPPELIN_MEM parameter in zeppelin-env.sh file like this,
export ZEPPELIN_MEM="-Xmx5024m -XX:MaxPermSize=5120m"
Then restart zeppelin
sudo systemctl stop zeppelin; sudo systemctl start zeppelin
Result
INFO [2021-05-04 18:51:02,939] ({main} Folder.java[addNote]:185) - Add note 2G7CAFXX7 to folder /
INFO [2021-05-04 18:51:02,940] ({main} Notebook.java[<init>]:127) - Notebook indexing started...
INFO [2021-05-04 18:51:05,793] ({main} LuceneSearch.java[addIndexDocs]:305) - Indexing 905 notebooks took 2853ms
INFO [2021-05-04 18:51:05,793] ({main} Notebook.java[<init>]:129) - Notebook indexing finished: 905 indexed in -2s
INFO [2021-05-04 18:51:05,795] ({main} Helium.java[loadConf]:103) - Add helium local registry /usr/lib/zeppelin/helium
INFO [2021-05-04 18:51:05,797] ({main} Helium.java[loadConf]:100) - Add helium
INFO [2021-05-04 18:51:06,631] ({main} Server.java[doStart]:407) - Started #131632ms
INFO [2021-05-04 18:51:06,631] ({main} ZeppelinServer.java[main]:249) - Done, zeppelin server started
The only thing that worked for me (using Spark 2) was to add to conf/zeppelin-env.sh:
export SPARK_SUBMIT_OPTIONS="... --driver-memory 4g ..."
Then restart Zeppelin interpreter (In the Zeppelin for Spark 2, click on the settings button on the top right and then click on the Interpreter link, scroll down and click the Restart button of the Spark section).

hiveserver2 can not run sql on Spark on Yarn

Here is my versions:
Hive: 1.2
Hadoop: CDH5.3
Spark: 1.4.1
I succeeded with hive on spark with hive client, but after I started hiveserver2 and tried a sql using beeline, it failed.
The error is:
2015-11-29 21:49:42,786 INFO [stderr-redir-1]: client.SparkClientImpl (SparkClientImpl.java:run(569)) - 15/11/29 21:49:42 INFO spark.SparkContext: Added JAR file:/root/cdh/apache-hive-1.2.1-bin/lib/hive-exec-1.2.1.jar at http://10.96.30.51:10318/jars/hive-exec-1.2.1.jar with timestamp 1448804982784
2015-11-29 21:49:43,336 INFO [stderr-redir-1]: client.SparkClientImpl (SparkClientImpl.java:run(569)) - 15/11/29 21:49:43 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm297
2015-11-29 21:49:43,356 INFO [stderr-redir-1]: client.SparkClientImpl (SparkClientImpl.java:run(569)) - 15/11/29 21:49:43 INFO retry.RetryInvocationHandler: Exception while invoking getClusterMetrics of class ApplicationClientProtocolPBClientImpl over rm297 after 1 fail over attempts. Trying to fail over immediately.
2015-11-29 21:49:43,357 INFO [stderr-redir-1]: client.SparkClientImpl (SparkClientImpl.java:run(569)) - 15/11/29 21:49:43 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm280
2015-11-29 21:49:43,359 INFO [stderr-redir-1]: client.SparkClientImpl (SparkClientImpl.java:run(569)) - 15/11/29 21:49:43 INFO retry.RetryInvocationHandler: Exception while invoking getClusterMetrics of class ApplicationClientProtocolPBClientImpl over rm280 after 2 fail over attempts. Trying to fail over after sleeping for 477ms.
2015-11-29 21:49:43,359 INFO [stderr-redir-1]: client.SparkClientImpl (SparkClientImpl.java:run(569)) - java.net.ConnectException: Call From hd-master-001/10.96.30.51 to hd-master-001:8032 failed on connection exception: java.net.ConnectException: 拒绝连接; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
2015-11-29 21:49:43,359 INFO [stderr-redir-1]: client.SparkClientImpl (SparkClientImpl.java:run(569)) - at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
My yarn's status is that hd-master-002 is active resourcemanager and hd-master-001 is backup. 8032 port on hd-master-001 is not open. So of course, connection error occurs when trying to connect to hd-master-001's 8032 port.
But why she tried to connect a backup resourcemanager.
If I use hive client command shell on spark on yarn, everything is ok.
PS: I didn't rebuild the spark assembly jar without hive, I only removed 'org.apache.hive' and 'org.apache.hadoop.hive' from built assembly jar. But I do not think it is the problem because I succeeded with hive client on spark on yarn.

Resources