Neo4j build failing on Mac - linux

I cloned master Neo4j on Github and tried to build it:
mvn clean install -DfullBuild -Dlicense.skip=true
Result:
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Neo4j .............................................. SUCCESS [ 1.917 s]
[INFO] Neo4j - Licensing configuration .................... SUCCESS [ 0.769 s]
[INFO] Neo4j - Primitive Collections ...................... SUCCESS [ 43.278 s]
[INFO] Neo4j - IO ......................................... SUCCESS [01:50 min]
[INFO] Neo4j - CSV reading and parsing .................... SUCCESS [ 5.461 s]
[INFO] Neo4j - Graph Database Kernel ...................... SUCCESS [03:59 min]
[INFO] Neo4j - JMX support ................................ SUCCESS [ 7.138 s]
[INFO] Neo4j - Usage Data Collection ...................... SUCCESS [ 10.788 s]
[INFO] Neo4j - Monitor Logging ............................ SUCCESS [ 7.750 s]
[INFO] Neo4j - Graphviz generation ........................ SUCCESS [ 7.947 s]
[INFO] Neo4j - Lucene Index ............................... SUCCESS [01:45 min]
[INFO] Neo4j - Graph Algorithms ........................... SUCCESS [ 11.222 s]
[INFO] Neo4j - Graph Matching ............................. SUCCESS [ 7.938 s]
[INFO] Neo4j - Community Cypher Build ..................... SUCCESS [ 3.658 s]
[INFO] Neo4j - Cypher Compiler 2.2 ........................ SUCCESS [04:34 min]
[INFO] Neo4j - Cypher ..................................... SUCCESS [04:29 min]
[INFO] Neo4j - Consistency Checker ........................ SUCCESS [01:10 min]
[INFO] Neo4j - Community .................................. SUCCESS [02:22 min]
[INFO] Neo4j - Community .................................. SUCCESS [ 0.079 s]
[INFO] Neo4j - Generic shell .............................. SUCCESS [01:19 min]
[INFO] Neo4j - Import Command Line Tool ................... SUCCESS [ 31.435 s]
[INFO] Neo4j - Examples ................................... SUCCESS [ 34.906 s]
[INFO] Neo4j - Server API ................................. SUCCESS [ 7.443 s]
[INFO] Neo4j - Browser .................................... SUCCESS [ 57.323 s]
[INFO] Neo4j - Server ..................................... SUCCESS [04:31 min]
[INFO] Neo4j - Test Harness ............................... SUCCESS [ 26.720 s]
[INFO] Neo4j - Server Plugin Tests ........................ SUCCESS [ 14.821 s]
[INFO] Neo4j - Server Examples ............................ SUCCESS [ 25.881 s]
[INFO] Neo4j - UDC Integration ............................ SUCCESS [ 10.245 s]
[INFO] Neo4j - GraphGist .................................. SUCCESS [ 27.983 s]
[INFO] Neo4j - Cypher Documentation ....................... SUCCESS [01:42 min]
[INFO] Neo4j - Cypher Reference Card Tests ................ SUCCESS [ 27.326 s]
[INFO] Neo4j - Community Build ............................ SUCCESS [ 0.077 s]
[INFO] Neo4j - Graph DB Monitoring and Management tools ... SUCCESS [ 10.148 s]
[INFO] Neo4j - Advanced ................................... SUCCESS [ 8.685 s]
[INFO] Neo4j - Advanced Server ............................ SUCCESS [ 21.165 s]
[INFO] Neo4j - Advanced Build ............................. SUCCESS [ 0.064 s]
[INFO] Neo4j - Query Logging .............................. SUCCESS [ 8.720 s]
[INFO] Neo4j - Communication Package ...................... SUCCESS [ 18.359 s]
[INFO] Neo4j - Clustering Infrastructure .................. SUCCESS [ 25.807 s]
[INFO] Neo4j - Backup Tool ................................ SUCCESS [01:22 min]
[INFO] Neo4j - High Availability .......................... SUCCESS [24:19 min]
[INFO] Neo4j - Enterprise ................................. SUCCESS [ 10.279 s]
[INFO] Neo4j - Enterprise Server .......................... SUCCESS [07:02 min]
[INFO] Neo4j - Enterprise Performance Tests ............... SUCCESS [ 41.132 s]
[INFO] Neo4j - Enterprise Build ........................... SUCCESS [ 0.056 s]
[INFO] Neo4j - Integration Tests .......................... SUCCESS [ 49.037 s]
[INFO] Neo4j - Page Cache Stress Tests .................... SUCCESS [ 0.097 s]
[INFO] Neo4j Javadocs ..................................... SUCCESS [ 9.582 s]
[INFO] Neo4j Cypher Reference Card ........................ SUCCESS [ 42.708 s]
[INFO] Neo4j - Reference Manual Contents .................. SUCCESS [ 4.565 s]
[INFO] Neo4j - Reference Manual ........................... SUCCESS [09:49 min]
[INFO] Neo4j - Server Assembler ........................... SUCCESS [ 1.083 s]
[INFO] Neo4j Community - Server Assembler ................. SUCCESS [ 5.669 s]
[INFO] Neo4j Advanced - Server Assembler .................. SUCCESS [ 5.255 s]
[INFO] Neo4j Enterprise - Server Assembler ................ SUCCESS [ 5.249 s]
[INFO] Neo4j Desktop ...................................... SUCCESS [ 51.900 s]
[INFO] Neo4j Packaging Build .............................. SUCCESS [ 0.049 s]
[INFO] Neo4j Debian Installers ............................ FAILURE [ 4.538 s]
[INFO] Neo4j RPM Installers ............................... SKIPPED
[INFO] Neo4j Community RPM ................................ SKIPPED
[INFO] Neo4j Advanced RPM ................................. SKIPPED
[INFO] Neo4j Community RPM ................................ SKIPPED
[INFO] Neo4j Linux Installers ............................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:22 h
[INFO] Finished at: 2015-02-27T19:37:24+00:00
[INFO] Final Memory: 308M/493M
[INFO] -----------------------------------------------------------------------
I want to build community installer/package for mac which I assume is the last on the list above (Neo4j Linux Installers) but is skipped because of the Debian Installers failure, because it can't find 'debuild' command. What is best way to resolve this?
I have found out that the missing command is used to build Debain packages but can't find a way to install it on my Mac.
Not familiar with mavern; is there a way to exclude the Debian and possibly RPM Installers from the build on my Mac, if Linux installer does not depend on these.

Inside of neo's pom.xml you'll see this:
<profile>
<id>neo-full-build</id>
<activation>
<activeByDefault>false</activeByDefault>
<property>
<name>fullBuild</name>
</property>
</activation>
<modules>
<module>manual</module>
<module>packaging</module>
<module>packaging/installer-linux</module>
</modules>
<properties>
<attach-docs-phase>verify</attach-docs-phase>
</properties>
</profile>
You see that bit where it includes <module>packaging/installer-linux</module>? The debian installer package is underneath of that. If you remove that line, I believe the full build will not descend into that directory, attempt to build a debian package (or any other linux, e.g. redhat RPM).

Related

Hawkbit build with multiple users throw error

I am trying to build a hawkBit instance with multiple Users. But everytime it throws an error like this:
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 4.897 s <<< FAILURE! - in org.eclipse.hawkbit.app.CorsTest
[ERROR] validateCorsRequest Time elapsed: 0.028 s <<< ERROR!
java.lang.IllegalStateException: Unable to create SecurityContext using #org.springframework.security.test.context.support.WithUserDetails(setupBefore=TEST_METHOD, userDetailsServiceBeanName=, value=admin)
Caused by: org.springframework.security.core.userdetails.UsernameNotFoundException: No such user
[INFO]
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] CorsTest.validateCorsRequest » IllegalState Unable to create SecurityContext u...
[INFO]
[ERROR] Tests run: 4, Failures: 0, Errors: 1, Skipped: 0
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for hawkBit :: Parent 0.3.0-SNAPSHOT:
...
[INFO] hawkBit :: Runtime ................................. SUCCESS [ 0.038 s]
[INFO] hawkBit :: Runtime :: Update Server ................ FAILURE [ 25.548 s]
[INFO] hawkBit :: Test Report ............................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 12:38 min
[INFO] Finished at: 2022-09-14T08:43:00+02:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test (default-test) on project hawkbit-update-server: There are test failures.
[ERROR]
...
My application.properties look like this:
# User Security
spring.security.user.name=admin
spring.security.user.password={bcrypt}$2a$12$ycF.o9IdsOlvy/3ML1qFgunkPuQ9P/xl38mO2EJ2uukFwqqLtoQjS
spring.main.allow-bean-definition-overriding=true
# Http Encoding
server.servlet.encoding.charset=UTF-8
server.servlet.encoding.enabled=true
server.servlet.encoding.force=true
# DDI authentication configuration
hawkbit.server.ddi.security.authentication.anonymous.enabled=false
hawkbit.server.ddi.security.authentication.targettoken.enabled=true
hawkbit.server.ddi.security.authentication.gatewaytoken.enabled=false
# Optional events
hawkbit.server.repository.publish-target-poll-event=false
# Disable DMF
hawkbit.dmf.rabbitmq.enabled=false
# Define own users instead of default "admin" user:
hawkbit.server.im.users[0].username=hawkbit
hawkbit.server.im.users[0].password={bcrypt}$2a$12$uPxtF4ae46PikuLCtBuGaOffoQ.exaKFWh0TEeh47YH9kYP.z.03y
hawkbit.server.im.users[0].firstname=Eclipse
hawkbit.server.im.users[0].lastname=HawkBit
hawkbit.server.im.users[0].permissions=ALL
spring.profiles.active=mysql
# SSL
server.port=8443
hawkbit.artifact.url.protocols.download-http.protocol=https
hawkbit.artifact.url.protocols.download-http.port=8443
security.require-ssl=true
server.use-forward-headers=true
server.ssl.key-store=hb-cert.jks
server.ssl.key-password=hb-cert
server.ssl.key-store-password=hb-cert
Even if I try to run it without the
spring.security.user.name=admin
spring.security.user.password={bcrypt}$2a$12$ycF.o9IdsOlvy/3ML1qFgunkPuQ9P/xl38mO2EJ2uukFwqqLtoQjS
it throws this error.
The bcryps hashes are all ok. The hash for admin is admin and forhawkbit is isAwesome!.
I tried one or multiple users with changing the 0 to 1,2,... but it is always the same.
Do you have any Ideas?

Override Maven's download of a 3rd party software with a local copy?

I am running the 32-bit build of Ubuntu 18.04 and attempting to build a 32-bit Jenkins from the source.
It fails in the last stage (see below) because it cannot find a Linux x86 build of Nodejs. They don't make 32-bit versions for Linux anymore. I'm fine with that - I have downloaded the 14.15.4 Nodejs sources and built my own 32-bit version. How can I override the Jenkins maven build that is attempting to download a non-existent package directly from the Nodejs distribution site?
I have tried prepositioning my home-built node-14.15.4-linux-x86.tar.gz in the appropriate location, but the build is getting killed because the package does not exist on the website it is attempting to download from (404 - Not Found). If I could stop it trying to download or tell it to pull the .tar.gz package from the local filesystem, I think that should fix the problem. I haven't found anything online and maven configurations are completely foreign to me.
[INFO] Installing node version v14.15.4
[INFO] Downloading https://nodejs.org/dist/v14.15.4/node-v14.15.4-linux-x86.tar.gz to /home/scott/.m2/repository/com/github/eirslett/node/14.15.4/node-14.15.4-linux-x86.tar.gz
[INFO] No proxies configured
[INFO] No proxy was configured, downloading directly
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Jenkins main module 2.275-SNAPSHOT:
[INFO]
[INFO] Jenkins main module ................................ SUCCESS [ 4.868 s]
[INFO] Jenkins BOM ........................................ SUCCESS [ 0.156 s]
[INFO] Jenkins cli ........................................ SUCCESS [ 10.285 s]
[INFO] Jenkins core ....................................... SUCCESS [01:12 min]
[INFO] Jenkins war ........................................ FAILURE [ 4.536 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:35 min
[INFO] Finished at: 2021-01-08T00:47:30-06:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.github.eirslett:frontend-maven-plugin:1.11.0:install-node-and-yarn (install node and yarn) on project jenkins-war: Could not download Node.js: Got error code 404 from the server. -> [Help 1]

Extracting Pbf file with Docker

I am trying to follow simple instruction as given in the
https://hub.docker.com/r/osrm/osrm-backend/
Instruction states as follow
download the data as
wget http://download.geofabrik.de/europe/germany/berlin-latest.osm.pbf
Pre-process the extract with the car profile and start a routing engine HTTP server on port 5000
docker run -t -v "${PWD}:/data" osrm/osrm-backend osrm-extract -p /opt/car.lua /data/berlin-latest.osm.pbf
The flag -v "${PWD}:/data" creates the directory /data inside the docker container and makes the current working directory "${PWD}" available there. The file /data/berlin-latest.osm.pbf inside the container is referring to "${PWD}/berlin-latest.osm.pbf" on the host.
but instead of Germany i changed it to India and download the data file
wget http://download.geofabrik.de/asia/india-latest.osm.pbf
and changed the docker command as
sudo docker run -t -v "${PWD}:/data" osrm/osrm-backend osrm-extract -p /opt/car.lua /data/india-latest.osm.pbf
and getting error :
terminate called after throwing an instance of 'boost::filesystem::filesystem_error' what(): boost::filesystem::status: Permission denied: "/data/india-latest.osm.pbf"
what I understand is docker is unable to extract the file due to some permission issue.
what should I do?
Followed the same steps as mentioned by you. I didn't received any error message.
You can give a try by removing sudo in front of your docker command.
Here is the output I see:
• • • docker run -t -v "${PWD}:/data" osrm/osrm-backend osrm-extract -p /opt/car.lua /data/india-latest.osm.pbf
[info] Parsed 0 location-dependent features with 0 GeoJSON polygons
[info] Using script /opt/car.lua
[info] Input file: india-latest.osm.pbf
[info] Profile: car.lua
[info] Threads: 8
[info] Parsing in progress..
[info] input file generated by osmium/1.8.0
[info] timestamp: 2020-08-21T20:42:02Z
[info] Using profile api version 4
[info] Found 3 turn restriction tags:
[info] motorcar
[info] motor_vehicle
[info] vehicle
[info] Parse relations ...
[info] Parse ways and nodes ...
[info] Using profile api version 4
[info] Using profile api version 4
[info] Using profile api version 4
[info] Using profile api version 4
[info] Using profile api version 4
[info] Using profile api version 4
[info] Using profile api version 4
[info] Parsing finished after 129.569 seconds
[info] Raw input contains 126788006 nodes, 16092177 ways, and 7326 relations, 2201 restrictions
[info] Sorting used nodes ... ok, after 0.693022s
[info] Erasing duplicate nodes ... ok, after 0.097902s
[info] Sorting all nodes ... ok, after 0.20617s
[info] Building node id map ... ok, after 0.257703s
[info] Confirming/Writing used nodes ... ok, after 1.89281s
[info] Writing barrier nodes ... ok, after 0s
[info] Writing traffic light nodes ... ok, after 0s
[info] Processed 39581602 nodes
[info] Sorting edges by start ... ok, after 3.65041s
[info] Setting start coords ... ok, after 2.50387s
[info] Sorting edges by target ... ok, after 3.33254s
[info] Computing edge weights ... ok, after 8.01501s
[info] Sorting edges by renumbered start ... ok, after 3.54458s
[info] Writing used edges ... ok, after 1.30046s -- Processed 41373066 edges
[info] Writing way meta-data ... ok, after 0.011832s -- Metadata contains << 3407420 entries.
[info] Sorting used ways ... ok, after 0.010457s
[info] Collecting start/end information on 0 maneuver overrides...ok, after 0.039794s
[info] Collecting start/end information on 0 maneuver overrides...ok, after 0s
[info] Collecting start/end information on 2201 restrictions...ok, after 0.083874s
[info] Collecting start/end information on 2201 restrictions...ok, after 0.00159s
[info] writing street name index ... ok, after 0.002164s
[info] extraction finished after 155.758s
[info] Generating edge-expanded graph representation
[info] . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100%
[info] Node compression ratio: 0.148128
[info] Edge compression ratio: 0.185013
[info] graph compression removed 3348686 annotations of 3407420 in 2.54008 seconds
[info] Find segregated edges in node-based graph ...
[info] ok, after 22.5332s
[info] Segregated edges count = 97299
[info] Writing nodes for nodes-based and edges-based graphs ...
[warn] Clipped 12 segment weights to 4194302
[info] Geometry successfully removed:
compressed edges: 15309100
compressed geometries: 82748654
longest chain length: 8194
cmpr ratio: 0.185007
avg chain length: 5.40519
[info] Generating edge expanded nodes ...
[info] . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100%
[info] Expanding via-way turn restrictions ...
[info] . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100%
[info] Generated 14948742 nodes (236 of which are duplicates) and 41373000 segments in edge-expanded graph
[info] Generating edge-expanded edges
[info] [warn] Turn is a u turn but not turning to the first connected edge of the intersection. Node ID: 631957, OSM link: http://www.openstreetmap.org/?zoom=18&mlat=12.313006&mlon=75.129656
[warn] Turn is a u turn but not turning to the first connected edge of the intersection. Node ID: 1025431, OSM link: http://www.openstreetmap.org/?zoom=18&mlat=11.225002&mlon=72.773843
[warn] Turn is a u turn but not turning to the first connected edge of the intersection. Node ID: 1025431, OSM link: http://www.openstreetmap.org/?zoom=18&mlat=11.225002&mlon=72.773843
[warn] Turn is a u turn but not turning to the first connected edge of the intersection. Node ID: 1025431, OSM link: http://www.openstreetmap.org/?zoom=18&mlat=11.225002&mlon=72.773843
[warn] Turn is a u turn but not turning to the first connected edge of the intersection. Node ID: 1025431, OSM link: http://www.openstreetmap.org/?zoom=18&mlat=11.225002&mlon=72.773843
.[info] Using profile api version 4
[info] Using profile api version 4
10% [warn] Turn is a u turn but not turning to the first connected edge of the intersection. Node ID: 4318270, OSM link: http://www.openstreetmap.org/?zoom=18&mlat=9.949453&mlon=77.181601
.[warn] Turn is a u turn but not turning to the first connected edge of the intersection. Node ID: 7481554, OSM link: http://www.openstreetmap.org/?zoom=18&mlat=11.488963&mlon=73.002006
20% . 30% . 40% . 50% .[warn] Turn is a u turn but not turning to the first connected edge of the intersection. Node ID: 22139276, OSM link: http://www.openstreetmap.org/?zoom=18&mlat=15.541327&mlon=77.926129
60% . 70% .[warn] Turn is a u turn but not turning to the first connected edge of the intersection. Node ID: 31183234, OSM link: http://www.openstreetmap.org/?zoom=18&mlat=16.298204&mlon=81.05196
80% . 90% .[warn] Turn is a u turn but not turning to the first connected edge of the intersection. Node ID: 38391257, OSM link: http://www.openstreetmap.org/?zoom=18&mlat=28.610931&mlon=77.052052
[warn] Turn is a u turn but not turning to the first connected edge of the intersection. Node ID: 38392328, OSM link: http://www.openstreetmap.org/?zoom=18&mlat=30.720227&mlon=76.677209
[warn] Turn is a u turn but not turning to the first connected edge of the intersection. Node ID: 39135596, OSM link: http://www.openstreetmap.org/?zoom=18&mlat=23.402787&mlon=81.358654
[info] Sorting and writing 0 maneuver overrides...
[info] done.
[info] Renumbering turns
[info] Writing 0 conditional turn penalties...
[info] Generated 41373000 edge based node segments
[info] Node-based graph contains 14830339 edges
[info] Edge-expanded graph ...
[info] contains 30138979 edges
[info] Timing statistics for edge-expanded graph:
[info] Renumbering edges: 0.499508s
[info] Generating nodes: 5.43434s
[info] Generating edges: 45.995s
[info] Generating guidance turns
[info] . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% .
[info] done.
[info] Created 119 entry classes and 19951 Bearing Classes
[info] Handled: 51 of 3324 lanes: 1.5343 %.
[info] Assigned 33989015 turn instruction types:
[info] new name: 483158 (1.42%)
[info] continue: 1414398 (4.16%)
[info] turn: 14280460 (42.01%)
[info] merge: 26879 (0.08%)
[info] on ramp: 11842 (0.03%)
[info] off ramp: 10722 (0.03%)
[info] fork: 131054 (0.39%)
[info] end of road: 6390775 (18.80%)
[info] notification: 618 (0.00%)
[info] enter roundabout: 11530 (0.03%)
[info] enter and exit roundabout: 1149 (0.00%)
[info] enter rotary: 1176 (0.00%)
[info] enter and exit rotary: 126 (0.00%)
[info] enter roundabout turn: 2333 (0.01%)
[info] (noturn): 328976 (0.97%)
[info] (suppressed): 10856840 (31.94%)
[info] roundabout: 28 (0.00%)
[info] exit roundabout: 12393 (0.04%)
[info] rotary: 9 (0.00%)
[info] exit rotary: 1258 (0.00%)
[info] exit roundabout turn: 2362 (0.01%)
[info] (stay on roundabout): 15433 (0.05%)
[info] (sliproad): 5496 (0.02%)
[info] Assigned 33989015 turn instruction modifiers:
[info] uturn: 1376359 (4.05%)
[info] sharp right: 481487 (1.42%)
[info] right: 9817870 (28.89%)
[info] slight right: 626400 (1.84%)
[info] straight: 10569160 (31.10%)
[info] slight left: 631180 (1.86%)
[info] left: 10001525 (29.43%)
[info] sharp left: 485034 (1.43%)
[info] Guidance turn annotations took 37.1287s
[info] Writing Intersection Classification Data
[info] ok, after 0.157749s
[info] Writing Turns and Lane Data...
[info] ok, after 0.105888s
[info] Saving edge-based node weights to file.
[info] Done writing. (0.101336)
[info] Computing strictly connected components ...
[info] Found 23696 SCC (6 large, 23690 small)
[info] SCC run took: 1.06626s
[info] Building r-tree ...
[info] Constructing r-tree of 41373000 segments build on-top of 39581602 coordinates
[info] finished r-tree construction in 6.08963 seconds
[info] Writing edge-based-graph edges ...
[info] ok, after 8.46229s
[info] Processed 30138979 edges
[info] Expansion: 211195 nodes/sec and 79762 edges/sec
[info] To prepare the data for routing, run: ./osrm-contract "/data/india-latest.osrm"
[info] RAM: peak bytes used: 10818285568

Zeppelin: web Application failure while building zeppelin

I am trying to build apache zeppelin using the instructions in this tutorial : Installing Zeppelig Tutorial
I installed spark 2.0 and maven 3.3.9 the latest versions. I used the following command to build zeppelin:
sudo mvn clean package -DskipTests -Psparkr -Ppyspark -Pspark-2.0 -Dflink
I got this error:
[ERROR] npm WARN unmet dependency /home/parallels/incubator-zeppelin
/zeppelin-web/node_modules/grunt-jscs/node_modules/jscs requires lodash#'~3.10.0' but will load
[ERROR] npm WARN unmet dependency /home/parallels/incubator-zeppelin/zeppelin-web/node_modules/grunt-jscs/node_modules/lodash,
[ERROR] npm WARN unmet dependency which is version 4.6.1
[ERROR] npm WARN unmet dependency /home/parallels/incubator-zeppelin/zeppelin-web/node_modules/karma-coverage/node_modules/istanbul/node_modules/handlebars requires source-map#'^0.4.4' but will load
[ERROR] npm WARN unmet dependency /home/parallels/incubator-zeppelin/zeppelin-web/node_modules/karma-coverage/node_modules/source-map,
[ERROR] npm WARN unmet dependency which is version 0.5.6
[INFO]
[INFO] --- frontend-maven-plugin:0.0.25:bower (bower install) # zeppelin-web ---
[INFO] Running 'bower --allow-root install' in /home/parallels/incubator-zeppelin/zeppelin-web
[ERROR] module.js:338
[ERROR] throw err;
[ERROR] ^
[ERROR] Error: Cannot find module 'q'
[ERROR] at Function.Module._resolveFilename (module.js:336:15)
[ERROR] at Function.Module._load (module.js:278:25)
[ERROR] at Module.require (module.js:365:17)
[ERROR] at require (module.js:384:17)
[ERROR] at Object.<anonymous> (/home/parallels/incubator-zeppelin/zeppelin-web/node_modules/bower/bin/bower:6:9)
[ERROR] at Module._compile (module.js:460:26)
[ERROR] at Object.Module._extensions..js (module.js:478:10)
[ERROR] at Module.load (module.js:355:32)
[ERROR] at Function.Module._load (module.js:310:12)
[ERROR] at Function.Module.runMain (module.js:501:10)
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Zeppelin ........................................... SUCCESS [ 3.333 s]
[INFO] Zeppelin: Interpreter .............................. SUCCESS [ 12.493 s]
[INFO] Zeppelin: Zengine .................................. SUCCESS [ 7.460 s]
[INFO] Zeppelin: Display system apis ...................... SUCCESS [ 16.886 s]
[INFO] Zeppelin: Spark dependencies ....................... SUCCESS [ 33.212 s]
[INFO] Zeppelin: Spark .................................... SUCCESS [ 25.951 s]
[INFO] Zeppelin: Markdown interpreter ..................... SUCCESS [ 0.387 s]
[INFO] Zeppelin: Angular interpreter ...................... SUCCESS [ 0.223 s]
[INFO] Zeppelin: Shell interpreter ........................ SUCCESS [ 0.287 s]
[INFO] Zeppelin: Livy interpreter ......................... SUCCESS [ 0.520 s]
[INFO] Zeppelin: HBase interpreter ........................ SUCCESS [ 3.979 s]
[INFO] Zeppelin: PostgreSQL interpreter ................... SUCCESS [ 0.488 s]
[INFO] Zeppelin: JDBC interpreter ......................... SUCCESS [ 0.694 s]
[INFO] Zeppelin: File System Interpreters ................. SUCCESS [ 0.766 s]
[INFO] Zeppelin: Flink .................................... SUCCESS [ 7.653 s]
[INFO] Zeppelin: Apache Ignite interpreter ................ SUCCESS [ 0.871 s]
[INFO] Zeppelin: Kylin interpreter ........................ SUCCESS [ 0.334 s]
[INFO] Zeppelin: Python interpreter ....................... SUCCESS [ 0.337 s]
[INFO] Zeppelin: Lens interpreter ......................... SUCCESS [ 2.984 s]
[INFO] Zeppelin: Apache Cassandra interpreter ............. SUCCESS [01:00 min]
[INFO] Zeppelin: Elasticsearch interpreter ................ SUCCESS [ 6.269 s]
[INFO] Zeppelin: BigQuery interpreter ..................... SUCCESS [ 0.833 s]
[INFO] Zeppelin: Alluxio interpreter ...................... SUCCESS [ 3.350 s]
[INFO] Zeppelin: web Application .......................... FAILURE [ 3.653 s]
[INFO] Zeppelin: Server ................................... SKIPPED
[INFO] Zeppelin: Packaging distribution ................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 03:14 min
[INFO] Finished at: 2016-09-06T19:09:29+01:00
[INFO] Final Memory: 164M/479M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.github.eirslett:frontend-maven-plugin:0.0.25:bower (bower install) on project zeppelin-web: Failed to run task: 'bower --allow-root install' failed. (error code 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :zeppelin-web
There is another thread on stackoverflow with the same error and #dirceusemighini suggests to cd to zeppelin-web and run the following command. The reason i created another question is because i am a new stack user and it wont let me comment to that question.
./bower install
I have tried that and i got the following error:
module.js:338
throw err;
^
Error: Cannot find module 'q'
at Function.Module._resolveFilename (module.js:336:15)
at Function.Module._load (module.js:278:25)
at Module.require (module.js:365:17)
at require (module.js:384:17)
at Object.<anonymous> (/home/parallels/incubator-zeppelin/zeppelin-web/node_modules/bower/bin/bower:6:9)
at Module._compile (module.js:460:26)
at Object.Module._extensions..js (module.js:478:10)
at Module.load (module.js:355:32)
at Function.Module._load (module.js:310:12)
at Function.Module.runMain (module.js:501:10)
parallels#ubuntu:~/incubator-zeppelin/zeppelin-web$
I have already unistall node, nodejs and npm and i reinstalled them globally
node -v : 5.0.0
npm -v : 3.3.6
bower -v: 1.7.9
Any suggestions??
The problem for me was Maven installation. I uninstall Maven and i reinstall it manually to /usr/local/apache-maven/
Then using a text editor i set the environment variables and re-run the build. Build was successful now. I don't know the actual cause of that but at the end it works..
gedit ~/.bashrc
export M2_HOME=/usr/local/apache-maven/apache-maven-3.3.9
export PATH=${M2_HOME}/bin:${PATH}
Run the build:
mvn clean package -DskipTests

Connecting Blob to Spark failing

I am trying to connect spark coming in Hortonworks 2.4 distribution to Azure Blob storage and I was getting error "wasb filesystem not recognized " . I checked and many suggested downloading azure-sdk-for-java and creating package.
I am trying to create package using mvn but while running both mvn test and mvn package ; the process is getting hanged while testing. There is no error given , it just failed to return anything. I had changed testconfiguration.xml to reflect my blob account name. Below is the log files I am getting.
Is there something else that needs to be done to get jars ?
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Microsoft Azure Storage Client SDK 4.3.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) # azure-storage ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/adminhorton/kspark/azure-storage-java-master/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) # azure-storage ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) # azure-storage ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO]
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) # azure-storage ---
[INFO] Compiling 52 source files to /home/adminhorton/kspark/azure-storage-java-master/target/test-classes
[INFO]
[INFO] --- maven-surefire-plugin:2.13:test (default-test) # azure-storage ---
[INFO] Surefire report directory: /home/adminhorton/kspark/azure-storage-java-master/target/surefire-reports
T E S T S
parallel='classes', perCoreThreadCount=true, threadCount=2, useUnlimitedThreads=false
Running com.microsoft.azure.storage.StorageAccountTests
Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.057 sec
Running com.microsoft.azure.storage.StorageUriTests
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.071 sec
com.microsoft.azure.storage.StorageAccountTests.txt
com.microsoft.azure.storage.StorageUriTests.txt
com.microsoft.azure.storage.StorageAccountTests.txt
com.microsoft.azure.storage.StorageUriTests.txt
According to your description, I am not sure you have configured your Storage Configuration rightly in your project. So I recommend you can follow these steps to check your configurations:
1.Create your Azure storage Account and set it in core-site.xml as this format:
<property>
<name>fs.azure.account.key.youraccount.blob.core.windows.net</name>
<value>YOUR ACCESS KEY</value>
</property>
2.Restart the HDP service and use the Hadoop fs –ls wasb://**.blob.core.windows.net/ to list the files in the container.
I strongly recommend you can refer to this blog how-to-configure-hortonworks-hdp-to-access-azure-windows-storage and official document.
Meanwhile , #Yuval provided the great sample about how to connect to Azure blob with Java SDK.

Resources