Crossbar Thruway worker crashes - crossbar

I have a Crossbar.io server with PHP Thruway workers. Recently, I started getting the following error. It happens about once a day now:
2016-04-17T21:08:12+0000 [Router 9572] Unable to format event {'log_logger': <Logger 'crossbar.router.protocol.WampWebSocketServerProtocol'>, 'log_time': 1460927292.17918, 'log_source': None, 'log_format': 'Traceback (most recent call last):\n File "/usr/local/lib/python2.7/site-packages/autobahn/wamp/websocket.py", line 88, in onMessage\n for msg in self._serializer.unserialize(payload, isBinary):\n File "/usr/local/lib/python2.7/site-packages/autobahn/wamp/serializer.py", line 106, in unserialize\n raise ProtocolError("invalid serialization of WAMP message ({0})".format(e))\nProtocolError: invalid serialization of WAMP message (Expected object or value)\n'}: tuple index out of range
2016-04-17T21:08:15+0000 [Guest 9583] The connected has closed with reason: close
2016-04-17T21:08:19+0000 [Guest 9583] PHP Fatal error: Call to a member function call() on null in /var/www/html/pickupServer/vendor/voryx/thruway/src/Thruway/ClientSession.php on line 106
2016-04-17T21:08:19+0000 [Guest 9583] Fatal error: Call to a member function call() on null in /var/www/html/pickupServer/vendor/voryx/thruway/src/Thruway/ClientSession.php on line 106
2016-04-17T21:08:19+0000 [Controller 9565] Guest worker2 exited with error A process has ended with a probable error condition: process ended with exit code 255.
Does anyone know hot to prevent this?
How do I automatically restart the worker if it fails as in this case?

I solved it in linux with MONIT checking crossbar-controler process and adding the following line:
if children < 3 then restart
3 is the number os child processes that crossbar-controler has on my environment. If any of them exits then crossbar restarts itself and notifies me. You have to check the number of child processes you have running using:
sudo service crossbar status.
This solves the error exit worker but with a cost of restarting the crossbar-controler. I am convinced that must be a crossbar/thruway way of solving the problem.
The ideal way is to try catch all possible errors of php to prevent fatal worker exits.
Thanks

Related

chrome-gnome-shell causing crash?

I am not sure if this has been answered as I am not really sure of the problem. At least once (sometimes more) during the day I get a notice that Ubuntu crashed. The info says it's related to the chrome-gnome-shell(I have reinstalled chrome-gnome-shell). I also can't get my local Gnome extensions to list at: https://extensions.gnome.org/local/. Using the browser console in Firefox, I get the following when I bring up that page:
Unchecked lastError value: Error: Could not establish connection. Receiving end does not exist. ExtensionCommon.jsm:265
stderr output from native app org.gnome.chrome_gnome_shell:
stderr output from native app org.gnome.chrome_gnome_shell: (process:13043): GLib-GIO-CRITICAL **: g_application_release: assertion 'application->priv->use_count > 0' failed
stderr output from native app org.gnome.chrome_gnome_shell: [13043] Uncaught exception of type <class 'gi._glib.GError'> occured
stderr output from native app org.gnome.chrome_gnome_shell: File "/usr/bin/chrome-gnome-shell", line 550, in <module>
stderr output from native app org.gnome.chrome_gnome_shell: app = ChromeGNOMEShell('--gapplication-service' in sys.argv)
stderr output from native app org.gnome.chrome_gnome_shell: File "/usr/bin/chrome-gnome-shell", line 67, in __init__
stderr output from native app org.gnome.chrome_gnome_shell: self.register()
stderr output from native app org.gnome.chrome_gnome_shell: [13043] Exception: GDBus.Error:org.freedesktop.DBus.Error.NoReply: Message did not receive a reply (timeout by message bus)
I am running Ubuntu 14.04 Gnome (v3.8.4), Linux kernel 4.4.0-71, Firefox 52.0.2 32-bit.
Any ideas of what is wrong and how to fix it?
You are using old chrome-gnome-shell version.
Just upgrade.

LoadLibrary failed when running Loadrunner 12.53

Fatal Error -32988: LoadLibrary failed, rc=193 [MsgId: MERR-32988]
Fatal Error -26000: xfbLrwiWebInfraGlobalInitOK failed [MsgId: MERR-26000]
Warning: Extension lrwreplaymain.dll reports error -1 on call to function ExtPerProcessInitialize
Error: Thread Context: Call to service of the driver failed, reason - thread context wasn't initialized on this thread.
Recording is passed but cannot replayed due to the above error.
Thanks for the help in advance.
Either lrwreplaymain.dll or some of the DLLs it depends on were corrupted (error code 193 = ERROR_BAD_EXE_FORMAT). This may have been caused by virus attack, file system corruption etc.
The easiest solution is to re-install LoadRunner. You can also check which DLLs are corrupted by means of the Dependency Walker x86. Just start it and open <LoadRunner installation folder>\bin\lrwreplaymain.dll

Application not responding when CefSharp.BrowserSubprocess.exe crashes

I've developed an application using cefSharp, application is working very fine.
But when any unhandled exception occurred in application at that time CefSharp.BrowserSubprocess.exe crashes and application throws message that application is not responding.
I've used below code for checking (throws unhandled exception)
private void OnBrowserStatusMessage(object sender, StatusMessageEventArgs args)
{
this.InvokeOnUiThreadIfRequired(() => lblStatus.Text = args.Value);
//Used below code to throw error for checking
throw new InvalidOperationException("Invalid operation.");
}
When below code throws error application got hanged and throws message that application is not responding.
Can any one tell me how can i handle this issue.
I'm using Chromium: 47.0.2526.80.
Here is a sample of my debug.log from my release folder, edited to remove too many duplicates:
[0317/175414:WARNING:quota_manager.cc(193)] Create directory failed for path
[0317/181858:ERROR:ipc_channel_win.cc(207)] pipe error: 109
[0317/182108:WARNING:quota_manager.cc(193)] Create directory failed for path
Edit debug.log
[0317/175414:WARNING:quota_manager.cc(193)] Create directory failed for path
[0317/181858:ERROR:ipc_channel_win.cc(207)] pipe error: 109
[0317/192448:ERROR:ipc_channel_win.cc(502)] pipe error: 232
[0317/193320:ERROR:ipc_channel_win.cc(207)] pipe error: 109
[0319/142421:WARNING:content_browser_client.cc(622)] No browser info matching frame process id 13 and routing id 1
[0319/183359:ERROR:audio_output_device.cc(427)] IO loop going away before the audio device has been stopped
[0319/184355:ERROR:ssl_client_socket_openssl.cc(1056)] handshake failed; returned -1, SSL error code 1, net_error -100
[0319/192106:ERROR:ssl_client_socket_openssl.cc(1056)] handshake failed; returned -1, SSL error code 1, net_error -100
[0319/200702:ERROR:gles2_cmd_decoder.cc(13099)] [.RenderWorker-00328548]GL ERROR :GL_INVALID_VALUE : glCopySubTextureCHROMIUM: source texture has no level 0

What causes BitBake worker processes to exit unexpectedly?

I have a BitBake build process that runs on a Docker container (CentOS 7). The BitBake fails during recipe gcc-cross-i586-5.2.0-r0: task do_compile on each run that I try it in.
An example of bitbake's output:
NOTE: recipe gcc-cross-i586-5.2.0-r0: task do_compile: Started
ERROR: Worker process (367) exited unexpectedly (-9), shutting down...
ERROR: Worker process (367) exited unexpectedly (-9), shutting down...
ERROR: Worker process (367) exited unexpectedly (-9), shutting down...
ERROR: Worker process (367) exited unexpectedly (-9), shutting down...
NOTE: Tasks Summary: Attempted 1538 tasks of which 17 didn't need to be rerun and all succeeded.
Is this a problem with recipe gcc-cross-i586-5.2.0-r0: task do_compile? Perhaps an out-of-memory error? I don't know what the -9 refers to or how to find out more information about it.
Try:
$ bitbake -c cleansstate gcc-cross ; bitbake -k gcc-cross
How much you have memory of ram?
Report log error here.
This worked for me,
Edit conf/local.conf and decrease the number of working threads by adding the following to you conf/local.conf file (under the build directory):
BB_NUMBER_THREADS = "6"
Just a long shot, -9 in kernel land means EBADF (bad file number.) Is it possible you have done some operations as root and some files are not accessible during the build? Is the issue reproducible? ie. can you rm -rf tmp and does it happen again? Make sure you don't have any permissions issues in your project directory and associated file system(s).

FATAL ERROR in native method: JDWP No transports initialized error while starting hybris server in debug mode

While trying to start my hybrisserver in debug mode I got the following error messages and hybrisserver stopped. I tried but not able to solve. Any help please.
FATAL ERROR in native method: JDWP No transports initialized, jvmtiError=AGENT_ERROR_TRANSPORT_INIT(197)<br/>
ERROR: transport error 202: bind failed: Permission denied<br/>
ERROR: JDWP Transport dt_socket failed to initialize, TRANSPORT_INIT(510)<br/>
JDWP exit error AGENT_ERROR_TRANSPORT_INIT(197): No transports initialized [../../../src/share/back/debugInit.c:750]<br/>
JVM exited while loading the application.<br/>
Reloading Wrapper configuration...<br/>
Launching a JVM...<br/>
FATAL ERROR in native method: JDWP No transports initialized, jvmtiError=AGENT_ERROR_TRANSPORT_INIT(197)<br/>
ERROR: transport error 202: bind failed: Permission denied<br/>
ERROR: JDWP Transport dt_socket failed to initialize, TRANSPORT_INIT(510)<br/>
JDWP exit error AGENT_ERROR_TRANSPORT_INIT(197): No transports initialized [../../../src/share/back/debugInit.c:750]<br/>
JVM exited while loading the application.<br/>
There were 5 failed launches in a row, each lasting less than 300 seconds. Giving up.
There may be a configuration problem: please check the logs.
<-- Wrapper Stopped<br/>
An error occurred in the process.
#thijsraets is correct. Either you have to check where is the port (8000) has been occupied or you can override the default value to something else in local.properties file.
tomcat.debugjavaoptions=-Xdebug -Xnoagent -Xrunjdwp:transport=dt_socket,server=y,address=8001,suspend=n
Run "ant all". This will configure debug for port 8001.
OR
You can change the JVM parameters in wrapper-debug.conf file...
wrapper.java.additional.23=-Xrunjdwp:transport=dt_socket,server=y,address=8001,suspend=n
People who encounter this problem seem to already have something else bound to the debug port, try changing the port in: tomcat.debugjavaoptions
The same thing happened to me and tried to kill the server and restarted it safely. I followed these steps:
ps aux | grep java . this will help me to find the PID , Process ID
kill -9 PID
If you want to kill all the tomcat processes you can do
pkill -9 -f tomcat
this will restart the server safely.

Resources