| [smila-dev] Zookeeper fatal error and SMILA shutdown |
Hi folks, lately I was wondering why my SMILA instance doesn’t answer anymore. When I took a look in log file I found this exceptions followed by a graceful shutdown of the framework: 2012-10-21 00:57:27,873 WARN [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181 ] server.NIOServerCnxn - EndOfStreamException: Unable to read additional data from client sessionid 0x13a64a35b390000, likely client has closed socket 2012-10-21 01:00:27,974 ERROR [Component Resolve Thread (localhost.localdomain:2181)] zookeeper.ClientCnxn - from Component Resolve Thread (localhost.localdomain:2181) java.lang.NoClassDefFoundError: org/apache/zookeeper/ClientCnxn$2 at org.apache.zookeeper.ClientCnxn.conLossPacket(ClientCnxn.java:646) at org.apache.zookeeper.ClientCnxn.access$2000(ClientCnxn.java:83) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1243) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1170) Caused by: java.lang.ClassNotFoundException: org.apache.zookeeper.ClientCnxn$2 at org.eclipse.osgi.internal.loader.BundleLoader.findClassInternal(BundleLoader.java:513) at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:429) at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:417) at org.eclipse.osgi.internal.baseadaptor.DefaultClassLoader.loadClass(DefaultClassLoader.java:107) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) ... 4 more 2012-10-21 01:00:27,974 ERROR [Component Resolve Thread (localhost.localdomain:2181)] zookeeper.ClientCnxn - from Component Resolve Thread (localhost.localdomain:2181) java.lang.NoClassDefFoundError: org/apache/zookeeper/ClientCnxn$2 at org.apache.zookeeper.ClientCnxn.conLossPacket(ClientCnxn.java:646) at org.apache.zookeeper.ClientCnxn.access$2000(ClientCnxn.java:83) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1243) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1170) Caused by: java.lang.ClassNotFoundException: org.apache.zookeeper.ClientCnxn$2 at org.eclipse.osgi.internal.loader.BundleLoader.findClassInternal(BundleLoader.java:513) at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:429) at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:417) at org.eclipse.osgi.internal.baseadaptor.DefaultClassLoader.loadClass(DefaultClassLoader.java:107) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) ... 4 more 2012-10-21 01:00:07,873 FATAL [SyncThread:0 ] server.SyncRequestProcessor - Severe unrecoverable error, exiting java.io.IOException: Input/output error at sun.nio.ch.FileChannelImpl.force0(Native Method) at sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:348) at org.apache.zookeeper.server.persistence.FileTxnLog.commit(FileTxnLog.java:310) at org.apache.zookeeper.server.persistence.FileTxnSnapLog.commit(FileTxnSnapLog.java:277) at org.apache.zookeeper.server.ZKDatabase.commit(ZKDatabase.java:483) at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:158) at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:98) 2012-10-21 01:00:07,873 FATAL [SyncThread:0 ] server.SyncRequestProcessor - Severe unrecoverable error, exiting java.io.IOException: Input/output error at sun.nio.ch.FileChannelImpl.force0(Native Method) at sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:348) at org.apache.zookeeper.server.persistence.FileTxnLog.commit(FileTxnLog.java:310) at org.apache.zookeeper.server.persistence.FileTxnSnapLog.commit(FileTxnSnapLog.java:277) at org.apache.zookeeper.server.ZKDatabase.commit(ZKDatabase.java:483) at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:158) at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:98) 2012-10-21 01:01:47,003 INFO [Thread-8 ] server.Server - Graceful shutdown SslSelectChannelConnector@0.0.0.0:8443 STARTED 2012-10-21 01:01:47,004 INFO [Thread-8 ] server.Server - Graceful shutdown SelectChannelConnector@0.0.0.0:8080 STARTED 2012-10-21 01:01:47,005 INFO [Thread-8 ] server.Server - Graceful shutdown o.e.j.s.h.ContextHandler{/zookeeper,null} 2012-10-21 01:01:47,005 INFO [Thread-8 ] server.Server - Graceful shutdown org.eclipse.smila.http.server.internal.HandlerAdapter@7bcf1c23#STARTED 2012-10-21 01:01:47,006 INFO [Thread-8 ] server.Server - Graceful shutdown o.e.j.s.h.ContextHandler{/ecc,null} 2012-10-21 01:01:47,006 INFO [Thread-8 ] server.Server - Graceful shutdown org.eclipse.smila.http.server.internal.HandlerAdapter@5a407d55#STARTED 2012-10-21 01:01:47,006 INFO [Thread-8 ] server.Server - Graceful shutdown o.e.j.s.h.ContextHandler{/taskmanager,null} 2012-10-21 01:01:47,006 INFO [Thread-8 ] server.Server - Graceful shutdown org.eclipse.smila.http.server.internal.HandlerAdapter@3fe485bd#STARTED 2012-10-21 01:01:47,006 INFO [Thread-8 ] server.Server - Graceful shutdown o.e.j.s.h.ContextHandler{/smila,null} 2012-10-21 01:01:47,006 INFO [Thread-8 ] server.Server - Graceful shutdown org.eclipse.smila.http.server.internal.HandlerAdapter@34085c10#STARTED 2012-10-21 01:01:47,007 INFO [Thread-8 ] server.Server - Graceful shutdown o.e.j.w.WebAppContext{/SMILA,file:/appl/eccenca/b401/configuration/org.eclipse.smila.search.servlet/webapp/} 2012-10-21 01:01:47,007 INFO [Thread-8 ] server.Server - Graceful shutdown o.e.j.w.WebAppContext{/eccenca,file:/appl/eccenca/b401/configuration/com.eccenca/webapp/} 2012-10-21 01:01:48,043 INFO [Thread-8 ] handler.ContextHandler - stopped o.e.j.w.WebAppContext{/eccenca,file:/appl/eccenca/b401/configuration/com.eccenca/webapp/} 2012-10-21 01:01:48,045 INFO [Thread-8 ] handler.ContextHandler - stopped o.e.j.w.WebAppContext{/SMILA,file:/appl/eccenca/b401/configuration/org.eclipse.smila.search.servlet/webapp/} 2012-10-21 01:01:48,045 INFO [Thread-8 ] handler.ContextHandler - stopped o.e.j.s.h.ContextHandler{/smila,null} 2012-10-21 01:01:48,046 INFO [Thread-8 ] handler.ContextHandler - stopped o.e.j.s.h.ContextHandler{/taskmanager,null} 2012-10-21 01:01:48,046 INFO [Thread-8 ] handler.ContextHandler - stopped o.e.j.s.h.ContextHandler{/ecc,null} 2012-10-21 01:01:48,046 INFO [Thread-8 ] handler.ContextHandler - stopped o.e.j.s.h.ContextHandler{/zookeeper,null} Does anyone has an idea what was happening and how I can avoid such behavior? I’m using the branch “2012-01-27_r2218_v1.1-prep” in SMILA SVN. Thanks you. Best regards Peter |