Zookeeper will not join the cluster. How to apply patch/upgrade?How to upgrade zookeeper from 3.4.5 to 3.4.6 on Ubuntu 14.04.3How to upgrade zookeeper from 3.4.5 to 3.4.6 on Ubuntu 14.04.3ZooKeeper not starting because acceptedEpoch is less than the currentEpoch
Simple Derivative Proof?
How did the Apollo guidance computer handle parity bit errors?
Constitutional limitation of criminalizing behavior in US law?
Where did Lovecraft write about Carcosa?
How to remap repeating commands i.e. <number><command>?
no sense/need/point
Is there a word for food that's gone 'bad', but is still edible?
All of my Firefox add-ons been disabled suddenly, how can I re-enable them?
Should I simplify my writing in a foreign country?
Does running exec do anything?
Is throwing dice a stochastic or a deterministic process?
Which US defense organization would respond to an invasion like this?
Is Iron Man stronger than the Hulk?
Is any special diet an effective treatment of autism?
All superlinear runtime algorithms are asymptotically equivalent to convex function?
Some Russian letters overlap the next line of text when used in drop caps
Madam I m Adam..please don’t get mad..you will no longer be prime
How can a hefty sand storm happen in a thin atmosphere like Martian?
When did England stop being a Papal fief?
about academic proof-reading, what to do in this situation?
Piano: quaver triplets in RH v dotted quaver and semiquaver in LH
In Futurama, how many beings has Leela slept with?
Hostile Divisor Numbers
In linear regression why does regularisation penalise the parameter values as well?
Zookeeper will not join the cluster. How to apply patch/upgrade?
How to upgrade zookeeper from 3.4.5 to 3.4.6 on Ubuntu 14.04.3How to upgrade zookeeper from 3.4.5 to 3.4.6 on Ubuntu 14.04.3ZooKeeper not starting because acceptedEpoch is less than the currentEpoch
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I am running a 3 node zookeeper ensemble on ubuntu 14.04. After noticing that node1 was not running, I had to remove the snapshots of this node and now the server did start, but refuses to join the cluster.
This is the log from zookeeper:
2016-01-15 17:07:28,187 - INFO [main:QuorumPeerConfig@101] - Reading configuration from: /etc/zookeeper/conf/zoo.cfg
2016-01-15 17:07:28,189 - INFO [main:QuorumPeerConfig@334] - Defaulting to majority quorums
2016-01-15 17:07:28,191 - INFO [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
2016-01-15 17:07:28,191 - INFO [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
2016-01-15 17:07:28,192 - INFO [main:DatadirCleanupManager@101] - Purge task is not scheduled.
2016-01-15 17:07:28,198 - INFO [main:QuorumPeerMain@127] - Starting quorum peer
2016-01-15 17:07:28,204 - INFO [main:NIOServerCnxnFactory@94] - binding to port 0.0.0.0/0.0.0.0:2181
2016-01-15 17:07:28,213 - INFO [main:QuorumPeer@913] - tickTime set to 2000
2016-01-15 17:07:28,213 - INFO [main:QuorumPeer@933] - minSessionTimeout set to -1
2016-01-15 17:07:28,213 - INFO [main:QuorumPeer@944] - maxSessionTimeout set to -1
2016-01-15 17:07:28,213 - INFO [main:QuorumPeer@959] - initLimit set to 10
2016-01-15 17:07:28,220 - INFO [main:QuorumPeer@429] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
2016-01-15 17:07:28,223 - INFO [main:QuorumPeer@444] - acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
2016-01-15 17:07:28,228 - INFO [Thread-1:QuorumCnxManager$Listener@486] - My election bind port: 0.0.0.0/0.0.0.0:3888
2016-01-15 17:07:28,233 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:QuorumPeer@670] - LOOKING
2016-01-15 17:07:28,234 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:FastLeaderElection@740] - New election. My id = 1, proposed zxid=0x0
2016-01-15 17:07:28,235 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 1 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)
2016-01-15 17:07:28,237 - INFO [WorkerSender[myid=1]:QuorumCnxManager@190] - Have smaller server identifier, so dropping the connection: (2, 1)
2016-01-15 17:07:28,237 - INFO [WorkerSender[myid=1]:QuorumCnxManager@190] - Have smaller server identifier, so dropping the connection: (3, 1)
2016-01-15 17:07:28,238 - INFO [zk1/10.0.0.101:3888:QuorumCnxManager$Listener@493] - Received connection request /10.0.0.103:48431
2016-01-15 17:07:28,239 - INFO [zk1/10.0.0.101:3888:QuorumCnxManager$Listener@493] - Received connection request /10.0.0.102:46486
2016-01-15 17:07:28,239 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 3 (n.leader), 0x1500000072 (n.zxid), 0x20 (n.round), LEADING (n.state), 3 (n.sid), 0x15 (n.peerEPoch), LOOKING (my state)
2016-01-15 17:07:28,240 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 3 (n.leader), 0x1500000072 (n.zxid), 0x20 (n.round), FOLLOWING (n.state), 2 (n.sid), 0x15 (n.peerEPoch), LOOKING (my state)
2016-01-15 17:07:28,240 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 3 (n.leader), 0x1500000072 (n.zxid), 0x20 (n.round), LEADING (n.state), 3 (n.sid), 0x15 (n.peerEPoch), LOOKING (my state)
2016-01-15 17:07:28,240 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:QuorumPeer@738] - FOLLOWING
2016-01-15 17:07:28,241 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 3 (n.leader), 0x1500000072 (n.zxid), 0x20 (n.round), FOLLOWING (n.state), 2 (n.sid), 0x15 (n.peerEPoch), FOLLOWING (my state)
2016-01-15 17:07:28,242 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Learner@85] - TCP NoDelay set to: true
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:zookeeper.version=3.4.5--1, built on 06/10/2013 17:26 GMT
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:host.name=fx1.findix.com
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.version=1.8.0_66
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.vendor=Oracle Corporation
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.home=/usr/lib/jvm/java-8-oracle/jre
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.class.path=/etc/zookeeper/conf:/usr/share/java/jline.jar:/usr/share/java/log4j-1.2.jar:/usr/share/java/xercesImpl.jar:/usr/share/java/xmlParserAPIs.jar:/usr/share/java/netty.jar:/usr/share/java/slf4j-api.jar:/usr/share/java/slf4j-log4j12.jar:/usr/share/java/zookeeper.jar
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.io.tmpdir=/tmp
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.compiler=<NA>
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:os.name=Linux
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:os.arch=amd64
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:os.version=3.19.0-43-generic
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:user.name=zookeeper
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:user.home=/var/lib/zookeeper
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:user.dir=/
2016-01-15 17:07:28,247 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:ZooKeeperServer@162] - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir /var/lib/zookeeper/version-2 snapdir /var/lib/zookeeper/version-2
2016-01-15 17:07:28,247 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Follower@63] - FOLLOWING - LEADER ELECTION TOOK - 13
2016-01-15 17:07:28,253 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Learner@325] - Getting a snapshot from leader
2016-01-15 17:07:28,262 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:FileTxnSnapLog@240] - Snapshotting: 0x16000009b6 to /var/lib/zookeeper/version-2/snapshot.16000009b6
2016-01-15 17:07:48,724 - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection from /10.0.0.101:58156
2016-01-15 17:07:48,761 - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@821] - Processing stat command from /10.0.0.101:58156
2016-01-15 17:07:48,763 - INFO [Thread-2:NIOServerCnxn$StatCommand@655] - Stat command output
2016-01-15 17:07:48,763 - INFO [Thread-2:NIOServerCnxn@1001] - Closed socket connection for client /10.0.0.101:58156 (no session established for client)
2016-01-15 17:08:02,003 - WARN [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Follower@118] - Got zxid 0x16000009b7 expected 0x1
2016-01-15 17:08:02,003 - INFO [SyncThread:1:FileTxnLog@199] - Creating new log file: log.16000009b7
The relevant entry seems to be: Got zxid 0x16000009b7 expected 0x1
Apparently it seems like the version 3.4.5 is buggy and it has been fixed in 3.4.6 so question now is how to apply a patch or how to upgrade within Ubuntu 14.04.3?
solr zookeeper
add a comment |
I am running a 3 node zookeeper ensemble on ubuntu 14.04. After noticing that node1 was not running, I had to remove the snapshots of this node and now the server did start, but refuses to join the cluster.
This is the log from zookeeper:
2016-01-15 17:07:28,187 - INFO [main:QuorumPeerConfig@101] - Reading configuration from: /etc/zookeeper/conf/zoo.cfg
2016-01-15 17:07:28,189 - INFO [main:QuorumPeerConfig@334] - Defaulting to majority quorums
2016-01-15 17:07:28,191 - INFO [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
2016-01-15 17:07:28,191 - INFO [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
2016-01-15 17:07:28,192 - INFO [main:DatadirCleanupManager@101] - Purge task is not scheduled.
2016-01-15 17:07:28,198 - INFO [main:QuorumPeerMain@127] - Starting quorum peer
2016-01-15 17:07:28,204 - INFO [main:NIOServerCnxnFactory@94] - binding to port 0.0.0.0/0.0.0.0:2181
2016-01-15 17:07:28,213 - INFO [main:QuorumPeer@913] - tickTime set to 2000
2016-01-15 17:07:28,213 - INFO [main:QuorumPeer@933] - minSessionTimeout set to -1
2016-01-15 17:07:28,213 - INFO [main:QuorumPeer@944] - maxSessionTimeout set to -1
2016-01-15 17:07:28,213 - INFO [main:QuorumPeer@959] - initLimit set to 10
2016-01-15 17:07:28,220 - INFO [main:QuorumPeer@429] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
2016-01-15 17:07:28,223 - INFO [main:QuorumPeer@444] - acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
2016-01-15 17:07:28,228 - INFO [Thread-1:QuorumCnxManager$Listener@486] - My election bind port: 0.0.0.0/0.0.0.0:3888
2016-01-15 17:07:28,233 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:QuorumPeer@670] - LOOKING
2016-01-15 17:07:28,234 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:FastLeaderElection@740] - New election. My id = 1, proposed zxid=0x0
2016-01-15 17:07:28,235 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 1 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)
2016-01-15 17:07:28,237 - INFO [WorkerSender[myid=1]:QuorumCnxManager@190] - Have smaller server identifier, so dropping the connection: (2, 1)
2016-01-15 17:07:28,237 - INFO [WorkerSender[myid=1]:QuorumCnxManager@190] - Have smaller server identifier, so dropping the connection: (3, 1)
2016-01-15 17:07:28,238 - INFO [zk1/10.0.0.101:3888:QuorumCnxManager$Listener@493] - Received connection request /10.0.0.103:48431
2016-01-15 17:07:28,239 - INFO [zk1/10.0.0.101:3888:QuorumCnxManager$Listener@493] - Received connection request /10.0.0.102:46486
2016-01-15 17:07:28,239 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 3 (n.leader), 0x1500000072 (n.zxid), 0x20 (n.round), LEADING (n.state), 3 (n.sid), 0x15 (n.peerEPoch), LOOKING (my state)
2016-01-15 17:07:28,240 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 3 (n.leader), 0x1500000072 (n.zxid), 0x20 (n.round), FOLLOWING (n.state), 2 (n.sid), 0x15 (n.peerEPoch), LOOKING (my state)
2016-01-15 17:07:28,240 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 3 (n.leader), 0x1500000072 (n.zxid), 0x20 (n.round), LEADING (n.state), 3 (n.sid), 0x15 (n.peerEPoch), LOOKING (my state)
2016-01-15 17:07:28,240 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:QuorumPeer@738] - FOLLOWING
2016-01-15 17:07:28,241 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 3 (n.leader), 0x1500000072 (n.zxid), 0x20 (n.round), FOLLOWING (n.state), 2 (n.sid), 0x15 (n.peerEPoch), FOLLOWING (my state)
2016-01-15 17:07:28,242 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Learner@85] - TCP NoDelay set to: true
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:zookeeper.version=3.4.5--1, built on 06/10/2013 17:26 GMT
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:host.name=fx1.findix.com
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.version=1.8.0_66
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.vendor=Oracle Corporation
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.home=/usr/lib/jvm/java-8-oracle/jre
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.class.path=/etc/zookeeper/conf:/usr/share/java/jline.jar:/usr/share/java/log4j-1.2.jar:/usr/share/java/xercesImpl.jar:/usr/share/java/xmlParserAPIs.jar:/usr/share/java/netty.jar:/usr/share/java/slf4j-api.jar:/usr/share/java/slf4j-log4j12.jar:/usr/share/java/zookeeper.jar
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.io.tmpdir=/tmp
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.compiler=<NA>
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:os.name=Linux
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:os.arch=amd64
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:os.version=3.19.0-43-generic
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:user.name=zookeeper
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:user.home=/var/lib/zookeeper
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:user.dir=/
2016-01-15 17:07:28,247 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:ZooKeeperServer@162] - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir /var/lib/zookeeper/version-2 snapdir /var/lib/zookeeper/version-2
2016-01-15 17:07:28,247 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Follower@63] - FOLLOWING - LEADER ELECTION TOOK - 13
2016-01-15 17:07:28,253 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Learner@325] - Getting a snapshot from leader
2016-01-15 17:07:28,262 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:FileTxnSnapLog@240] - Snapshotting: 0x16000009b6 to /var/lib/zookeeper/version-2/snapshot.16000009b6
2016-01-15 17:07:48,724 - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection from /10.0.0.101:58156
2016-01-15 17:07:48,761 - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@821] - Processing stat command from /10.0.0.101:58156
2016-01-15 17:07:48,763 - INFO [Thread-2:NIOServerCnxn$StatCommand@655] - Stat command output
2016-01-15 17:07:48,763 - INFO [Thread-2:NIOServerCnxn@1001] - Closed socket connection for client /10.0.0.101:58156 (no session established for client)
2016-01-15 17:08:02,003 - WARN [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Follower@118] - Got zxid 0x16000009b7 expected 0x1
2016-01-15 17:08:02,003 - INFO [SyncThread:1:FileTxnLog@199] - Creating new log file: log.16000009b7
The relevant entry seems to be: Got zxid 0x16000009b7 expected 0x1
Apparently it seems like the version 3.4.5 is buggy and it has been fixed in 3.4.6 so question now is how to apply a patch or how to upgrade within Ubuntu 14.04.3?
solr zookeeper
add a comment |
I am running a 3 node zookeeper ensemble on ubuntu 14.04. After noticing that node1 was not running, I had to remove the snapshots of this node and now the server did start, but refuses to join the cluster.
This is the log from zookeeper:
2016-01-15 17:07:28,187 - INFO [main:QuorumPeerConfig@101] - Reading configuration from: /etc/zookeeper/conf/zoo.cfg
2016-01-15 17:07:28,189 - INFO [main:QuorumPeerConfig@334] - Defaulting to majority quorums
2016-01-15 17:07:28,191 - INFO [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
2016-01-15 17:07:28,191 - INFO [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
2016-01-15 17:07:28,192 - INFO [main:DatadirCleanupManager@101] - Purge task is not scheduled.
2016-01-15 17:07:28,198 - INFO [main:QuorumPeerMain@127] - Starting quorum peer
2016-01-15 17:07:28,204 - INFO [main:NIOServerCnxnFactory@94] - binding to port 0.0.0.0/0.0.0.0:2181
2016-01-15 17:07:28,213 - INFO [main:QuorumPeer@913] - tickTime set to 2000
2016-01-15 17:07:28,213 - INFO [main:QuorumPeer@933] - minSessionTimeout set to -1
2016-01-15 17:07:28,213 - INFO [main:QuorumPeer@944] - maxSessionTimeout set to -1
2016-01-15 17:07:28,213 - INFO [main:QuorumPeer@959] - initLimit set to 10
2016-01-15 17:07:28,220 - INFO [main:QuorumPeer@429] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
2016-01-15 17:07:28,223 - INFO [main:QuorumPeer@444] - acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
2016-01-15 17:07:28,228 - INFO [Thread-1:QuorumCnxManager$Listener@486] - My election bind port: 0.0.0.0/0.0.0.0:3888
2016-01-15 17:07:28,233 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:QuorumPeer@670] - LOOKING
2016-01-15 17:07:28,234 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:FastLeaderElection@740] - New election. My id = 1, proposed zxid=0x0
2016-01-15 17:07:28,235 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 1 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)
2016-01-15 17:07:28,237 - INFO [WorkerSender[myid=1]:QuorumCnxManager@190] - Have smaller server identifier, so dropping the connection: (2, 1)
2016-01-15 17:07:28,237 - INFO [WorkerSender[myid=1]:QuorumCnxManager@190] - Have smaller server identifier, so dropping the connection: (3, 1)
2016-01-15 17:07:28,238 - INFO [zk1/10.0.0.101:3888:QuorumCnxManager$Listener@493] - Received connection request /10.0.0.103:48431
2016-01-15 17:07:28,239 - INFO [zk1/10.0.0.101:3888:QuorumCnxManager$Listener@493] - Received connection request /10.0.0.102:46486
2016-01-15 17:07:28,239 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 3 (n.leader), 0x1500000072 (n.zxid), 0x20 (n.round), LEADING (n.state), 3 (n.sid), 0x15 (n.peerEPoch), LOOKING (my state)
2016-01-15 17:07:28,240 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 3 (n.leader), 0x1500000072 (n.zxid), 0x20 (n.round), FOLLOWING (n.state), 2 (n.sid), 0x15 (n.peerEPoch), LOOKING (my state)
2016-01-15 17:07:28,240 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 3 (n.leader), 0x1500000072 (n.zxid), 0x20 (n.round), LEADING (n.state), 3 (n.sid), 0x15 (n.peerEPoch), LOOKING (my state)
2016-01-15 17:07:28,240 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:QuorumPeer@738] - FOLLOWING
2016-01-15 17:07:28,241 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 3 (n.leader), 0x1500000072 (n.zxid), 0x20 (n.round), FOLLOWING (n.state), 2 (n.sid), 0x15 (n.peerEPoch), FOLLOWING (my state)
2016-01-15 17:07:28,242 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Learner@85] - TCP NoDelay set to: true
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:zookeeper.version=3.4.5--1, built on 06/10/2013 17:26 GMT
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:host.name=fx1.findix.com
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.version=1.8.0_66
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.vendor=Oracle Corporation
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.home=/usr/lib/jvm/java-8-oracle/jre
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.class.path=/etc/zookeeper/conf:/usr/share/java/jline.jar:/usr/share/java/log4j-1.2.jar:/usr/share/java/xercesImpl.jar:/usr/share/java/xmlParserAPIs.jar:/usr/share/java/netty.jar:/usr/share/java/slf4j-api.jar:/usr/share/java/slf4j-log4j12.jar:/usr/share/java/zookeeper.jar
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.io.tmpdir=/tmp
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.compiler=<NA>
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:os.name=Linux
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:os.arch=amd64
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:os.version=3.19.0-43-generic
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:user.name=zookeeper
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:user.home=/var/lib/zookeeper
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:user.dir=/
2016-01-15 17:07:28,247 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:ZooKeeperServer@162] - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir /var/lib/zookeeper/version-2 snapdir /var/lib/zookeeper/version-2
2016-01-15 17:07:28,247 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Follower@63] - FOLLOWING - LEADER ELECTION TOOK - 13
2016-01-15 17:07:28,253 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Learner@325] - Getting a snapshot from leader
2016-01-15 17:07:28,262 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:FileTxnSnapLog@240] - Snapshotting: 0x16000009b6 to /var/lib/zookeeper/version-2/snapshot.16000009b6
2016-01-15 17:07:48,724 - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection from /10.0.0.101:58156
2016-01-15 17:07:48,761 - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@821] - Processing stat command from /10.0.0.101:58156
2016-01-15 17:07:48,763 - INFO [Thread-2:NIOServerCnxn$StatCommand@655] - Stat command output
2016-01-15 17:07:48,763 - INFO [Thread-2:NIOServerCnxn@1001] - Closed socket connection for client /10.0.0.101:58156 (no session established for client)
2016-01-15 17:08:02,003 - WARN [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Follower@118] - Got zxid 0x16000009b7 expected 0x1
2016-01-15 17:08:02,003 - INFO [SyncThread:1:FileTxnLog@199] - Creating new log file: log.16000009b7
The relevant entry seems to be: Got zxid 0x16000009b7 expected 0x1
Apparently it seems like the version 3.4.5 is buggy and it has been fixed in 3.4.6 so question now is how to apply a patch or how to upgrade within Ubuntu 14.04.3?
solr zookeeper
I am running a 3 node zookeeper ensemble on ubuntu 14.04. After noticing that node1 was not running, I had to remove the snapshots of this node and now the server did start, but refuses to join the cluster.
This is the log from zookeeper:
2016-01-15 17:07:28,187 - INFO [main:QuorumPeerConfig@101] - Reading configuration from: /etc/zookeeper/conf/zoo.cfg
2016-01-15 17:07:28,189 - INFO [main:QuorumPeerConfig@334] - Defaulting to majority quorums
2016-01-15 17:07:28,191 - INFO [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
2016-01-15 17:07:28,191 - INFO [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
2016-01-15 17:07:28,192 - INFO [main:DatadirCleanupManager@101] - Purge task is not scheduled.
2016-01-15 17:07:28,198 - INFO [main:QuorumPeerMain@127] - Starting quorum peer
2016-01-15 17:07:28,204 - INFO [main:NIOServerCnxnFactory@94] - binding to port 0.0.0.0/0.0.0.0:2181
2016-01-15 17:07:28,213 - INFO [main:QuorumPeer@913] - tickTime set to 2000
2016-01-15 17:07:28,213 - INFO [main:QuorumPeer@933] - minSessionTimeout set to -1
2016-01-15 17:07:28,213 - INFO [main:QuorumPeer@944] - maxSessionTimeout set to -1
2016-01-15 17:07:28,213 - INFO [main:QuorumPeer@959] - initLimit set to 10
2016-01-15 17:07:28,220 - INFO [main:QuorumPeer@429] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
2016-01-15 17:07:28,223 - INFO [main:QuorumPeer@444] - acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
2016-01-15 17:07:28,228 - INFO [Thread-1:QuorumCnxManager$Listener@486] - My election bind port: 0.0.0.0/0.0.0.0:3888
2016-01-15 17:07:28,233 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:QuorumPeer@670] - LOOKING
2016-01-15 17:07:28,234 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:FastLeaderElection@740] - New election. My id = 1, proposed zxid=0x0
2016-01-15 17:07:28,235 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 1 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)
2016-01-15 17:07:28,237 - INFO [WorkerSender[myid=1]:QuorumCnxManager@190] - Have smaller server identifier, so dropping the connection: (2, 1)
2016-01-15 17:07:28,237 - INFO [WorkerSender[myid=1]:QuorumCnxManager@190] - Have smaller server identifier, so dropping the connection: (3, 1)
2016-01-15 17:07:28,238 - INFO [zk1/10.0.0.101:3888:QuorumCnxManager$Listener@493] - Received connection request /10.0.0.103:48431
2016-01-15 17:07:28,239 - INFO [zk1/10.0.0.101:3888:QuorumCnxManager$Listener@493] - Received connection request /10.0.0.102:46486
2016-01-15 17:07:28,239 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 3 (n.leader), 0x1500000072 (n.zxid), 0x20 (n.round), LEADING (n.state), 3 (n.sid), 0x15 (n.peerEPoch), LOOKING (my state)
2016-01-15 17:07:28,240 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 3 (n.leader), 0x1500000072 (n.zxid), 0x20 (n.round), FOLLOWING (n.state), 2 (n.sid), 0x15 (n.peerEPoch), LOOKING (my state)
2016-01-15 17:07:28,240 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 3 (n.leader), 0x1500000072 (n.zxid), 0x20 (n.round), LEADING (n.state), 3 (n.sid), 0x15 (n.peerEPoch), LOOKING (my state)
2016-01-15 17:07:28,240 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:QuorumPeer@738] - FOLLOWING
2016-01-15 17:07:28,241 - INFO [WorkerReceiver[myid=1]:FastLeaderElection@542] - Notification: 3 (n.leader), 0x1500000072 (n.zxid), 0x20 (n.round), FOLLOWING (n.state), 2 (n.sid), 0x15 (n.peerEPoch), FOLLOWING (my state)
2016-01-15 17:07:28,242 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Learner@85] - TCP NoDelay set to: true
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:zookeeper.version=3.4.5--1, built on 06/10/2013 17:26 GMT
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:host.name=fx1.findix.com
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.version=1.8.0_66
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.vendor=Oracle Corporation
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.home=/usr/lib/jvm/java-8-oracle/jre
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.class.path=/etc/zookeeper/conf:/usr/share/java/jline.jar:/usr/share/java/log4j-1.2.jar:/usr/share/java/xercesImpl.jar:/usr/share/java/xmlParserAPIs.jar:/usr/share/java/netty.jar:/usr/share/java/slf4j-api.jar:/usr/share/java/slf4j-log4j12.jar:/usr/share/java/zookeeper.jar
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.io.tmpdir=/tmp
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.compiler=<NA>
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:os.name=Linux
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:os.arch=amd64
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:os.version=3.19.0-43-generic
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:user.name=zookeeper
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:user.home=/var/lib/zookeeper
2016-01-15 17:07:28,246 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:user.dir=/
2016-01-15 17:07:28,247 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:ZooKeeperServer@162] - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir /var/lib/zookeeper/version-2 snapdir /var/lib/zookeeper/version-2
2016-01-15 17:07:28,247 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Follower@63] - FOLLOWING - LEADER ELECTION TOOK - 13
2016-01-15 17:07:28,253 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Learner@325] - Getting a snapshot from leader
2016-01-15 17:07:28,262 - INFO [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:FileTxnSnapLog@240] - Snapshotting: 0x16000009b6 to /var/lib/zookeeper/version-2/snapshot.16000009b6
2016-01-15 17:07:48,724 - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection from /10.0.0.101:58156
2016-01-15 17:07:48,761 - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@821] - Processing stat command from /10.0.0.101:58156
2016-01-15 17:07:48,763 - INFO [Thread-2:NIOServerCnxn$StatCommand@655] - Stat command output
2016-01-15 17:07:48,763 - INFO [Thread-2:NIOServerCnxn@1001] - Closed socket connection for client /10.0.0.101:58156 (no session established for client)
2016-01-15 17:08:02,003 - WARN [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:Follower@118] - Got zxid 0x16000009b7 expected 0x1
2016-01-15 17:08:02,003 - INFO [SyncThread:1:FileTxnLog@199] - Creating new log file: log.16000009b7
The relevant entry seems to be: Got zxid 0x16000009b7 expected 0x1
Apparently it seems like the version 3.4.5 is buggy and it has been fixed in 3.4.6 so question now is how to apply a patch or how to upgrade within Ubuntu 14.04.3?
solr zookeeper
solr zookeeper
edited Jan 15 '16 at 19:15
merlin
asked Jan 15 '16 at 16:19
merlinmerlin
1,01452351
1,01452351
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
This seems to be a bug in 3.4.5: http://zookeeper.apache.org/releases.html : The release fixes a critical bug that could prevent a server from joining an established ensemble.
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "2"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f749443%2fzookeeper-will-not-join-the-cluster-how-to-apply-patch-upgrade%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
This seems to be a bug in 3.4.5: http://zookeeper.apache.org/releases.html : The release fixes a critical bug that could prevent a server from joining an established ensemble.
add a comment |
This seems to be a bug in 3.4.5: http://zookeeper.apache.org/releases.html : The release fixes a critical bug that could prevent a server from joining an established ensemble.
add a comment |
This seems to be a bug in 3.4.5: http://zookeeper.apache.org/releases.html : The release fixes a critical bug that could prevent a server from joining an established ensemble.
This seems to be a bug in 3.4.5: http://zookeeper.apache.org/releases.html : The release fixes a critical bug that could prevent a server from joining an established ensemble.
answered Jan 15 '16 at 19:07
merlinmerlin
1,01452351
1,01452351
add a comment |
add a comment |
Thanks for contributing an answer to Server Fault!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f749443%2fzookeeper-will-not-join-the-cluster-how-to-apply-patch-upgrade%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown