kafka scripts in “bin” directory fail with “Address already in use” (running in kubernetes)Running single replica Kubernetes service at public IP address and without load balancingCannot use supervisor with Apache KafkaRunning Kafka in Kubernetes on AWSKubernetes API Server Healthcheck Address with kubeadm
A newer friend of my brother's gave him a load of baseball cards that are supposedly extremely valuable. Is this a scam?
Patience, young "Padovan"
Why doesn't Newton's third law mean a person bounces back to where they started when they hit the ground?
A function which translates a sentence to title-case
Is there really no realistic way for a skeleton monster to move around without magic?
Can an x86 CPU running in real mode be considered to be basically an 8086 CPU?
Are tax years 2016 & 2017 back taxes deductible for tax year 2018?
New order #4: World
How do I create uniquely male characters?
Prevent a directory in /tmp from being deleted
Motorized valve interfering with button?
Is it possible to make sharp wind that can cut stuff from afar?
Do airline pilots ever risk not hearing communication directed to them specifically, from traffic controllers?
How old can references or sources in a thesis be?
How to type dʒ symbol (IPA) on Mac?
Why did the Germans forbid the possession of pet pigeons in Rostov-on-Don in 1941?
How long does it take to type this?
Why was the small council so happy for Tyrion to become the Master of Coin?
DOS, create pipe for stdin/stdout of command.com(or 4dos.com) in C or Batch?
Why is the design of haulage companies so “special”?
Circuitry of TV splitters
I’m planning on buying a laser printer but concerned about the life cycle of toner in the machine
Schwarzchild Radius of the Universe
What is the command to reset a PC without deleting any files
kafka scripts in “bin” directory fail with “Address already in use” (running in kubernetes)
Running single replica Kubernetes service at public IP address and without load balancingCannot use supervisor with Apache KafkaRunning Kafka in Kubernetes on AWSKubernetes API Server Healthcheck Address with kubeadm
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I have a kafka set up running in minikube. It's up and running, and I'm able to produce messages into it and consume them back out.
However, when I'm logging in to one the brokers (using kubectl exec if relevant) and try to get some information about its state using one of the scripts in bin, I get an exception Address already in use:
root@kafka-0:/kafka# bin/kafka-consumer-groups.sh --list --bootstrap-server kafka:9092
Exception in thread "main" java.lang.reflect.InvocationTargetException
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at java.instrument/sun.instrument.InstrumentationImpl.loadClassAndStartAgent(InstrumentationImpl.java:513)
at java.instrument/sun.instrument.InstrumentationImpl.loadClassAndCallPremain(InstrumentationImpl.java:525)
Caused by: java.net.BindException: Address already in use
at java.base/sun.nio.ch.Net.bind0(Native Method)
at java.base/sun.nio.ch.Net.bind(Net.java:461)
at java.base/sun.nio.ch.Net.bind(Net.java:453)
at java.base/sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:227)
at java.base/sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:80)
at jdk.httpserver/sun.net.httpserver.ServerImpl.bind(ServerImpl.java:134)
at jdk.httpserver/sun.net.httpserver.HttpServerImpl.bind(HttpServerImpl.java:54)
at io.prometheus.jmx.shaded.io.prometheus.client.exporter.HTTPServer.<init>(HTTPServer.java:145)
at io.prometheus.jmx.shaded.io.prometheus.jmx.JavaAgent.premain(JavaAgent.java:54)
... 6 more
FATAL ERROR in native method: processing of -javaagent failed
Aborted (core dumped)
A quick look using strace showed that it is trying to bind to port 80. I have no idea why that is even necessary for a script that is meant only to obtain data.
The same error happens on all scripts in the kafka bin directory.
Any ideas regarding on how to fix will be a great help
kubernetes kafka
asked Apr 4 at 13:24
Tom KlinoTom Klino
196119
add a comment |
I have a kafka set up running in minikube. It's up and running, and I'm able to produce messages into it and consume them back out.
However, when I'm logging in to one the brokers (using kubectl exec if relevant) and try to get some information about its state using one of the scripts in bin, I get an exception Address already in use:
root@kafka-0:/kafka# bin/kafka-consumer-groups.sh --list --bootstrap-server kafka:9092
Exception in thread "main" java.lang.reflect.InvocationTargetException
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at java.instrument/sun.instrument.InstrumentationImpl.loadClassAndStartAgent(InstrumentationImpl.java:513)
at java.instrument/sun.instrument.InstrumentationImpl.loadClassAndCallPremain(InstrumentationImpl.java:525)
Caused by: java.net.BindException: Address already in use
at java.base/sun.nio.ch.Net.bind0(Native Method)
at java.base/sun.nio.ch.Net.bind(Net.java:461)
at java.base/sun.nio.ch.Net.bind(Net.java:453)
at java.base/sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:227)
at java.base/sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:80)
at jdk.httpserver/sun.net.httpserver.ServerImpl.bind(ServerImpl.java:134)
at jdk.httpserver/sun.net.httpserver.HttpServerImpl.bind(HttpServerImpl.java:54)
at io.prometheus.jmx.shaded.io.prometheus.client.exporter.HTTPServer.<init>(HTTPServer.java:145)
at io.prometheus.jmx.shaded.io.prometheus.jmx.JavaAgent.premain(JavaAgent.java:54)
... 6 more
FATAL ERROR in native method: processing of -javaagent failed
Aborted (core dumped)
A quick look using strace showed that it is trying to bind to port 80. I have no idea why that is even necessary for a script that is meant only to obtain data.
The same error happens on all scripts in the kafka bin directory.
Any ideas regarding on how to fix will be a great help
kubernetes kafka
asked Apr 4 at 13:24
Tom KlinoTom Klino
196119
add a comment |
I have a kafka set up running in minikube. It's up and running, and I'm able to produce messages into it and consume them back out.
However, when I'm logging in to one the brokers (using kubectl exec if relevant) and try to get some information about its state using one of the scripts in bin, I get an exception Address already in use:
root@kafka-0:/kafka# bin/kafka-consumer-groups.sh --list --bootstrap-server kafka:9092
Exception in thread "main" java.lang.reflect.InvocationTargetException
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at java.instrument/sun.instrument.InstrumentationImpl.loadClassAndStartAgent(InstrumentationImpl.java:513)
at java.instrument/sun.instrument.InstrumentationImpl.loadClassAndCallPremain(InstrumentationImpl.java:525)
Caused by: java.net.BindException: Address already in use
at java.base/sun.nio.ch.Net.bind0(Native Method)
at java.base/sun.nio.ch.Net.bind(Net.java:461)
at java.base/sun.nio.ch.Net.bind(Net.java:453)
at java.base/sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:227)
at java.base/sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:80)
at jdk.httpserver/sun.net.httpserver.ServerImpl.bind(ServerImpl.java:134)
at jdk.httpserver/sun.net.httpserver.HttpServerImpl.bind(HttpServerImpl.java:54)
at io.prometheus.jmx.shaded.io.prometheus.client.exporter.HTTPServer.<init>(HTTPServer.java:145)
at io.prometheus.jmx.shaded.io.prometheus.jmx.JavaAgent.premain(JavaAgent.java:54)
... 6 more
FATAL ERROR in native method: processing of -javaagent failed
Aborted (core dumped)
A quick look using strace showed that it is trying to bind to port 80. I have no idea why that is even necessary for a script that is meant only to obtain data.
The same error happens on all scripts in the kafka bin directory.
Any ideas regarding on how to fix will be a great help
kubernetes kafka
asked Apr 4 at 13:24
Tom KlinoTom Klino
196119
I have a kafka set up running in minikube. It's up and running, and I'm able to produce messages into it and consume them back out.
However, when I'm logging in to one the brokers (using kubectl exec if relevant) and try to get some information about its state using one of the scripts in bin, I get an exception Address already in use:
root@kafka-0:/kafka# bin/kafka-consumer-groups.sh --list --bootstrap-server kafka:9092
Exception in thread "main" java.lang.reflect.InvocationTargetException
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at java.instrument/sun.instrument.InstrumentationImpl.loadClassAndStartAgent(InstrumentationImpl.java:513)
at java.instrument/sun.instrument.InstrumentationImpl.loadClassAndCallPremain(InstrumentationImpl.java:525)
Caused by: java.net.BindException: Address already in use
at java.base/sun.nio.ch.Net.bind0(Native Method)
at java.base/sun.nio.ch.Net.bind(Net.java:461)
at java.base/sun.nio.ch.Net.bind(Net.java:453)
at java.base/sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:227)
at java.base/sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:80)
at jdk.httpserver/sun.net.httpserver.ServerImpl.bind(ServerImpl.java:134)
at jdk.httpserver/sun.net.httpserver.HttpServerImpl.bind(HttpServerImpl.java:54)
at io.prometheus.jmx.shaded.io.prometheus.client.exporter.HTTPServer.<init>(HTTPServer.java:145)
at io.prometheus.jmx.shaded.io.prometheus.jmx.JavaAgent.premain(JavaAgent.java:54)
... 6 more
FATAL ERROR in native method: processing of -javaagent failed
Aborted (core dumped)
A quick look using strace showed that it is trying to bind to port 80. I have no idea why that is even necessary for a script that is meant only to obtain data.
The same error happens on all scripts in the kafka bin directory.
Any ideas regarding on how to fix will be a great help
kubernetes kafka
kubernetes kafka
asked Apr 4 at 13:24
Tom KlinoTom Klino
196119
asked Apr 4 at 13:24
Tom KlinoTom Klino
196119
asked Apr 4 at 13:24
Tom KlinoTom Klino
196119
asked Apr 4 at 13:24
Tom KlinoTom Klino
196119
asked Apr 4 at 13:24
Tom KlinoTom Klino
196119
196119
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
In the command instead of --bootsrap-server can you use --broker-list
answered Apr 4 at 13:29
Abhishek MishraAbhishek Mishra
1314
that doesn't help. exact same error
– Tom Klino
Apr 4 at 13:30
Just out of curiosity when you write kafka:9092 does it mean hostname of the kafka server is "kafka". If not could you try your original command with IP address instead of hostname
– Abhishek Mishra
Apr 4 at 13:39
yes, the hostname is "kafka". kubernetes dns resolves this to the brokers. but for that matter, I already tried using localhost as well
– Tom Klino
Apr 4 at 13:41
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "2"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f961501%2fkafka-scripts-in-bin-directory-fail-with-address-already-in-use-running-in%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
In the command instead of --bootsrap-server can you use --broker-list
answered Apr 4 at 13:29
Abhishek MishraAbhishek Mishra
1314
that doesn't help. exact same error
– Tom Klino
Apr 4 at 13:30
Just out of curiosity when you write kafka:9092 does it mean hostname of the kafka server is "kafka". If not could you try your original command with IP address instead of hostname
– Abhishek Mishra
Apr 4 at 13:39
yes, the hostname is "kafka". kubernetes dns resolves this to the brokers. but for that matter, I already tried using localhost as well
– Tom Klino
Apr 4 at 13:41
add a comment |
In the command instead of --bootsrap-server can you use --broker-list
answered Apr 4 at 13:29
Abhishek MishraAbhishek Mishra
1314
that doesn't help. exact same error
– Tom Klino
Apr 4 at 13:30
Just out of curiosity when you write kafka:9092 does it mean hostname of the kafka server is "kafka". If not could you try your original command with IP address instead of hostname
– Abhishek Mishra
Apr 4 at 13:39
yes, the hostname is "kafka". kubernetes dns resolves this to the brokers. but for that matter, I already tried using localhost as well
– Tom Klino
Apr 4 at 13:41
add a comment |
In the command instead of --bootsrap-server can you use --broker-list
answered Apr 4 at 13:29
Abhishek MishraAbhishek Mishra
1314
In the command instead of --bootsrap-server can you use --broker-list
answered Apr 4 at 13:29
Abhishek MishraAbhishek Mishra
1314
answered Apr 4 at 13:29
Abhishek MishraAbhishek Mishra
1314
answered Apr 4 at 13:29
Abhishek MishraAbhishek Mishra
1314
answered Apr 4 at 13:29
Abhishek MishraAbhishek Mishra
1314
1314
that doesn't help. exact same error
– Tom Klino
Apr 4 at 13:30
Just out of curiosity when you write kafka:9092 does it mean hostname of the kafka server is "kafka". If not could you try your original command with IP address instead of hostname
– Abhishek Mishra
Apr 4 at 13:39
yes, the hostname is "kafka". kubernetes dns resolves this to the brokers. but for that matter, I already tried using localhost as well
– Tom Klino
Apr 4 at 13:41
add a comment |
that doesn't help. exact same error
– Tom Klino
Apr 4 at 13:30
Just out of curiosity when you write kafka:9092 does it mean hostname of the kafka server is "kafka". If not could you try your original command with IP address instead of hostname
– Abhishek Mishra
Apr 4 at 13:39
yes, the hostname is "kafka". kubernetes dns resolves this to the brokers. but for that matter, I already tried using localhost as well
– Tom Klino
Apr 4 at 13:41
that doesn't help. exact same error
– Tom Klino
Apr 4 at 13:30
that doesn't help. exact same error
– Tom Klino
Apr 4 at 13:30
Just out of curiosity when you write kafka:9092 does it mean hostname of the kafka server is "kafka". If not could you try your original command with IP address instead of hostname
– Abhishek Mishra
Apr 4 at 13:39
Just out of curiosity when you write kafka:9092 does it mean hostname of the kafka server is "kafka". If not could you try your original command with IP address instead of hostname
– Abhishek Mishra
Apr 4 at 13:39
yes, the hostname is "kafka". kubernetes dns resolves this to the brokers. but for that matter, I already tried using localhost as well
– Tom Klino
Apr 4 at 13:41
yes, the hostname is "kafka". kubernetes dns resolves this to the brokers. but for that matter, I already tried using localhost as well
– Tom Klino
Apr 4 at 13:41
add a comment |
Thanks for contributing an answer to Server Fault!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f961501%2fkafka-scripts-in-bin-directory-fail-with-address-already-in-use-running-in%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
