Istio breaks MySQL connection
I have an application that works just fine when deployed on regular K8s. I installed Istio on K8s along with my application. I configured a gateway and virtual service. Most thing appear to work except for internal connections to MySQL.
There are a few services that use MySQL and they can no longer connect to the database with Istio.
Any idea what broke? I am guessing it's something to do with the automatically injected sidecar proxy messing with the traffic. I am new to Istio and the docs are a bit scarce in places. Do I need to configure anything special for MySQL? Interestingly calls to MongoDB and Redis appear to be working. Confused :-(
kubernetes istio
asked Nov 13 '18 at 11:20
SteveWWSteveWW
62
add a comment |
I have an application that works just fine when deployed on regular K8s. I installed Istio on K8s along with my application. I configured a gateway and virtual service. Most thing appear to work except for internal connections to MySQL.
There are a few services that use MySQL and they can no longer connect to the database with Istio.
Any idea what broke? I am guessing it's something to do with the automatically injected sidecar proxy messing with the traffic. I am new to Istio and the docs are a bit scarce in places. Do I need to configure anything special for MySQL? Interestingly calls to MongoDB and Redis appear to be working. Confused :-(
kubernetes istio
asked Nov 13 '18 at 11:20
SteveWWSteveWW
62
Could you elaborate what exactly is wrong with MySQL connection? What kind of exceptions/errors you getting?
– getslaf
Nov 14 '18 at 10:32
I have a PHP and a Java service that should connect to MySQL both of them are reporting that they are unable to connect. Connection refused, they just can not see the database. I have checked and MySQL is running and I can connect to it from a shell inside the container.
– SteveWW
Nov 15 '18 at 10:32
@SteveWW hey ! MySql doesn't work with my Istio (1.5) either... Did you found a fix ?
– Doctor
Dec 26 '18 at 15:40
Looks like it's a bug with Istio, see answer below. At the moment I'm not using Istio with MySQL.
– SteveWW
Jan 2 at 9:54
add a comment |
I have an application that works just fine when deployed on regular K8s. I installed Istio on K8s along with my application. I configured a gateway and virtual service. Most thing appear to work except for internal connections to MySQL.
There are a few services that use MySQL and they can no longer connect to the database with Istio.
Any idea what broke? I am guessing it's something to do with the automatically injected sidecar proxy messing with the traffic. I am new to Istio and the docs are a bit scarce in places. Do I need to configure anything special for MySQL? Interestingly calls to MongoDB and Redis appear to be working. Confused :-(
kubernetes istio
asked Nov 13 '18 at 11:20
SteveWWSteveWW
62
I have an application that works just fine when deployed on regular K8s. I installed Istio on K8s along with my application. I configured a gateway and virtual service. Most thing appear to work except for internal connections to MySQL.
There are a few services that use MySQL and they can no longer connect to the database with Istio.
Any idea what broke? I am guessing it's something to do with the automatically injected sidecar proxy messing with the traffic. I am new to Istio and the docs are a bit scarce in places. Do I need to configure anything special for MySQL? Interestingly calls to MongoDB and Redis appear to be working. Confused :-(
kubernetes istio
kubernetes istio
asked Nov 13 '18 at 11:20
SteveWWSteveWW
62
asked Nov 13 '18 at 11:20
SteveWWSteveWW
62
asked Nov 13 '18 at 11:20
SteveWWSteveWW
62
asked Nov 13 '18 at 11:20
SteveWWSteveWW
62
asked Nov 13 '18 at 11:20
SteveWWSteveWW
62
62
Could you elaborate what exactly is wrong with MySQL connection? What kind of exceptions/errors you getting?
– getslaf
Nov 14 '18 at 10:32
I have a PHP and a Java service that should connect to MySQL both of them are reporting that they are unable to connect. Connection refused, they just can not see the database. I have checked and MySQL is running and I can connect to it from a shell inside the container.
– SteveWW
Nov 15 '18 at 10:32
@SteveWW hey ! MySql doesn't work with my Istio (1.5) either... Did you found a fix ?
– Doctor
Dec 26 '18 at 15:40
Looks like it's a bug with Istio, see answer below. At the moment I'm not using Istio with MySQL.
– SteveWW
Jan 2 at 9:54
add a comment |
Could you elaborate what exactly is wrong with MySQL connection? What kind of exceptions/errors you getting?
– getslaf
Nov 14 '18 at 10:32
I have a PHP and a Java service that should connect to MySQL both of them are reporting that they are unable to connect. Connection refused, they just can not see the database. I have checked and MySQL is running and I can connect to it from a shell inside the container.
– SteveWW
Nov 15 '18 at 10:32
@SteveWW hey ! MySql doesn't work with my Istio (1.5) either... Did you found a fix ?
– Doctor
Dec 26 '18 at 15:40
Looks like it's a bug with Istio, see answer below. At the moment I'm not using Istio with MySQL.
– SteveWW
Jan 2 at 9:54
Could you elaborate what exactly is wrong with MySQL connection? What kind of exceptions/errors you getting?
– getslaf
Nov 14 '18 at 10:32
Could you elaborate what exactly is wrong with MySQL connection? What kind of exceptions/errors you getting?
– getslaf
Nov 14 '18 at 10:32
I have a PHP and a Java service that should connect to MySQL both of them are reporting that they are unable to connect. Connection refused, they just can not see the database. I have checked and MySQL is running and I can connect to it from a shell inside the container.
– SteveWW
Nov 15 '18 at 10:32
I have a PHP and a Java service that should connect to MySQL both of them are reporting that they are unable to connect. Connection refused, they just can not see the database. I have checked and MySQL is running and I can connect to it from a shell inside the container.
– SteveWW
Nov 15 '18 at 10:32
@SteveWW hey ! MySql doesn't work with my Istio (1.5) either... Did you found a fix ?
– Doctor
Dec 26 '18 at 15:40
@SteveWW hey ! MySql doesn't work with my Istio (1.5) either... Did you found a fix ?
– Doctor
Dec 26 '18 at 15:40
Looks like it's a bug with Istio, see answer below. At the moment I'm not using Istio with MySQL.
– SteveWW
Jan 2 at 9:54
Looks like it's a bug with Istio, see answer below. At the moment I'm not using Istio with MySQL.
– SteveWW
Jan 2 at 9:54
add a comment |
1 Answer
1
active
oldest
votes
There are multiple bugs in istio 1.0.3 preventing this. One is the / in the name, which the developers don't seem to think is a big deal, but breaks all stateful sets as they use a slash in the name. Once this is resolved, you can get a statefulset mysql up, but the connection is fubar, it connects but immediately gives a MySQL has gone away. The newer 1.1 versions appear just as bad. I think 1.0.2 has the last "working" version of Istio, but there were still major issues that made me try newer versions.
You can find the istio.yaml change here: https://github.com/istio/istio/issues/9982
answered Nov 15 '18 at 18:49
Michael BusheyMichael Bushey
1
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53279924%2fistio-breaks-mysql-connection%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
There are multiple bugs in istio 1.0.3 preventing this. One is the / in the name, which the developers don't seem to think is a big deal, but breaks all stateful sets as they use a slash in the name. Once this is resolved, you can get a statefulset mysql up, but the connection is fubar, it connects but immediately gives a MySQL has gone away. The newer 1.1 versions appear just as bad. I think 1.0.2 has the last "working" version of Istio, but there were still major issues that made me try newer versions.
You can find the istio.yaml change here: https://github.com/istio/istio/issues/9982
answered Nov 15 '18 at 18:49
Michael BusheyMichael Bushey
1
add a comment |
There are multiple bugs in istio 1.0.3 preventing this. One is the / in the name, which the developers don't seem to think is a big deal, but breaks all stateful sets as they use a slash in the name. Once this is resolved, you can get a statefulset mysql up, but the connection is fubar, it connects but immediately gives a MySQL has gone away. The newer 1.1 versions appear just as bad. I think 1.0.2 has the last "working" version of Istio, but there were still major issues that made me try newer versions.
You can find the istio.yaml change here: https://github.com/istio/istio/issues/9982
answered Nov 15 '18 at 18:49
Michael BusheyMichael Bushey
1
add a comment |
There are multiple bugs in istio 1.0.3 preventing this. One is the / in the name, which the developers don't seem to think is a big deal, but breaks all stateful sets as they use a slash in the name. Once this is resolved, you can get a statefulset mysql up, but the connection is fubar, it connects but immediately gives a MySQL has gone away. The newer 1.1 versions appear just as bad. I think 1.0.2 has the last "working" version of Istio, but there were still major issues that made me try newer versions.
You can find the istio.yaml change here: https://github.com/istio/istio/issues/9982
answered Nov 15 '18 at 18:49
Michael BusheyMichael Bushey
1
There are multiple bugs in istio 1.0.3 preventing this. One is the / in the name, which the developers don't seem to think is a big deal, but breaks all stateful sets as they use a slash in the name. Once this is resolved, you can get a statefulset mysql up, but the connection is fubar, it connects but immediately gives a MySQL has gone away. The newer 1.1 versions appear just as bad. I think 1.0.2 has the last "working" version of Istio, but there were still major issues that made me try newer versions.
You can find the istio.yaml change here: https://github.com/istio/istio/issues/9982
answered Nov 15 '18 at 18:49
Michael BusheyMichael Bushey
1
answered Nov 15 '18 at 18:49
Michael BusheyMichael Bushey
1
answered Nov 15 '18 at 18:49
Michael BusheyMichael Bushey
1
answered Nov 15 '18 at 18:49
Michael BusheyMichael Bushey
1
1
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53279924%2fistio-breaks-mysql-connection%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Could you elaborate what exactly is wrong with MySQL connection? What kind of exceptions/errors you getting?
– getslaf
Nov 14 '18 at 10:32
I have a PHP and a Java service that should connect to MySQL both of them are reporting that they are unable to connect. Connection refused, they just can not see the database. I have checked and MySQL is running and I can connect to it from a shell inside the container.
– SteveWW
Nov 15 '18 at 10:32
@SteveWW hey ! MySql doesn't work with my Istio (1.5) either... Did you found a fix ?
– Doctor
Dec 26 '18 at 15:40
Looks like it's a bug with Istio, see answer below. At the moment I'm not using Istio with MySQL.
– SteveWW
Jan 2 at 9:54