Using unittest in python with docker and psycopg2









up vote
0
down vote

favorite












BRIEF DESCRIPTION OF THE PROBLEM: Psycopg2 won't connect to a test DB within docker from unittest, but connects fine from console.



ERROR MESSAGE:
psycopg2.OperationalError: server closed the connection unexpectedly
This probably means the server terminated abnormally before or while processing the request.



DETAILS:
I'm trying to set up a testing database in docker, that will be created and populated before testing and then removed after.



Here's the fuction to set up database:



def set_up_empty_test_db():
client = docker.from_env()
try:
testdb = client.containers.get("TestDB")
testdb.stop()
testdb.remove()
testdb = client.containers.run(
"postgres",
ports=5432: 5433,
detach=True,
name="TestDB",
environment=["POSTGRES_PASSWORD=yourPassword"],
)
except NotFound:
testdb = client.containers.run(
"postgres",
ports=5432: 5433,
detach=True,
name="TestDB",
environment=["POSTGRES_PASSWORD=yourPassword"],
)

while testdb.status != "running":
testdb = client.containers.get("TestDB")
return


If I launch this function from console it works without an error and I can see TestDB container running. I can successfully initiate connection:



conn = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")


But it doesn't work when unit testing. Here's the testing code:



class TestCreateCity(unittest.TestCase):
def setUp(self):
set_up_empty_test_db()
con = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")

self.assertIsNone(con.isolation_level)

cur = con.cursor()
sql_file = open(os.path.join(ROOT_DIR + "/ddl/creates/schema_y.sql"), "r")
cur.execute(sql_file.readline())
con.commit()
con.close()
self.session = Session(creator=con)

def test_create_city(self):
cs.create_city("Test_CITY", "US")
q = self.session.query(City).filter(City.city_name == "Test_CITY").one()
self.assertIs(q)
self.assertEqual(q.city_name, "Test_CITY")
self.assertEqual(q.country_code, "US")


It breaks when trying to initiate connection. Please advise.










share|improve this question





















  • you get any error message?
    – RandomDude
    Sep 6 at 13:47














up vote
0
down vote

favorite












BRIEF DESCRIPTION OF THE PROBLEM: Psycopg2 won't connect to a test DB within docker from unittest, but connects fine from console.



ERROR MESSAGE:
psycopg2.OperationalError: server closed the connection unexpectedly
This probably means the server terminated abnormally before or while processing the request.



DETAILS:
I'm trying to set up a testing database in docker, that will be created and populated before testing and then removed after.



Here's the fuction to set up database:



def set_up_empty_test_db():
client = docker.from_env()
try:
testdb = client.containers.get("TestDB")
testdb.stop()
testdb.remove()
testdb = client.containers.run(
"postgres",
ports=5432: 5433,
detach=True,
name="TestDB",
environment=["POSTGRES_PASSWORD=yourPassword"],
)
except NotFound:
testdb = client.containers.run(
"postgres",
ports=5432: 5433,
detach=True,
name="TestDB",
environment=["POSTGRES_PASSWORD=yourPassword"],
)

while testdb.status != "running":
testdb = client.containers.get("TestDB")
return


If I launch this function from console it works without an error and I can see TestDB container running. I can successfully initiate connection:



conn = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")


But it doesn't work when unit testing. Here's the testing code:



class TestCreateCity(unittest.TestCase):
def setUp(self):
set_up_empty_test_db()
con = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")

self.assertIsNone(con.isolation_level)

cur = con.cursor()
sql_file = open(os.path.join(ROOT_DIR + "/ddl/creates/schema_y.sql"), "r")
cur.execute(sql_file.readline())
con.commit()
con.close()
self.session = Session(creator=con)

def test_create_city(self):
cs.create_city("Test_CITY", "US")
q = self.session.query(City).filter(City.city_name == "Test_CITY").one()
self.assertIs(q)
self.assertEqual(q.city_name, "Test_CITY")
self.assertEqual(q.country_code, "US")


It breaks when trying to initiate connection. Please advise.










share|improve this question





















  • you get any error message?
    – RandomDude
    Sep 6 at 13:47












up vote
0
down vote

favorite









up vote
0
down vote

favorite











BRIEF DESCRIPTION OF THE PROBLEM: Psycopg2 won't connect to a test DB within docker from unittest, but connects fine from console.



ERROR MESSAGE:
psycopg2.OperationalError: server closed the connection unexpectedly
This probably means the server terminated abnormally before or while processing the request.



DETAILS:
I'm trying to set up a testing database in docker, that will be created and populated before testing and then removed after.



Here's the fuction to set up database:



def set_up_empty_test_db():
client = docker.from_env()
try:
testdb = client.containers.get("TestDB")
testdb.stop()
testdb.remove()
testdb = client.containers.run(
"postgres",
ports=5432: 5433,
detach=True,
name="TestDB",
environment=["POSTGRES_PASSWORD=yourPassword"],
)
except NotFound:
testdb = client.containers.run(
"postgres",
ports=5432: 5433,
detach=True,
name="TestDB",
environment=["POSTGRES_PASSWORD=yourPassword"],
)

while testdb.status != "running":
testdb = client.containers.get("TestDB")
return


If I launch this function from console it works without an error and I can see TestDB container running. I can successfully initiate connection:



conn = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")


But it doesn't work when unit testing. Here's the testing code:



class TestCreateCity(unittest.TestCase):
def setUp(self):
set_up_empty_test_db()
con = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")

self.assertIsNone(con.isolation_level)

cur = con.cursor()
sql_file = open(os.path.join(ROOT_DIR + "/ddl/creates/schema_y.sql"), "r")
cur.execute(sql_file.readline())
con.commit()
con.close()
self.session = Session(creator=con)

def test_create_city(self):
cs.create_city("Test_CITY", "US")
q = self.session.query(City).filter(City.city_name == "Test_CITY").one()
self.assertIs(q)
self.assertEqual(q.city_name, "Test_CITY")
self.assertEqual(q.country_code, "US")


It breaks when trying to initiate connection. Please advise.










share|improve this question













BRIEF DESCRIPTION OF THE PROBLEM: Psycopg2 won't connect to a test DB within docker from unittest, but connects fine from console.



ERROR MESSAGE:
psycopg2.OperationalError: server closed the connection unexpectedly
This probably means the server terminated abnormally before or while processing the request.



DETAILS:
I'm trying to set up a testing database in docker, that will be created and populated before testing and then removed after.



Here's the fuction to set up database:



def set_up_empty_test_db():
client = docker.from_env()
try:
testdb = client.containers.get("TestDB")
testdb.stop()
testdb.remove()
testdb = client.containers.run(
"postgres",
ports=5432: 5433,
detach=True,
name="TestDB",
environment=["POSTGRES_PASSWORD=yourPassword"],
)
except NotFound:
testdb = client.containers.run(
"postgres",
ports=5432: 5433,
detach=True,
name="TestDB",
environment=["POSTGRES_PASSWORD=yourPassword"],
)

while testdb.status != "running":
testdb = client.containers.get("TestDB")
return


If I launch this function from console it works without an error and I can see TestDB container running. I can successfully initiate connection:



conn = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")


But it doesn't work when unit testing. Here's the testing code:



class TestCreateCity(unittest.TestCase):
def setUp(self):
set_up_empty_test_db()
con = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")

self.assertIsNone(con.isolation_level)

cur = con.cursor()
sql_file = open(os.path.join(ROOT_DIR + "/ddl/creates/schema_y.sql"), "r")
cur.execute(sql_file.readline())
con.commit()
con.close()
self.session = Session(creator=con)

def test_create_city(self):
cs.create_city("Test_CITY", "US")
q = self.session.query(City).filter(City.city_name == "Test_CITY").one()
self.assertIs(q)
self.assertEqual(q.city_name, "Test_CITY")
self.assertEqual(q.country_code, "US")


It breaks when trying to initiate connection. Please advise.







python unit-testing docker psycopg2






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked Jul 7 at 10:59









Mikhail Beliansky

365




365











  • you get any error message?
    – RandomDude
    Sep 6 at 13:47
















  • you get any error message?
    – RandomDude
    Sep 6 at 13:47















you get any error message?
– RandomDude
Sep 6 at 13:47




you get any error message?
– RandomDude
Sep 6 at 13:47












1 Answer
1






active

oldest

votes

















up vote
0
down vote













I know this is an old question, but I needed to do the same thing today. You try and connect to the postgres server too quickly after starting it - that's why it works in the console.



All you need to do is replace:



set_up_empty_test_db()
con = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")


with:



set_up_empty_test_db()
con = None
while con == None:
try:
con = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")
except psycopg2.OperationalError:
time.sleep(0.5);


Hope this helps someone else. Cheers!






share|improve this answer




















  • That's exactly what I did in my own solution. Thanks for sharing!
    – Mikhail Beliansky
    Nov 18 at 12:55










Your Answer






StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f51222513%2fusing-unittest-in-python-with-docker-and-psycopg2%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























1 Answer
1






active

oldest

votes








1 Answer
1






active

oldest

votes









active

oldest

votes






active

oldest

votes








up vote
0
down vote













I know this is an old question, but I needed to do the same thing today. You try and connect to the postgres server too quickly after starting it - that's why it works in the console.



All you need to do is replace:



set_up_empty_test_db()
con = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")


with:



set_up_empty_test_db()
con = None
while con == None:
try:
con = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")
except psycopg2.OperationalError:
time.sleep(0.5);


Hope this helps someone else. Cheers!






share|improve this answer




















  • That's exactly what I did in my own solution. Thanks for sharing!
    – Mikhail Beliansky
    Nov 18 at 12:55














up vote
0
down vote













I know this is an old question, but I needed to do the same thing today. You try and connect to the postgres server too quickly after starting it - that's why it works in the console.



All you need to do is replace:



set_up_empty_test_db()
con = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")


with:



set_up_empty_test_db()
con = None
while con == None:
try:
con = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")
except psycopg2.OperationalError:
time.sleep(0.5);


Hope this helps someone else. Cheers!






share|improve this answer




















  • That's exactly what I did in my own solution. Thanks for sharing!
    – Mikhail Beliansky
    Nov 18 at 12:55












up vote
0
down vote










up vote
0
down vote









I know this is an old question, but I needed to do the same thing today. You try and connect to the postgres server too quickly after starting it - that's why it works in the console.



All you need to do is replace:



set_up_empty_test_db()
con = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")


with:



set_up_empty_test_db()
con = None
while con == None:
try:
con = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")
except psycopg2.OperationalError:
time.sleep(0.5);


Hope this helps someone else. Cheers!






share|improve this answer












I know this is an old question, but I needed to do the same thing today. You try and connect to the postgres server too quickly after starting it - that's why it works in the console.



All you need to do is replace:



set_up_empty_test_db()
con = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")


with:



set_up_empty_test_db()
con = None
while con == None:
try:
con = psycopg2.connect("host='localhost' user='postgres' password='yourPassword' port='5433'")
except psycopg2.OperationalError:
time.sleep(0.5);


Hope this helps someone else. Cheers!







share|improve this answer












share|improve this answer



share|improve this answer










answered Nov 12 at 0:12









user2368291

311




311











  • That's exactly what I did in my own solution. Thanks for sharing!
    – Mikhail Beliansky
    Nov 18 at 12:55
















  • That's exactly what I did in my own solution. Thanks for sharing!
    – Mikhail Beliansky
    Nov 18 at 12:55















That's exactly what I did in my own solution. Thanks for sharing!
– Mikhail Beliansky
Nov 18 at 12:55




That's exactly what I did in my own solution. Thanks for sharing!
– Mikhail Beliansky
Nov 18 at 12:55

















draft saved

draft discarded
















































Thanks for contributing an answer to Stack Overflow!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.





Some of your past answers have not been well-received, and you're in danger of being blocked from answering.


Please pay close attention to the following guidance:


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f51222513%2fusing-unittest-in-python-with-docker-and-psycopg2%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







這個網誌中的熱門文章

How to read a connectionString WITH PROVIDER in .NET Core?

In R, how to develop a multiplot heatmap.2 figure showing key labels successfully

Museum of Modern and Contemporary Art of Trento and Rovereto