Azure batch job task not running on the specified pool?
I created an azure batch pool with custom image. Now when I create a job from the pool and create a task from the job and run it, the task fails because it does not find the (python) dependency package I preinstalled through the custom image; moreover in the task's overview, under 'Pool' it says 'n/a'. So does that mean the pool that I created from custom image is not being used by the task, and therefore my packages are missing?
By the way, if I log on to a node in the pool, I can see my packages do exist on the nodes.
Thanks.
azure azure-virtual-machine python-packaging azure-batch asked Nov 13 '18 at 20:52
GadamGadam
58831026
add a comment |
I created an azure batch pool with custom image. Now when I create a job from the pool and create a task from the job and run it, the task fails because it does not find the (python) dependency package I preinstalled through the custom image; moreover in the task's overview, under 'Pool' it says 'n/a'. So does that mean the pool that I created from custom image is not being used by the task, and therefore my packages are missing?
By the way, if I log on to a node in the pool, I can see my packages do exist on the nodes.
Thanks.
azure azure-virtual-machine python-packaging azure-batch asked Nov 13 '18 at 20:52
GadamGadam
58831026
add a comment |
I created an azure batch pool with custom image. Now when I create a job from the pool and create a task from the job and run it, the task fails because it does not find the (python) dependency package I preinstalled through the custom image; moreover in the task's overview, under 'Pool' it says 'n/a'. So does that mean the pool that I created from custom image is not being used by the task, and therefore my packages are missing?
By the way, if I log on to a node in the pool, I can see my packages do exist on the nodes.
Thanks.
azure azure-virtual-machine python-packaging azure-batch asked Nov 13 '18 at 20:52
GadamGadam
58831026
I created an azure batch pool with custom image. Now when I create a job from the pool and create a task from the job and run it, the task fails because it does not find the (python) dependency package I preinstalled through the custom image; moreover in the task's overview, under 'Pool' it says 'n/a'. So does that mean the pool that I created from custom image is not being used by the task, and therefore my packages are missing?
By the way, if I log on to a node in the pool, I can see my packages do exist on the nodes.
Thanks.
azure azure-virtual-machine python-packaging azure-batch azure azure-virtual-machine python-packaging azure-batch asked Nov 13 '18 at 20:52
GadamGadam
58831026
asked Nov 13 '18 at 20:52
GadamGadam
58831026
asked Nov 13 '18 at 20:52
GadamGadam
58831026
asked Nov 13 '18 at 20:52
GadamGadam
58831026
asked Nov 13 '18 at 20:52
GadamGadam
58831026
58831026
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
Using a custom image saves time in preparing your pool's compute nodes
to run your Batch workload. While you can use an Azure Marketplace
image and install software on each compute node after provisioning,
using a custom image might be more efficient.
With the description of the document, the difference between the custom image and Azure Marketplace image is just that you installed the applications indeed in your custom image. So you can run tasks in the pool nodes no matter which image you have used.
For the issues you met, I think it's the user issue which you use to run the tasks. The user permission will limit the use of the application in the nodes. For more details, see Run tasks under user accounts in Batch. I suggest you can try to use an admin user to run your tasks. Hope this will be helpful.
answered Nov 14 '18 at 9:36
Charles XuCharles Xu
3,9381210
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53289336%2fazure-batch-job-task-not-running-on-the-specified-pool%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Using a custom image saves time in preparing your pool's compute nodes
to run your Batch workload. While you can use an Azure Marketplace
image and install software on each compute node after provisioning,
using a custom image might be more efficient.
With the description of the document, the difference between the custom image and Azure Marketplace image is just that you installed the applications indeed in your custom image. So you can run tasks in the pool nodes no matter which image you have used.
For the issues you met, I think it's the user issue which you use to run the tasks. The user permission will limit the use of the application in the nodes. For more details, see Run tasks under user accounts in Batch. I suggest you can try to use an admin user to run your tasks. Hope this will be helpful.
answered Nov 14 '18 at 9:36
Charles XuCharles Xu
3,9381210
add a comment |
Using a custom image saves time in preparing your pool's compute nodes
to run your Batch workload. While you can use an Azure Marketplace
image and install software on each compute node after provisioning,
using a custom image might be more efficient.
With the description of the document, the difference between the custom image and Azure Marketplace image is just that you installed the applications indeed in your custom image. So you can run tasks in the pool nodes no matter which image you have used.
For the issues you met, I think it's the user issue which you use to run the tasks. The user permission will limit the use of the application in the nodes. For more details, see Run tasks under user accounts in Batch. I suggest you can try to use an admin user to run your tasks. Hope this will be helpful.
answered Nov 14 '18 at 9:36
Charles XuCharles Xu
3,9381210
add a comment |
Using a custom image saves time in preparing your pool's compute nodes
to run your Batch workload. While you can use an Azure Marketplace
image and install software on each compute node after provisioning,
using a custom image might be more efficient.
With the description of the document, the difference between the custom image and Azure Marketplace image is just that you installed the applications indeed in your custom image. So you can run tasks in the pool nodes no matter which image you have used.
For the issues you met, I think it's the user issue which you use to run the tasks. The user permission will limit the use of the application in the nodes. For more details, see Run tasks under user accounts in Batch. I suggest you can try to use an admin user to run your tasks. Hope this will be helpful.
answered Nov 14 '18 at 9:36
Charles XuCharles Xu
3,9381210
Using a custom image saves time in preparing your pool's compute nodes
to run your Batch workload. While you can use an Azure Marketplace
image and install software on each compute node after provisioning,
using a custom image might be more efficient.
With the description of the document, the difference between the custom image and Azure Marketplace image is just that you installed the applications indeed in your custom image. So you can run tasks in the pool nodes no matter which image you have used.
For the issues you met, I think it's the user issue which you use to run the tasks. The user permission will limit the use of the application in the nodes. For more details, see Run tasks under user accounts in Batch. I suggest you can try to use an admin user to run your tasks. Hope this will be helpful.
answered Nov 14 '18 at 9:36
Charles XuCharles Xu
3,9381210
answered Nov 14 '18 at 9:36
Charles XuCharles Xu
3,9381210
answered Nov 14 '18 at 9:36
Charles XuCharles Xu
3,9381210
answered Nov 14 '18 at 9:36
Charles XuCharles Xu
3,9381210
3,9381210
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53289336%2fazure-batch-job-task-not-running-on-the-specified-pool%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
