How to allow concurrent execution of job arrays with job share (-js)How do i get concurrent asp.net on linux?How do concurrent filesystems work?How to lock concurrent access to a shared webservice from multiple webservers?Apache httpd response time increase with concurrent connectionsHow to allow more than two simultanous sessions on AzureHow to submit job from compute node to another compute node?How many concurrent TCP connections or sockets can be handled by a web server for e.g in a chat application
How is it believable that Euron could so easily pull off this ambush?
How do I politely tell my players to shut up about their backstory?
Where do 5 or more U.S. counties meet in a single point?
And now you see it II (the B side)
How could a civilization detect tachyons?
Is there an idiom that means "revealing a secret unintentionally"?
Magical Modulo Squares
Why are thrust reversers not used down to taxi speeds?
What dice to use in a game that revolves around triangles?
Can radiation block all wireless communications?
When was it publicly revealed that a KH-11 spy satellite took pictures of the first Shuttle flight?
Is it possible to do moon sighting in advance for 5 years with 100% accuracy?
Why is the episode called "The Last of the Starks"?
How to avoid making self and former employee look bad when reporting on fixing former employee's work?
How to start your Starctaft II games vs AI immediatly?
Can the president of the United States be guilty of insider trading?
Names of the Six Tastes
Exactly which act of bravery are Luke and Han awarded a medal for?
Is the tensor product (of vector spaces) commutative?
Trying to understand a summation
What's the difference between "ricochet" and "bounce"?
Company stopped paying my salary. What are my options?
My parents are Afghan
Opposite party turned away from voting when ballot is all opposing party
How to allow concurrent execution of job arrays with job share (-js)
How do i get concurrent asp.net on linux?How do concurrent filesystems work?How to lock concurrent access to a shared webservice from multiple webservers?Apache httpd response time increase with concurrent connectionsHow to allow more than two simultanous sessions on AzureHow to submit job from compute node to another compute node?How many concurrent TCP connections or sockets can be handled by a web server for e.g in a chat application
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I'm trying to have SGE run job array tasks concurrently based on the job shares parameter of qsub but it seems not to be working as expected. Is there a way to enable concurrent task execution based on shares?
I have a script which sleeps to simulate long running tasks and I submit it to a small SGE cluster (26 slots) as different job arrays as follows:
qsub -t 1-201 -js 100 sge_longRunning.sh
qsub -t 1-202 -js 101 sge_longRunning.sh
qsub -t 1-203 -js 102 sge_longRunning.sh
I would expect the tasks to be almost equally distributed on the cluster over time but what I get is that the last submitted array gets fully executed (all 203 tasks), then the second one gets completely executed, finally the first one.
The cluster operates under a functional policy with 1M tickets and 0.9 weight for functional policy tickets.
Any hints how to get the tasks for the different job arrays to run concurrently sharing almost equally the available resources? Any hint what might be wrong with the above configuration/test setting?
gridengine concurrency
add a comment |
I'm trying to have SGE run job array tasks concurrently based on the job shares parameter of qsub but it seems not to be working as expected. Is there a way to enable concurrent task execution based on shares?
I have a script which sleeps to simulate long running tasks and I submit it to a small SGE cluster (26 slots) as different job arrays as follows:
qsub -t 1-201 -js 100 sge_longRunning.sh
qsub -t 1-202 -js 101 sge_longRunning.sh
qsub -t 1-203 -js 102 sge_longRunning.sh
I would expect the tasks to be almost equally distributed on the cluster over time but what I get is that the last submitted array gets fully executed (all 203 tasks), then the second one gets completely executed, finally the first one.
The cluster operates under a functional policy with 1M tickets and 0.9 weight for functional policy tickets.
Any hints how to get the tasks for the different job arrays to run concurrently sharing almost equally the available resources? Any hint what might be wrong with the above configuration/test setting?
gridengine concurrency
add a comment |
I'm trying to have SGE run job array tasks concurrently based on the job shares parameter of qsub but it seems not to be working as expected. Is there a way to enable concurrent task execution based on shares?
I have a script which sleeps to simulate long running tasks and I submit it to a small SGE cluster (26 slots) as different job arrays as follows:
qsub -t 1-201 -js 100 sge_longRunning.sh
qsub -t 1-202 -js 101 sge_longRunning.sh
qsub -t 1-203 -js 102 sge_longRunning.sh
I would expect the tasks to be almost equally distributed on the cluster over time but what I get is that the last submitted array gets fully executed (all 203 tasks), then the second one gets completely executed, finally the first one.
The cluster operates under a functional policy with 1M tickets and 0.9 weight for functional policy tickets.
Any hints how to get the tasks for the different job arrays to run concurrently sharing almost equally the available resources? Any hint what might be wrong with the above configuration/test setting?
gridengine concurrency
I'm trying to have SGE run job array tasks concurrently based on the job shares parameter of qsub but it seems not to be working as expected. Is there a way to enable concurrent task execution based on shares?
I have a script which sleeps to simulate long running tasks and I submit it to a small SGE cluster (26 slots) as different job arrays as follows:
qsub -t 1-201 -js 100 sge_longRunning.sh
qsub -t 1-202 -js 101 sge_longRunning.sh
qsub -t 1-203 -js 102 sge_longRunning.sh
I would expect the tasks to be almost equally distributed on the cluster over time but what I get is that the last submitted array gets fully executed (all 203 tasks), then the second one gets completely executed, finally the first one.
The cluster operates under a functional policy with 1M tickets and 0.9 weight for functional policy tickets.
Any hints how to get the tasks for the different job arrays to run concurrently sharing almost equally the available resources? Any hint what might be wrong with the above configuration/test setting?
gridengine concurrency
gridengine concurrency
asked Apr 29 at 15:42
a1ana1an
2372514
2372514
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "2"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f965123%2fhow-to-allow-concurrent-execution-of-job-arrays-with-job-share-js%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Server Fault!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f965123%2fhow-to-allow-concurrent-execution-of-job-arrays-with-job-share-js%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown