How to allow concurrent execution of job arrays with job share (-js)How do i get concurrent asp.net on linux?How do concurrent filesystems work?How to lock concurrent access to a shared webservice from multiple webservers?Apache httpd response time increase with concurrent connectionsHow to allow more than two simultanous sessions on AzureHow to submit job from compute node to another compute node?How many concurrent TCP connections or sockets can be handled by a web server for e.g in a chat application

How is it believable that Euron could so easily pull off this ambush?

How do I politely tell my players to shut up about their backstory?

Where do 5 or more U.S. counties meet in a single point?

And now you see it II (the B side)

How could a civilization detect tachyons?

Is there an idiom that means "revealing a secret unintentionally"?

Magical Modulo Squares

Why are thrust reversers not used down to taxi speeds?

What dice to use in a game that revolves around triangles?

Can radiation block all wireless communications?

When was it publicly revealed that a KH-11 spy satellite took pictures of the first Shuttle flight?

Is it possible to do moon sighting in advance for 5 years with 100% accuracy?

Why is the episode called "The Last of the Starks"?

How to avoid making self and former employee look bad when reporting on fixing former employee's work?

How to start your Starctaft II games vs AI immediatly?

Can the president of the United States be guilty of insider trading?

Names of the Six Tastes

Exactly which act of bravery are Luke and Han awarded a medal for?

Is the tensor product (of vector spaces) commutative?

Trying to understand a summation

What's the difference between "ricochet" and "bounce"?

Company stopped paying my salary. What are my options?

My parents are Afghan

Opposite party turned away from voting when ballot is all opposing party



How to allow concurrent execution of job arrays with job share (-js)


How do i get concurrent asp.net on linux?How do concurrent filesystems work?How to lock concurrent access to a shared webservice from multiple webservers?Apache httpd response time increase with concurrent connectionsHow to allow more than two simultanous sessions on AzureHow to submit job from compute node to another compute node?How many concurrent TCP connections or sockets can be handled by a web server for e.g in a chat application






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;








0















I'm trying to have SGE run job array tasks concurrently based on the job shares parameter of qsub but it seems not to be working as expected. Is there a way to enable concurrent task execution based on shares?



I have a script which sleeps to simulate long running tasks and I submit it to a small SGE cluster (26 slots) as different job arrays as follows:



qsub -t 1-201 -js 100 sge_longRunning.sh
qsub -t 1-202 -js 101 sge_longRunning.sh
qsub -t 1-203 -js 102 sge_longRunning.sh


I would expect the tasks to be almost equally distributed on the cluster over time but what I get is that the last submitted array gets fully executed (all 203 tasks), then the second one gets completely executed, finally the first one.



The cluster operates under a functional policy with 1M tickets and 0.9 weight for functional policy tickets.



Any hints how to get the tasks for the different job arrays to run concurrently sharing almost equally the available resources? Any hint what might be wrong with the above configuration/test setting?










share|improve this question




























    0















    I'm trying to have SGE run job array tasks concurrently based on the job shares parameter of qsub but it seems not to be working as expected. Is there a way to enable concurrent task execution based on shares?



    I have a script which sleeps to simulate long running tasks and I submit it to a small SGE cluster (26 slots) as different job arrays as follows:



    qsub -t 1-201 -js 100 sge_longRunning.sh
    qsub -t 1-202 -js 101 sge_longRunning.sh
    qsub -t 1-203 -js 102 sge_longRunning.sh


    I would expect the tasks to be almost equally distributed on the cluster over time but what I get is that the last submitted array gets fully executed (all 203 tasks), then the second one gets completely executed, finally the first one.



    The cluster operates under a functional policy with 1M tickets and 0.9 weight for functional policy tickets.



    Any hints how to get the tasks for the different job arrays to run concurrently sharing almost equally the available resources? Any hint what might be wrong with the above configuration/test setting?










    share|improve this question
























      0












      0








      0








      I'm trying to have SGE run job array tasks concurrently based on the job shares parameter of qsub but it seems not to be working as expected. Is there a way to enable concurrent task execution based on shares?



      I have a script which sleeps to simulate long running tasks and I submit it to a small SGE cluster (26 slots) as different job arrays as follows:



      qsub -t 1-201 -js 100 sge_longRunning.sh
      qsub -t 1-202 -js 101 sge_longRunning.sh
      qsub -t 1-203 -js 102 sge_longRunning.sh


      I would expect the tasks to be almost equally distributed on the cluster over time but what I get is that the last submitted array gets fully executed (all 203 tasks), then the second one gets completely executed, finally the first one.



      The cluster operates under a functional policy with 1M tickets and 0.9 weight for functional policy tickets.



      Any hints how to get the tasks for the different job arrays to run concurrently sharing almost equally the available resources? Any hint what might be wrong with the above configuration/test setting?










      share|improve this question














      I'm trying to have SGE run job array tasks concurrently based on the job shares parameter of qsub but it seems not to be working as expected. Is there a way to enable concurrent task execution based on shares?



      I have a script which sleeps to simulate long running tasks and I submit it to a small SGE cluster (26 slots) as different job arrays as follows:



      qsub -t 1-201 -js 100 sge_longRunning.sh
      qsub -t 1-202 -js 101 sge_longRunning.sh
      qsub -t 1-203 -js 102 sge_longRunning.sh


      I would expect the tasks to be almost equally distributed on the cluster over time but what I get is that the last submitted array gets fully executed (all 203 tasks), then the second one gets completely executed, finally the first one.



      The cluster operates under a functional policy with 1M tickets and 0.9 weight for functional policy tickets.



      Any hints how to get the tasks for the different job arrays to run concurrently sharing almost equally the available resources? Any hint what might be wrong with the above configuration/test setting?







      gridengine concurrency






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Apr 29 at 15:42









      a1ana1an

      2372514




      2372514




















          0






          active

          oldest

          votes












          Your Answer








          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "2"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f965123%2fhow-to-allow-concurrent-execution-of-job-arrays-with-job-share-js%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Server Fault!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f965123%2fhow-to-allow-concurrent-execution-of-job-arrays-with-job-share-js%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Wikipedia:Vital articles Мазмуну Biography - Өмүр баян Philosophy and psychology - Философия жана психология Religion - Дин Social sciences - Коомдук илимдер Language and literature - Тил жана адабият Science - Илим Technology - Технология Arts and recreation - Искусство жана эс алуу History and geography - Тарых жана география Навигация менюсу

          Bruxelas-Capital Índice Historia | Composición | Situación lingüística | Clima | Cidades irmandadas | Notas | Véxase tamén | Menú de navegacióneO uso das linguas en Bruxelas e a situación do neerlandés"Rexión de Bruxelas Capital"o orixinalSitio da rexiónPáxina de Bruselas no sitio da Oficina de Promoción Turística de Valonia e BruxelasMapa Interactivo da Rexión de Bruxelas-CapitaleeWorldCat332144929079854441105155190212ID28008674080552-90000 0001 0666 3698n94104302ID540940339365017018237

          What should I write in an apology letter, since I have decided not to join a company after accepting an offer letterShould I keep looking after accepting a job offer?What should I do when I've been verbally told I would get an offer letter, but still haven't gotten one after 4 weeks?Do I accept an offer from a company that I am not likely to join?New job hasn't confirmed starting date and I want to give current employer as much notice as possibleHow should I address my manager in my resignation letter?HR delayed background verification, now jobless as resignedNo email communication after accepting a formal written offer. How should I phrase the call?What should I do if after receiving a verbal offer letter I am informed that my written job offer is put on hold due to some internal issues?Should I inform the current employer that I am about to resign within 1-2 weeks since I have signed the offer letter and waiting for visa?What company will do, if I send their offer letter to another company