How to allow concurrent execution of job arrays with job share (-js)How do i get concurrent asp.net on linux?How do concurrent filesystems work?How to lock concurrent access to a shared webservice from multiple webservers?Apache httpd response time increase with concurrent connectionsHow to allow more than two simultanous sessions on AzureHow to submit job from compute node to another compute node?How many concurrent TCP connections or sockets can be handled by a web server for e.g in a chat application

How is it believable that Euron could so easily pull off this ambush?

How do I politely tell my players to shut up about their backstory?

Where do 5 or more U.S. counties meet in a single point?

And now you see it II (the B side)

How could a civilization detect tachyons?

Is there an idiom that means "revealing a secret unintentionally"?

Magical Modulo Squares

Why are thrust reversers not used down to taxi speeds?

What dice to use in a game that revolves around triangles?

Can radiation block all wireless communications?

When was it publicly revealed that a KH-11 spy satellite took pictures of the first Shuttle flight?

Is it possible to do moon sighting in advance for 5 years with 100% accuracy?

Why is the episode called "The Last of the Starks"?

How to avoid making self and former employee look bad when reporting on fixing former employee's work?

How to start your Starctaft II games vs AI immediatly?

Can the president of the United States be guilty of insider trading?

Names of the Six Tastes

Exactly which act of bravery are Luke and Han awarded a medal for?

Is the tensor product (of vector spaces) commutative?

Trying to understand a summation

What's the difference between "ricochet" and "bounce"?

Company stopped paying my salary. What are my options?

My parents are Afghan

Opposite party turned away from voting when ballot is all opposing party



How to allow concurrent execution of job arrays with job share (-js)


How do i get concurrent asp.net on linux?How do concurrent filesystems work?How to lock concurrent access to a shared webservice from multiple webservers?Apache httpd response time increase with concurrent connectionsHow to allow more than two simultanous sessions on AzureHow to submit job from compute node to another compute node?How many concurrent TCP connections or sockets can be handled by a web server for e.g in a chat application






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;








0















I'm trying to have SGE run job array tasks concurrently based on the job shares parameter of qsub but it seems not to be working as expected. Is there a way to enable concurrent task execution based on shares?



I have a script which sleeps to simulate long running tasks and I submit it to a small SGE cluster (26 slots) as different job arrays as follows:



qsub -t 1-201 -js 100 sge_longRunning.sh
qsub -t 1-202 -js 101 sge_longRunning.sh
qsub -t 1-203 -js 102 sge_longRunning.sh


I would expect the tasks to be almost equally distributed on the cluster over time but what I get is that the last submitted array gets fully executed (all 203 tasks), then the second one gets completely executed, finally the first one.



The cluster operates under a functional policy with 1M tickets and 0.9 weight for functional policy tickets.



Any hints how to get the tasks for the different job arrays to run concurrently sharing almost equally the available resources? Any hint what might be wrong with the above configuration/test setting?










share|improve this question




























    0















    I'm trying to have SGE run job array tasks concurrently based on the job shares parameter of qsub but it seems not to be working as expected. Is there a way to enable concurrent task execution based on shares?



    I have a script which sleeps to simulate long running tasks and I submit it to a small SGE cluster (26 slots) as different job arrays as follows:



    qsub -t 1-201 -js 100 sge_longRunning.sh
    qsub -t 1-202 -js 101 sge_longRunning.sh
    qsub -t 1-203 -js 102 sge_longRunning.sh


    I would expect the tasks to be almost equally distributed on the cluster over time but what I get is that the last submitted array gets fully executed (all 203 tasks), then the second one gets completely executed, finally the first one.



    The cluster operates under a functional policy with 1M tickets and 0.9 weight for functional policy tickets.



    Any hints how to get the tasks for the different job arrays to run concurrently sharing almost equally the available resources? Any hint what might be wrong with the above configuration/test setting?










    share|improve this question
























      0












      0








      0








      I'm trying to have SGE run job array tasks concurrently based on the job shares parameter of qsub but it seems not to be working as expected. Is there a way to enable concurrent task execution based on shares?



      I have a script which sleeps to simulate long running tasks and I submit it to a small SGE cluster (26 slots) as different job arrays as follows:



      qsub -t 1-201 -js 100 sge_longRunning.sh
      qsub -t 1-202 -js 101 sge_longRunning.sh
      qsub -t 1-203 -js 102 sge_longRunning.sh


      I would expect the tasks to be almost equally distributed on the cluster over time but what I get is that the last submitted array gets fully executed (all 203 tasks), then the second one gets completely executed, finally the first one.



      The cluster operates under a functional policy with 1M tickets and 0.9 weight for functional policy tickets.



      Any hints how to get the tasks for the different job arrays to run concurrently sharing almost equally the available resources? Any hint what might be wrong with the above configuration/test setting?










      share|improve this question














      I'm trying to have SGE run job array tasks concurrently based on the job shares parameter of qsub but it seems not to be working as expected. Is there a way to enable concurrent task execution based on shares?



      I have a script which sleeps to simulate long running tasks and I submit it to a small SGE cluster (26 slots) as different job arrays as follows:



      qsub -t 1-201 -js 100 sge_longRunning.sh
      qsub -t 1-202 -js 101 sge_longRunning.sh
      qsub -t 1-203 -js 102 sge_longRunning.sh


      I would expect the tasks to be almost equally distributed on the cluster over time but what I get is that the last submitted array gets fully executed (all 203 tasks), then the second one gets completely executed, finally the first one.



      The cluster operates under a functional policy with 1M tickets and 0.9 weight for functional policy tickets.



      Any hints how to get the tasks for the different job arrays to run concurrently sharing almost equally the available resources? Any hint what might be wrong with the above configuration/test setting?







      gridengine concurrency






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Apr 29 at 15:42









      a1ana1an

      2372514




      2372514




















          0






          active

          oldest

          votes












          Your Answer








          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "2"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f965123%2fhow-to-allow-concurrent-execution-of-job-arrays-with-job-share-js%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Server Fault!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f965123%2fhow-to-allow-concurrent-execution-of-job-arrays-with-job-share-js%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          RemoteApp sporadic failureWindows 2008 RemoteAPP client disconnects within a matter of minutesWhat is the minimum version of RDP supported by Server 2012 RDS?How to configure a Remoteapp server to increase stabilityMicrosoft RemoteApp Active SessionRDWeb TS connection broken for some users post RemoteApp certificate changeRemote Desktop Licensing, RemoteAPPRDS 2012 R2 some users are not able to logon after changed date and time on Connection BrokersWhat happens during Remote Desktop logon, and is there any logging?After installing RDS on WinServer 2016 I still can only connect with two users?RD Connection via RDGW to Session host is not connecting

          How to write a 12-bar blues melodyI-IV-V blues progressionHow to play the bridges in a standard blues progressionHow does Gdim7 fit in C# minor?question on a certain chord progressionMusicology of Melody12 bar blues, spread rhythm: alternative to 6th chord to avoid finger stretchChord progressions/ Root key/ MelodiesHow to put chords (POP-EDM) under a given lead vocal melody (starting from a good knowledge in music theory)Are there “rules” for improvising with the minor pentatonic scale over 12-bar shuffle?Confusion about blues scale and chords

          Esgonzo ibérico Índice Descrición Distribución Hábitat Ameazas Notas Véxase tamén "Acerca dos nomes dos anfibios e réptiles galegos""Chalcides bedriagai"Chalcides bedriagai en Carrascal, L. M. Salvador, A. (Eds). Enciclopedia virtual de los vertebrados españoles. Museo Nacional de Ciencias Naturales, Madrid. España.Fotos