Dynamic Scale R Script without access Server GUIwhere do i put the cloud-config.txt fileDoes AWS EC2 have secondary disks scattered across the cluster?How to create shared Google Compute Engine images?internal error while trying to move an instance across zonesExecute script with different argument on AWS instancesGCE Ubuntu Multi-Interface Instance Route Configurationpartition and format local ssd in start scriptHow do you securely retrieve the ssh host keys from a google compute engine instance?Private s3 access from ec2 user-data scriptShut down a notebook instance
Should I include salary information on my CV?
Why does the numerical solution of an ODE move away from an unstable equilibrium?
Do 3D printers really reach 50 micron (0.050mm) accuracy?
What does 2>&1 | tee mean?
Cross over of arrows in a complex diagram
Why is Madam Hooch not a professor?
Does the UK have a written constitution?
Conduit Fill and Derating for THHN Cables (outdoor run)
Why is a blank required between "[[" and "-e xxx" in ksh?
Procedurally generate regions on island
Which centaur is more 'official'?
Does anycast addressing add additional latency in any way?
How fast can a ship with rotating habitats be accelerated?
Children's short story about material that accelerates away from gravity
Should I report a leak of confidential HR information?
Can I use the PWM pins as regular digital input/output pins?
where clause to retrieve case record which are older than 12 months and 1 day in soql
Spicket or spigot?
How would a order of Monks that renounce their names communicate effectively?
Do we or do we not observe (measure) superpositions all the time?
Transitive action of a discrete group on a compact space
Fluently Validation of Objects
Bash echo $-1 prints hb1. Why?
ArcGIS Intersect Tool not splitting lines as expected?
Dynamic Scale R Script without access Server GUI
where do i put the cloud-config.txt fileDoes AWS EC2 have secondary disks scattered across the cluster?How to create shared Google Compute Engine images?internal error while trying to move an instance across zonesExecute script with different argument on AWS instancesGCE Ubuntu Multi-Interface Instance Route Configurationpartition and format local ssd in start scriptHow do you securely retrieve the ssh host keys from a google compute engine instance?Private s3 access from ec2 user-data scriptShut down a notebook instance
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;
I have a question regarding R on Cloud Services like AWS or GCE.
My plan is: Running a Shiny Server endless with having the option to upload a file. After klicking "run" the script should start a cluster of instances with the code running in parallel. The file should be processed there. Maybe the file has to be stored on an aws.s3 or gce store. After parallel processing every instance should save its results to a store or insert it into a data frame in RAM of the shiny instance and turn itself off.
All code I have seen now is to start an RStudio instance manually on some cloud engines that run manually that script. I want that cluster instance starting from an R package (if existing) and starting that script parallel on it via an R package. That triggering has to come from the shiny server code.
Do I have to program this by myself, or are there packages for it? I googled the segue package for aws, but it seems it got deprecated.
Greetings,
Timo
amazon-ec2
google-compute-engine amazon-emr asked Jun 10 at 6:36
Timo aus HannoverTimo aus Hannover
11 bronze badge
add a comment |
I have a question regarding R on Cloud Services like AWS or GCE.
My plan is: Running a Shiny Server endless with having the option to upload a file. After klicking "run" the script should start a cluster of instances with the code running in parallel. The file should be processed there. Maybe the file has to be stored on an aws.s3 or gce store. After parallel processing every instance should save its results to a store or insert it into a data frame in RAM of the shiny instance and turn itself off.
All code I have seen now is to start an RStudio instance manually on some cloud engines that run manually that script. I want that cluster instance starting from an R package (if existing) and starting that script parallel on it via an R package. That triggering has to come from the shiny server code.
Do I have to program this by myself, or are there packages for it? I googled the segue package for aws, but it seems it got deprecated.
Greetings,
Timo
amazon-ec2
google-compute-engine amazon-emr asked Jun 10 at 6:36
Timo aus HannoverTimo aus Hannover
11 bronze badge
add a comment |
I have a question regarding R on Cloud Services like AWS or GCE.
My plan is: Running a Shiny Server endless with having the option to upload a file. After klicking "run" the script should start a cluster of instances with the code running in parallel. The file should be processed there. Maybe the file has to be stored on an aws.s3 or gce store. After parallel processing every instance should save its results to a store or insert it into a data frame in RAM of the shiny instance and turn itself off.
All code I have seen now is to start an RStudio instance manually on some cloud engines that run manually that script. I want that cluster instance starting from an R package (if existing) and starting that script parallel on it via an R package. That triggering has to come from the shiny server code.
Do I have to program this by myself, or are there packages for it? I googled the segue package for aws, but it seems it got deprecated.
Greetings,
Timo
amazon-ec2
google-compute-engine amazon-emr asked Jun 10 at 6:36
Timo aus HannoverTimo aus Hannover
11 bronze badge
I have a question regarding R on Cloud Services like AWS or GCE.
My plan is: Running a Shiny Server endless with having the option to upload a file. After klicking "run" the script should start a cluster of instances with the code running in parallel. The file should be processed there. Maybe the file has to be stored on an aws.s3 or gce store. After parallel processing every instance should save its results to a store or insert it into a data frame in RAM of the shiny instance and turn itself off.
All code I have seen now is to start an RStudio instance manually on some cloud engines that run manually that script. I want that cluster instance starting from an R package (if existing) and starting that script parallel on it via an R package. That triggering has to come from the shiny server code.
Do I have to program this by myself, or are there packages for it? I googled the segue package for aws, but it seems it got deprecated.
Greetings,
Timo
amazon-ec2
google-compute-engine amazon-emr amazon-ec2
google-compute-engine amazon-emr asked Jun 10 at 6:36
Timo aus HannoverTimo aus Hannover
11 bronze badge
asked Jun 10 at 6:36
Timo aus HannoverTimo aus Hannover
11 bronze badge
asked Jun 10 at 6:36
Timo aus HannoverTimo aus Hannover
11 bronze badge
asked Jun 10 at 6:36
Timo aus HannoverTimo aus Hannover
11 bronze badge
asked Jun 10 at 6:36
Timo aus HannoverTimo aus Hannover
11 bronze badge
11 bronze badge
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "2"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f970775%2fdynamic-scale-r-script-without-access-server-gui%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Server Fault!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f970775%2fdynamic-scale-r-script-without-access-server-gui%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
