How do I process files on GCP through SFTP and Stateful Setssynchronize files between remote sftp location and localUploading files on server through SFTPHow does sftp replace files?OpenSSH: Difference between internal-sftp and sftp-serverHigh availability IIS web application, via google cloud storage bucket mounted to windows instanceDoes hosted Kubernetes on GCP suppport pet sets?GCP LB with static website and kubernetesGoogle Cloud Bucket connection from Kubernetes deployment using Storage APIGCP: Can not ssh to instance after sftp setting (ForceCommand internal-sftp)Best method to do SFTP of GCP Cloud Storage files to Salesforce
Program for finding longest run of zeros from a list of 100 random integers which are either 0 or 1
Why is the episode called "The Last of the Starks"?
What will Doctor Strange protect now?
Do these creatures from the Tomb of Annihilation campaign speak Common?
I want to write a blog post building upon someone else's paper, how can I properly cite/credit them?
Was Mohammed the most popular first name for boys born in Berlin in 2018?
Linear Independence for Vectors of Cosine Values
How to avoid making self and former employee look bad when reporting on fixing former employee's work?
Is the tensor product (of vector spaces) commutative?
How is it believable that Euron could so easily pull off this ambush?
logo selection for poster presentation
Trying to understand a summation
Is it possible to do moon sighting in advance for 5 years with 100% accuracy?
Is this strange Morse signal type common?
Examples where existence is harder than evaluation
Did any early RISC OS precursor run on the BBC Micro?
What's an appropriate age to involve kids in life changing decisions?
Is it safe to keep the GPU on 100% utilization for a very long time?
How long can fsck take on a 30 TB volume?
Mindfulness of Watching Youtube
How could a civilization detect tachyons?
Two (probably) equal real numbers which are not proved to be equal?
While drilling into kitchen wall, hit a wire - any advice?
What dice to use in a game that revolves around triangles?
How do I process files on GCP through SFTP and Stateful Sets
synchronize files between remote sftp location and localUploading files on server through SFTPHow does sftp replace files?OpenSSH: Difference between internal-sftp and sftp-serverHigh availability IIS web application, via google cloud storage bucket mounted to windows instanceDoes hosted Kubernetes on GCP suppport pet sets?GCP LB with static website and kubernetesGoogle Cloud Bucket connection from Kubernetes deployment using Storage APIGCP: Can not ssh to instance after sftp setting (ForceCommand internal-sftp)Best method to do SFTP of GCP Cloud Storage files to Salesforce
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I'm looking for a little direction here and am having some troubles. I have an application that needs to process some simple csv files and I'm struggling to connect the appropriate technologies.
I have an application deployable as a container. I believe that I should deploy it as a stateful set as it requires access to a persistent file system.
I believe I need a Persistent Volume Claim on which to mount my stateful set
Where I run into a little confusion is how the files get into that volume. I need a SFTP server so that 3rd parties can drop files into a location for the application to pick up and process.
I'm not quite sure the best method of connecting this together. Can I have a Compute VM also mount the same location as the Persistent Volume Claim?
It seems like a straightforward task, but the proper design here eludes me. Help is appreciated.
Running Google GCP/Kubernetes
storage
google-cloud-platform sftp kubernetes asked Apr 29 at 14:20
G. BallG. Ball
111
add a comment |
I'm looking for a little direction here and am having some troubles. I have an application that needs to process some simple csv files and I'm struggling to connect the appropriate technologies.
I have an application deployable as a container. I believe that I should deploy it as a stateful set as it requires access to a persistent file system.
I believe I need a Persistent Volume Claim on which to mount my stateful set
Where I run into a little confusion is how the files get into that volume. I need a SFTP server so that 3rd parties can drop files into a location for the application to pick up and process.
I'm not quite sure the best method of connecting this together. Can I have a Compute VM also mount the same location as the Persistent Volume Claim?
It seems like a straightforward task, but the proper design here eludes me. Help is appreciated.
Running Google GCP/Kubernetes
storage
google-cloud-platform sftp kubernetes asked Apr 29 at 14:20
G. BallG. Ball
111
add a comment |
I'm looking for a little direction here and am having some troubles. I have an application that needs to process some simple csv files and I'm struggling to connect the appropriate technologies.
I have an application deployable as a container. I believe that I should deploy it as a stateful set as it requires access to a persistent file system.
I believe I need a Persistent Volume Claim on which to mount my stateful set
Where I run into a little confusion is how the files get into that volume. I need a SFTP server so that 3rd parties can drop files into a location for the application to pick up and process.
I'm not quite sure the best method of connecting this together. Can I have a Compute VM also mount the same location as the Persistent Volume Claim?
It seems like a straightforward task, but the proper design here eludes me. Help is appreciated.
Running Google GCP/Kubernetes
storage
google-cloud-platform sftp kubernetes asked Apr 29 at 14:20
G. BallG. Ball
111
I'm looking for a little direction here and am having some troubles. I have an application that needs to process some simple csv files and I'm struggling to connect the appropriate technologies.
I have an application deployable as a container. I believe that I should deploy it as a stateful set as it requires access to a persistent file system.
I believe I need a Persistent Volume Claim on which to mount my stateful set
Where I run into a little confusion is how the files get into that volume. I need a SFTP server so that 3rd parties can drop files into a location for the application to pick up and process.
I'm not quite sure the best method of connecting this together. Can I have a Compute VM also mount the same location as the Persistent Volume Claim?
It seems like a straightforward task, but the proper design here eludes me. Help is appreciated.
Running Google GCP/Kubernetes
storage
google-cloud-platform sftp kubernetes storage
google-cloud-platform sftp kubernetes asked Apr 29 at 14:20
G. BallG. Ball
111
asked Apr 29 at 14:20
G. BallG. Ball
111
asked Apr 29 at 14:20
G. BallG. Ball
111
asked Apr 29 at 14:20
G. BallG. Ball
111
asked Apr 29 at 14:20
G. BallG. Ball
111
111
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
You probably want a Deployment which is simpler than StatefulSet and can also use persistent volumes. Read the docs carefully, as the 'StatefulSet' is a bit of a misnomer.
You want a sshd server container (which accepts sftp clients' connections) to have access to the same volume as the application container, put both containers in the same Pod and mount the same single volume in both containers.
answered Apr 29 at 22:07
kubanczykkubanczyk
10.7k32946
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "2"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f965111%2fhow-do-i-process-files-on-gcp-through-sftp-and-stateful-sets%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
You probably want a Deployment which is simpler than StatefulSet and can also use persistent volumes. Read the docs carefully, as the 'StatefulSet' is a bit of a misnomer.
You want a sshd server container (which accepts sftp clients' connections) to have access to the same volume as the application container, put both containers in the same Pod and mount the same single volume in both containers.
answered Apr 29 at 22:07
kubanczykkubanczyk
10.7k32946
add a comment |
You probably want a Deployment which is simpler than StatefulSet and can also use persistent volumes. Read the docs carefully, as the 'StatefulSet' is a bit of a misnomer.
You want a sshd server container (which accepts sftp clients' connections) to have access to the same volume as the application container, put both containers in the same Pod and mount the same single volume in both containers.
answered Apr 29 at 22:07
kubanczykkubanczyk
10.7k32946
add a comment |
You probably want a Deployment which is simpler than StatefulSet and can also use persistent volumes. Read the docs carefully, as the 'StatefulSet' is a bit of a misnomer.
You want a sshd server container (which accepts sftp clients' connections) to have access to the same volume as the application container, put both containers in the same Pod and mount the same single volume in both containers.
answered Apr 29 at 22:07
kubanczykkubanczyk
10.7k32946
You probably want a Deployment which is simpler than StatefulSet and can also use persistent volumes. Read the docs carefully, as the 'StatefulSet' is a bit of a misnomer.
You want a sshd server container (which accepts sftp clients' connections) to have access to the same volume as the application container, put both containers in the same Pod and mount the same single volume in both containers.
answered Apr 29 at 22:07
kubanczykkubanczyk
10.7k32946
answered Apr 29 at 22:07
kubanczykkubanczyk
10.7k32946
answered Apr 29 at 22:07
kubanczykkubanczyk
10.7k32946
answered Apr 29 at 22:07
kubanczykkubanczyk
10.7k32946
10.7k32946
add a comment |
add a comment |
Thanks for contributing an answer to Server Fault!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f965111%2fhow-do-i-process-files-on-gcp-through-sftp-and-stateful-sets%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
