Use S3 bucket as a mounted drive or EBS volume on EC2?Which is faster for read access on EC2; local drive or EBS?Create EBS volume before EC2 instance w/o getting InsufficientInstanceCapacity?Amazon EC2 terminology - AMI vs. EBS vs. Snapshot vs. VolumeEC2 drive not EBS volume sizeDisk Writes to Mounted EBS Volume Not Logged in MonitorSelecting an EBS Volume as Root for EC2 instanceEC2 Disk space not utilized fullyScale Up Hadoop disk on aws infrastructureshrinking EBS volume that used as rootEBS volume unmounted after EC2 instance type change
What is the "ls" directory in my home directory?
Drawing a second weapon as part of an attack?
Should the party get XP for a monster they never attacked?
Why isn't it a compile-time error to return a nullptr as a std::string?
Too early in the morning to have SODA?
Is there a name for the trope when there is a moments dialogue when someone pauses just before they leave the room?
How much steel armor can you wear and still be able to swim?
Am I legally required to provide a (GPL licensed) source code even after a project is abandoned?
Umlaut character order when sorting
Dates on degrees don’t make sense – will people care?
Covering index used despite missing column
What constitutes a syllable?
Cut the gold chain
What mathematical theory is required for high frequency trading?
Designing a magic-compatible polearm
In Mistborn, why can metal in people's bodies be affected by Allomancy sometimes?
How can I prevent a user from copying files on another hard drive?
Draw a symmetric alien head
Explicit song lyrics checker
How to properly understand branches of complex functions
Extending prime numbers digit by digit while retaining primality
How to work with PETG? Settings, caveats, etc
Second 100 amp breaker inside existing 200 amp residential panel for new detached garage
Why don't we have a weaning party like Avraham did?
Use S3 bucket as a mounted drive or EBS volume on EC2?
Which is faster for read access on EC2; local drive or EBS?Create EBS volume before EC2 instance w/o getting InsufficientInstanceCapacity?Amazon EC2 terminology - AMI vs. EBS vs. Snapshot vs. VolumeEC2 drive not EBS volume sizeDisk Writes to Mounted EBS Volume Not Logged in MonitorSelecting an EBS Volume as Root for EC2 instanceEC2 Disk space not utilized fullyScale Up Hadoop disk on aws infrastructureshrinking EBS volume that used as rootEBS volume unmounted after EC2 instance type change
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I have an application that writes the logs on the server, it is a windows server. By increasing the logs the disk drive used space, increases and we have to scale up the volume from time to time. Scaling up the Disk Drive (EBS volume) doesn't seem very efficient way.
I'm wondering if we mount a S3 bucket as a mounted drive on EC2 for saving the logs there, is the best way or if there is any better way for that?
windows amazon-web-services amazon-s3 amazon-ebs
asked Jun 3 at 12:56
MatrixMatrix
12919
|
show 3 more comments
I have an application that writes the logs on the server, it is a windows server. By increasing the logs the disk drive used space, increases and we have to scale up the volume from time to time. Scaling up the Disk Drive (EBS volume) doesn't seem very efficient way.
I'm wondering if we mount a S3 bucket as a mounted drive on EC2 for saving the logs there, is the best way or if there is any better way for that?
windows amazon-web-services amazon-s3 amazon-ebs
asked Jun 3 at 12:56
MatrixMatrix
12919
2
Why not rotate the logs off to S3 periodically?
– ceejayoz
Jun 3 at 12:58
@ceejayoz The application doesn't support it unfortunately.
– Matrix
Jun 3 at 13:31
The application doesn't have to. Log rotation is, in fact, usually handled by another dedicated process.
– ceejayoz
Jun 3 at 14:30
What will you be doing with the logs? Analytics, forward to a log search engine. Archival, rotate to cheap (object) storage.
– John Mahowald
Jun 3 at 16:12
There are applications around that let you mount an S3 bucket as a file system. I don't know how reliable they are.
– Tim
Jun 3 at 20:10
|
show 3 more comments
I have an application that writes the logs on the server, it is a windows server. By increasing the logs the disk drive used space, increases and we have to scale up the volume from time to time. Scaling up the Disk Drive (EBS volume) doesn't seem very efficient way.
I'm wondering if we mount a S3 bucket as a mounted drive on EC2 for saving the logs there, is the best way or if there is any better way for that?
windows amazon-web-services amazon-s3 amazon-ebs
asked Jun 3 at 12:56
MatrixMatrix
12919
I have an application that writes the logs on the server, it is a windows server. By increasing the logs the disk drive used space, increases and we have to scale up the volume from time to time. Scaling up the Disk Drive (EBS volume) doesn't seem very efficient way.
I'm wondering if we mount a S3 bucket as a mounted drive on EC2 for saving the logs there, is the best way or if there is any better way for that?
windows amazon-web-services amazon-s3 amazon-ebs
windows amazon-web-services amazon-s3 amazon-ebs
asked Jun 3 at 12:56
MatrixMatrix
12919
asked Jun 3 at 12:56
MatrixMatrix
12919
asked Jun 3 at 12:56
MatrixMatrix
12919
asked Jun 3 at 12:56
MatrixMatrix
12919
asked Jun 3 at 12:56
MatrixMatrix
12919
12919
2
Why not rotate the logs off to S3 periodically?
– ceejayoz
Jun 3 at 12:58
@ceejayoz The application doesn't support it unfortunately.
– Matrix
Jun 3 at 13:31
The application doesn't have to. Log rotation is, in fact, usually handled by another dedicated process.
– ceejayoz
Jun 3 at 14:30
What will you be doing with the logs? Analytics, forward to a log search engine. Archival, rotate to cheap (object) storage.
– John Mahowald
Jun 3 at 16:12
There are applications around that let you mount an S3 bucket as a file system. I don't know how reliable they are.
– Tim
Jun 3 at 20:10
|
show 3 more comments
2
Why not rotate the logs off to S3 periodically?
– ceejayoz
Jun 3 at 12:58
@ceejayoz The application doesn't support it unfortunately.
– Matrix
Jun 3 at 13:31
The application doesn't have to. Log rotation is, in fact, usually handled by another dedicated process.
– ceejayoz
Jun 3 at 14:30
What will you be doing with the logs? Analytics, forward to a log search engine. Archival, rotate to cheap (object) storage.
– John Mahowald
Jun 3 at 16:12
There are applications around that let you mount an S3 bucket as a file system. I don't know how reliable they are.
– Tim
Jun 3 at 20:10
2
2
Why not rotate the logs off to S3 periodically?
– ceejayoz
Jun 3 at 12:58
Why not rotate the logs off to S3 periodically?
– ceejayoz
Jun 3 at 12:58
@ceejayoz The application doesn't support it unfortunately.
– Matrix
Jun 3 at 13:31
@ceejayoz The application doesn't support it unfortunately.
– Matrix
Jun 3 at 13:31
The application doesn't have to. Log rotation is, in fact, usually handled by another dedicated process.
– ceejayoz
Jun 3 at 14:30
The application doesn't have to. Log rotation is, in fact, usually handled by another dedicated process.
– ceejayoz
Jun 3 at 14:30
What will you be doing with the logs? Analytics, forward to a log search engine. Archival, rotate to cheap (object) storage.
– John Mahowald
Jun 3 at 16:12
What will you be doing with the logs? Analytics, forward to a log search engine. Archival, rotate to cheap (object) storage.
– John Mahowald
Jun 3 at 16:12
There are applications around that let you mount an S3 bucket as a file system. I don't know how reliable they are.
– Tim
Jun 3 at 20:10
There are applications around that let you mount an S3 bucket as a file system. I don't know how reliable they are.
– Tim
Jun 3 at 20:10
|
show 3 more comments
1 Answer
1
active
oldest
votes
Have the application write logs to CloudWatch and/or an S3 Bucket periodically and then wipe older logs on your instance so that you don't have to increase EBS size. S3 cant be attached as a volume like you say, but it can be used as a delivery point for your logs externally.
answered Jun 3 at 13:02
DTDDTD
316
No unfortunately the application (Arcgis Service) doesn't support either CloudWatch log or S3 bucket. So it can't write logs directly to them. So the only way can be with a script that collect the logs from the drive and upload it to a s3 bucket every day?
– Matrix
Jun 3 at 13:29
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "2"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f969933%2fuse-s3-bucket-as-a-mounted-drive-or-ebs-volume-on-ec2%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Have the application write logs to CloudWatch and/or an S3 Bucket periodically and then wipe older logs on your instance so that you don't have to increase EBS size. S3 cant be attached as a volume like you say, but it can be used as a delivery point for your logs externally.
answered Jun 3 at 13:02
DTDDTD
316
No unfortunately the application (Arcgis Service) doesn't support either CloudWatch log or S3 bucket. So it can't write logs directly to them. So the only way can be with a script that collect the logs from the drive and upload it to a s3 bucket every day?
– Matrix
Jun 3 at 13:29
add a comment |
Have the application write logs to CloudWatch and/or an S3 Bucket periodically and then wipe older logs on your instance so that you don't have to increase EBS size. S3 cant be attached as a volume like you say, but it can be used as a delivery point for your logs externally.
answered Jun 3 at 13:02
DTDDTD
316
No unfortunately the application (Arcgis Service) doesn't support either CloudWatch log or S3 bucket. So it can't write logs directly to them. So the only way can be with a script that collect the logs from the drive and upload it to a s3 bucket every day?
– Matrix
Jun 3 at 13:29
add a comment |
Have the application write logs to CloudWatch and/or an S3 Bucket periodically and then wipe older logs on your instance so that you don't have to increase EBS size. S3 cant be attached as a volume like you say, but it can be used as a delivery point for your logs externally.
answered Jun 3 at 13:02
DTDDTD
316
Have the application write logs to CloudWatch and/or an S3 Bucket periodically and then wipe older logs on your instance so that you don't have to increase EBS size. S3 cant be attached as a volume like you say, but it can be used as a delivery point for your logs externally.
answered Jun 3 at 13:02
DTDDTD
316
answered Jun 3 at 13:02
DTDDTD
316
answered Jun 3 at 13:02
DTDDTD
316
answered Jun 3 at 13:02
DTDDTD
316
316
No unfortunately the application (Arcgis Service) doesn't support either CloudWatch log or S3 bucket. So it can't write logs directly to them. So the only way can be with a script that collect the logs from the drive and upload it to a s3 bucket every day?
– Matrix
Jun 3 at 13:29
add a comment |
No unfortunately the application (Arcgis Service) doesn't support either CloudWatch log or S3 bucket. So it can't write logs directly to them. So the only way can be with a script that collect the logs from the drive and upload it to a s3 bucket every day?
– Matrix
Jun 3 at 13:29
No unfortunately the application (Arcgis Service) doesn't support either CloudWatch log or S3 bucket. So it can't write logs directly to them. So the only way can be with a script that collect the logs from the drive and upload it to a s3 bucket every day?
– Matrix
Jun 3 at 13:29
No unfortunately the application (Arcgis Service) doesn't support either CloudWatch log or S3 bucket. So it can't write logs directly to them. So the only way can be with a script that collect the logs from the drive and upload it to a s3 bucket every day?
– Matrix
Jun 3 at 13:29
add a comment |
Thanks for contributing an answer to Server Fault!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f969933%2fuse-s3-bucket-as-a-mounted-drive-or-ebs-volume-on-ec2%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
2
Why not rotate the logs off to S3 periodically?
– ceejayoz
Jun 3 at 12:58
@ceejayoz The application doesn't support it unfortunately.
– Matrix
Jun 3 at 13:31
The application doesn't have to. Log rotation is, in fact, usually handled by another dedicated process.
– ceejayoz
Jun 3 at 14:30
What will you be doing with the logs? Analytics, forward to a log search engine. Archival, rotate to cheap (object) storage.
– John Mahowald
Jun 3 at 16:12
There are applications around that let you mount an S3 bucket as a file system. I don't know how reliable they are.
– Tim
Jun 3 at 20:10