How change large dataset between access tiers in Azure Blob StorageSetting default version on Azure Blob Storage?Windows Azure Blob Storage Data MigrationAzure - Transfer Blob Storage account to new subscriptionMove Large Azure Storage Container To Another AccountKeeping a delta sync between Azure Storage blob containersHow to add versioning support to Azure File StorageAzure - Connecting to Blob storage from app service through vnetAccess with Azure Automation in Blob StorageAzure Storage / Table - Read LockRepoint website in Azure App Service to Azure static site storage container blob with no downtime
Multi tool use
Teaching a class likely meant to inflate the GPA of student athletes
Increase speed altering column on large table to NON NULL
Has there been a multiethnic Star Trek character?
Which languages would be most useful in Europe at the end of the 19th century?
Reactive Programming
Is using 'echo' to display attacker-controlled data on the terminal dangerous?
Is there a set of positive integers of density 1 which contains no infinite arithmetic progression?
Will Roalesk, Apex Hybrid, trigger Sharktocrab twice?
What aircraft was used as Air Force One for the flight between Southampton and Shannon?
What would be the way to say "just saying" in German? (Not the literal translation)
Why did Intel abandon unified CPU cache?
Why am I getting a strange double quote (“) in Open Office instead of the ordinary one (")?
Is it possible to have 2 different but equal size real number sets that have the same mean and standard deviation?
How can I use String in enum for Apex?
Are polynomials with the same roots identical?
How to hide rifle during medieval town entrance inspection?
Is it expected that a reader will skip parts of what you write?
What is the color of artificial intelligence?
I've been given a project I can't complete, what should I do?
USGS Relief map (GeoTIFF raster) misaligns with vector layers (QGIS)
What are some really overused phrases in French that are common nowadays?
Return a String containing only alphabets without spaces
The Frozen Wastes
Should I refuse being named as co-author of a bad quality paper?
How change large dataset between access tiers in Azure Blob Storage
Setting default version on Azure Blob Storage?Windows Azure Blob Storage Data MigrationAzure - Transfer Blob Storage account to new subscriptionMove Large Azure Storage Container To Another AccountKeeping a delta sync between Azure Storage blob containersHow to add versioning support to Azure File StorageAzure - Connecting to Blob storage from app service through vnetAccess with Azure Automation in Blob StorageAzure Storage / Table - Read LockRepoint website in Azure App Service to Azure static site storage container blob with no downtime
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I have an ML dataset that consists of 2.7M images, ~1TB. For ML experiments, I uploaded these as blobs in an Azure storage account under "hot" access (which I thought would be appropriate for ML training). While not actively training, I would like this dataset to be in "Archive" mode to avoid accumulating "leaky faucet" charges.
The document on blob storage access tiers describes how it can be toggled on a per-blob basis, but AFAICT that is per-file (not even per-directory, which would be fine).
Is there a way to toggle the access tier of an entire storage account?
Absent that, what might be a good strategy? Perhaps creating a default-archive-access data_archive storage account and do a cloud-based copy to a temporary data_for_training_purposes hot-access storage account that I create and delete as needed?
azure azure-storage
asked May 24 at 18:41
Larry OBrienLarry OBrien
1062
add a comment |
I have an ML dataset that consists of 2.7M images, ~1TB. For ML experiments, I uploaded these as blobs in an Azure storage account under "hot" access (which I thought would be appropriate for ML training). While not actively training, I would like this dataset to be in "Archive" mode to avoid accumulating "leaky faucet" charges.
The document on blob storage access tiers describes how it can be toggled on a per-blob basis, but AFAICT that is per-file (not even per-directory, which would be fine).
Is there a way to toggle the access tier of an entire storage account?
Absent that, what might be a good strategy? Perhaps creating a default-archive-access data_archive storage account and do a cloud-based copy to a temporary data_for_training_purposes hot-access storage account that I create and delete as needed?
azure azure-storage
asked May 24 at 18:41
Larry OBrienLarry OBrien
1062
add a comment |
I have an ML dataset that consists of 2.7M images, ~1TB. For ML experiments, I uploaded these as blobs in an Azure storage account under "hot" access (which I thought would be appropriate for ML training). While not actively training, I would like this dataset to be in "Archive" mode to avoid accumulating "leaky faucet" charges.
The document on blob storage access tiers describes how it can be toggled on a per-blob basis, but AFAICT that is per-file (not even per-directory, which would be fine).
Is there a way to toggle the access tier of an entire storage account?
Absent that, what might be a good strategy? Perhaps creating a default-archive-access data_archive storage account and do a cloud-based copy to a temporary data_for_training_purposes hot-access storage account that I create and delete as needed?
azure azure-storage
asked May 24 at 18:41
Larry OBrienLarry OBrien
1062
I have an ML dataset that consists of 2.7M images, ~1TB. For ML experiments, I uploaded these as blobs in an Azure storage account under "hot" access (which I thought would be appropriate for ML training). While not actively training, I would like this dataset to be in "Archive" mode to avoid accumulating "leaky faucet" charges.
The document on blob storage access tiers describes how it can be toggled on a per-blob basis, but AFAICT that is per-file (not even per-directory, which would be fine).
Is there a way to toggle the access tier of an entire storage account?
Absent that, what might be a good strategy? Perhaps creating a default-archive-access data_archive storage account and do a cloud-based copy to a temporary data_for_training_purposes hot-access storage account that I create and delete as needed?
azure azure-storage
azure azure-storage
asked May 24 at 18:41
Larry OBrienLarry OBrien
1062
asked May 24 at 18:41
Larry OBrienLarry OBrien
1062
asked May 24 at 18:41
Larry OBrienLarry OBrien
1062
asked May 24 at 18:41
Larry OBrienLarry OBrien
1062
asked May 24 at 18:41
Larry OBrienLarry OBrien
1062
1062
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "2"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f968761%2fhow-change-large-dataset-between-access-tiers-in-azure-blob-storage%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Server Fault!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f968761%2fhow-change-large-dataset-between-access-tiers-in-azure-blob-storage%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
xHBA5,Vifa452qh1ugUcmMhvU1Jazu3NP0zmct1GeR8P87O oRTd7Z,jg Usnkh,X4zL MsL,HAUnVj,4FvSl fmPdhJtN
