How change large dataset between access tiers in Azure Blob StorageSetting default version on Azure Blob Storage?Windows Azure Blob Storage Data MigrationAzure - Transfer Blob Storage account to new subscriptionMove Large Azure Storage Container To Another AccountKeeping a delta sync between Azure Storage blob containersHow to add versioning support to Azure File StorageAzure - Connecting to Blob storage from app service through vnetAccess with Azure Automation in Blob StorageAzure Storage / Table - Read LockRepoint website in Azure App Service to Azure static site storage container blob with no downtime

Teaching a class likely meant to inflate the GPA of student athletes

Increase speed altering column on large table to NON NULL

Has there been a multiethnic Star Trek character?

Which languages would be most useful in Europe at the end of the 19th century?

Reactive Programming

Is using 'echo' to display attacker-controlled data on the terminal dangerous?

Is there a set of positive integers of density 1 which contains no infinite arithmetic progression?

Will Roalesk, Apex Hybrid, trigger Sharktocrab twice?

What aircraft was used as Air Force One for the flight between Southampton and Shannon?

What would be the way to say "just saying" in German? (Not the literal translation)

Why did Intel abandon unified CPU cache?

Why am I getting a strange double quote (“) in Open Office instead of the ordinary one (")?

Is it possible to have 2 different but equal size real number sets that have the same mean and standard deviation?

How can I use String in enum for Apex?

Are polynomials with the same roots identical?

How to hide rifle during medieval town entrance inspection?

Is it expected that a reader will skip parts of what you write?

What is the color of artificial intelligence?

I've been given a project I can't complete, what should I do?

USGS Relief map (GeoTIFF raster) misaligns with vector layers (QGIS)

What are some really overused phrases in French that are common nowadays?

Return a String containing only alphabets without spaces

The Frozen Wastes

Should I refuse being named as co-author of a bad quality paper?



How change large dataset between access tiers in Azure Blob Storage


Setting default version on Azure Blob Storage?Windows Azure Blob Storage Data MigrationAzure - Transfer Blob Storage account to new subscriptionMove Large Azure Storage Container To Another AccountKeeping a delta sync between Azure Storage blob containersHow to add versioning support to Azure File StorageAzure - Connecting to Blob storage from app service through vnetAccess with Azure Automation in Blob StorageAzure Storage / Table - Read LockRepoint website in Azure App Service to Azure static site storage container blob with no downtime






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;








1















I have an ML dataset that consists of 2.7M images, ~1TB. For ML experiments, I uploaded these as blobs in an Azure storage account under "hot" access (which I thought would be appropriate for ML training). While not actively training, I would like this dataset to be in "Archive" mode to avoid accumulating "leaky faucet" charges.



The document on blob storage access tiers describes how it can be toggled on a per-blob basis, but AFAICT that is per-file (not even per-directory, which would be fine).



Is there a way to toggle the access tier of an entire storage account?



Absent that, what might be a good strategy? Perhaps creating a default-archive-access data_archive storage account and do a cloud-based copy to a temporary data_for_training_purposes hot-access storage account that I create and delete as needed?










share|improve this question




























    1















    I have an ML dataset that consists of 2.7M images, ~1TB. For ML experiments, I uploaded these as blobs in an Azure storage account under "hot" access (which I thought would be appropriate for ML training). While not actively training, I would like this dataset to be in "Archive" mode to avoid accumulating "leaky faucet" charges.



    The document on blob storage access tiers describes how it can be toggled on a per-blob basis, but AFAICT that is per-file (not even per-directory, which would be fine).



    Is there a way to toggle the access tier of an entire storage account?



    Absent that, what might be a good strategy? Perhaps creating a default-archive-access data_archive storage account and do a cloud-based copy to a temporary data_for_training_purposes hot-access storage account that I create and delete as needed?










    share|improve this question
























      1












      1








      1








      I have an ML dataset that consists of 2.7M images, ~1TB. For ML experiments, I uploaded these as blobs in an Azure storage account under "hot" access (which I thought would be appropriate for ML training). While not actively training, I would like this dataset to be in "Archive" mode to avoid accumulating "leaky faucet" charges.



      The document on blob storage access tiers describes how it can be toggled on a per-blob basis, but AFAICT that is per-file (not even per-directory, which would be fine).



      Is there a way to toggle the access tier of an entire storage account?



      Absent that, what might be a good strategy? Perhaps creating a default-archive-access data_archive storage account and do a cloud-based copy to a temporary data_for_training_purposes hot-access storage account that I create and delete as needed?










      share|improve this question














      I have an ML dataset that consists of 2.7M images, ~1TB. For ML experiments, I uploaded these as blobs in an Azure storage account under "hot" access (which I thought would be appropriate for ML training). While not actively training, I would like this dataset to be in "Archive" mode to avoid accumulating "leaky faucet" charges.



      The document on blob storage access tiers describes how it can be toggled on a per-blob basis, but AFAICT that is per-file (not even per-directory, which would be fine).



      Is there a way to toggle the access tier of an entire storage account?



      Absent that, what might be a good strategy? Perhaps creating a default-archive-access data_archive storage account and do a cloud-based copy to a temporary data_for_training_purposes hot-access storage account that I create and delete as needed?







      azure azure-storage






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked May 24 at 18:41









      Larry OBrienLarry OBrien

      1062




      1062




















          0






          active

          oldest

          votes












          Your Answer








          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "2"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f968761%2fhow-change-large-dataset-between-access-tiers-in-azure-blob-storage%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Server Fault!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f968761%2fhow-change-large-dataset-between-access-tiers-in-azure-blob-storage%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Wikipedia:Vital articles Мазмуну Biography - Өмүр баян Philosophy and psychology - Философия жана психология Religion - Дин Social sciences - Коомдук илимдер Language and literature - Тил жана адабият Science - Илим Technology - Технология Arts and recreation - Искусство жана эс алуу History and geography - Тарых жана география Навигация менюсу

          Bruxelas-Capital Índice Historia | Composición | Situación lingüística | Clima | Cidades irmandadas | Notas | Véxase tamén | Menú de navegacióneO uso das linguas en Bruxelas e a situación do neerlandés"Rexión de Bruxelas Capital"o orixinalSitio da rexiónPáxina de Bruselas no sitio da Oficina de Promoción Turística de Valonia e BruxelasMapa Interactivo da Rexión de Bruxelas-CapitaleeWorldCat332144929079854441105155190212ID28008674080552-90000 0001 0666 3698n94104302ID540940339365017018237

          What should I write in an apology letter, since I have decided not to join a company after accepting an offer letterShould I keep looking after accepting a job offer?What should I do when I've been verbally told I would get an offer letter, but still haven't gotten one after 4 weeks?Do I accept an offer from a company that I am not likely to join?New job hasn't confirmed starting date and I want to give current employer as much notice as possibleHow should I address my manager in my resignation letter?HR delayed background verification, now jobless as resignedNo email communication after accepting a formal written offer. How should I phrase the call?What should I do if after receiving a verbal offer letter I am informed that my written job offer is put on hold due to some internal issues?Should I inform the current employer that I am about to resign within 1-2 weeks since I have signed the offer letter and waiting for visa?What company will do, if I send their offer letter to another company