How change large dataset between access tiers in Azure Blob StorageSetting default version on Azure Blob Storage?Windows Azure Blob Storage Data MigrationAzure - Transfer Blob Storage account to new subscriptionMove Large Azure Storage Container To Another AccountKeeping a delta sync between Azure Storage blob containersHow to add versioning support to Azure File StorageAzure - Connecting to Blob storage from app service through vnetAccess with Azure Automation in Blob StorageAzure Storage / Table - Read LockRepoint website in Azure App Service to Azure static site storage container blob with no downtime

Teaching a class likely meant to inflate the GPA of student athletes

Increase speed altering column on large table to NON NULL

Has there been a multiethnic Star Trek character?

Which languages would be most useful in Europe at the end of the 19th century?

Reactive Programming

Is using 'echo' to display attacker-controlled data on the terminal dangerous?

Is there a set of positive integers of density 1 which contains no infinite arithmetic progression?

Will Roalesk, Apex Hybrid, trigger Sharktocrab twice?

What aircraft was used as Air Force One for the flight between Southampton and Shannon?

What would be the way to say "just saying" in German? (Not the literal translation)

Why did Intel abandon unified CPU cache?

Why am I getting a strange double quote (“) in Open Office instead of the ordinary one (")?

Is it possible to have 2 different but equal size real number sets that have the same mean and standard deviation?

How can I use String in enum for Apex?

Are polynomials with the same roots identical?

How to hide rifle during medieval town entrance inspection?

Is it expected that a reader will skip parts of what you write?

What is the color of artificial intelligence?

I've been given a project I can't complete, what should I do?

USGS Relief map (GeoTIFF raster) misaligns with vector layers (QGIS)

What are some really overused phrases in French that are common nowadays?

Return a String containing only alphabets without spaces

The Frozen Wastes

Should I refuse being named as co-author of a bad quality paper?



How change large dataset between access tiers in Azure Blob Storage


Setting default version on Azure Blob Storage?Windows Azure Blob Storage Data MigrationAzure - Transfer Blob Storage account to new subscriptionMove Large Azure Storage Container To Another AccountKeeping a delta sync between Azure Storage blob containersHow to add versioning support to Azure File StorageAzure - Connecting to Blob storage from app service through vnetAccess with Azure Automation in Blob StorageAzure Storage / Table - Read LockRepoint website in Azure App Service to Azure static site storage container blob with no downtime






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;








1















I have an ML dataset that consists of 2.7M images, ~1TB. For ML experiments, I uploaded these as blobs in an Azure storage account under "hot" access (which I thought would be appropriate for ML training). While not actively training, I would like this dataset to be in "Archive" mode to avoid accumulating "leaky faucet" charges.



The document on blob storage access tiers describes how it can be toggled on a per-blob basis, but AFAICT that is per-file (not even per-directory, which would be fine).



Is there a way to toggle the access tier of an entire storage account?



Absent that, what might be a good strategy? Perhaps creating a default-archive-access data_archive storage account and do a cloud-based copy to a temporary data_for_training_purposes hot-access storage account that I create and delete as needed?










share|improve this question




























    1















    I have an ML dataset that consists of 2.7M images, ~1TB. For ML experiments, I uploaded these as blobs in an Azure storage account under "hot" access (which I thought would be appropriate for ML training). While not actively training, I would like this dataset to be in "Archive" mode to avoid accumulating "leaky faucet" charges.



    The document on blob storage access tiers describes how it can be toggled on a per-blob basis, but AFAICT that is per-file (not even per-directory, which would be fine).



    Is there a way to toggle the access tier of an entire storage account?



    Absent that, what might be a good strategy? Perhaps creating a default-archive-access data_archive storage account and do a cloud-based copy to a temporary data_for_training_purposes hot-access storage account that I create and delete as needed?










    share|improve this question
























      1












      1








      1








      I have an ML dataset that consists of 2.7M images, ~1TB. For ML experiments, I uploaded these as blobs in an Azure storage account under "hot" access (which I thought would be appropriate for ML training). While not actively training, I would like this dataset to be in "Archive" mode to avoid accumulating "leaky faucet" charges.



      The document on blob storage access tiers describes how it can be toggled on a per-blob basis, but AFAICT that is per-file (not even per-directory, which would be fine).



      Is there a way to toggle the access tier of an entire storage account?



      Absent that, what might be a good strategy? Perhaps creating a default-archive-access data_archive storage account and do a cloud-based copy to a temporary data_for_training_purposes hot-access storage account that I create and delete as needed?










      share|improve this question














      I have an ML dataset that consists of 2.7M images, ~1TB. For ML experiments, I uploaded these as blobs in an Azure storage account under "hot" access (which I thought would be appropriate for ML training). While not actively training, I would like this dataset to be in "Archive" mode to avoid accumulating "leaky faucet" charges.



      The document on blob storage access tiers describes how it can be toggled on a per-blob basis, but AFAICT that is per-file (not even per-directory, which would be fine).



      Is there a way to toggle the access tier of an entire storage account?



      Absent that, what might be a good strategy? Perhaps creating a default-archive-access data_archive storage account and do a cloud-based copy to a temporary data_for_training_purposes hot-access storage account that I create and delete as needed?







      azure azure-storage






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked May 24 at 18:41









      Larry OBrienLarry OBrien

      1062




      1062




















          0






          active

          oldest

          votes












          Your Answer








          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "2"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f968761%2fhow-change-large-dataset-between-access-tiers-in-azure-blob-storage%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Server Fault!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f968761%2fhow-change-large-dataset-between-access-tiers-in-azure-blob-storage%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Club Baloncesto Breogán Índice Historia | Pavillón | Nome | O Breogán na cultura popular | Xogadores | Adestradores | Presidentes | Palmarés | Historial | Líderes | Notas | Véxase tamén | Menú de navegacióncbbreogan.galCadroGuía oficial da ACB 2009-10, páxina 201Guía oficial ACB 1992, páxina 183. Editorial DB.É de 6.500 espectadores sentados axeitándose á última normativa"Estudiantes Junior, entre as mellores canteiras"o orixinalHemeroteca El Mundo Deportivo, 16 setembro de 1970, páxina 12Historia do BreogánAlfredo Pérez, o último canoneiroHistoria C.B. BreogánHemeroteca de El Mundo DeportivoJimmy Wright, norteamericano do Breogán deixará Lugo por ameazas de morteResultados de Breogán en 1986-87Resultados de Breogán en 1990-91Ficha de Velimir Perasović en acb.comResultados de Breogán en 1994-95Breogán arrasa al Barça. "El Mundo Deportivo", 27 de setembro de 1999, páxina 58CB Breogán - FC BarcelonaA FEB invita a participar nunha nova Liga EuropeaCharlie Bell na prensa estatalMáximos anotadores 2005Tempada 2005-06 : Tódolos Xogadores da Xornada""Non quero pensar nunha man negra, mais pregúntome que está a pasar""o orixinalRaúl López, orgulloso dos xogadores, presume da boa saúde económica do BreogánJulio González confirma que cesa como presidente del BreogánHomenaxe a Lisardo GómezA tempada do rexurdimento celesteEntrevista a Lisardo GómezEl COB dinamita el Pazo para forzar el quinto (69-73)Cafés Candelas, patrocinador del CB Breogán"Suso Lázare, novo presidente do Breogán"o orixinalCafés Candelas Breogán firma el mayor triunfo de la historiaEl Breogán realizará 17 homenajes por su cincuenta aniversario"O Breogán honra ao seu fundador e primeiro presidente"o orixinalMiguel Giao recibiu a homenaxe do PazoHomenaxe aos primeiros gladiadores celestesO home que nos amosa como ver o Breo co corazónTita Franco será homenaxeada polos #50anosdeBreoJulio Vila recibirá unha homenaxe in memoriam polos #50anosdeBreo"O Breogán homenaxeará aos seus aboados máis veteráns"Pechada ovación a «Capi» Sanmartín e Ricardo «Corazón de González»Homenaxe por décadas de informaciónPaco García volve ao Pazo con motivo do 50 aniversario"Resultados y clasificaciones""O Cafés Candelas Breogán, campión da Copa Princesa""O Cafés Candelas Breogán, equipo ACB"C.B. Breogán"Proxecto social"o orixinal"Centros asociados"o orixinalFicha en imdb.comMario Camus trata la recuperación del amor en 'La vieja música', su última película"Páxina web oficial""Club Baloncesto Breogán""C. B. Breogán S.A.D."eehttp://www.fegaba.com

          Vilaño, A Laracha Índice Patrimonio | Lugares e parroquias | Véxase tamén | Menú de navegación43°14′52″N 8°36′03″O / 43.24775, -8.60070

          Cegueira Índice Epidemioloxía | Deficiencia visual | Tipos de cegueira | Principais causas de cegueira | Tratamento | Técnicas de adaptación e axudas | Vida dos cegos | Primeiros auxilios | Crenzas respecto das persoas cegas | Crenzas das persoas cegas | O neno deficiente visual | Aspectos psicolóxicos da cegueira | Notas | Véxase tamén | Menú de navegación54.054.154.436928256blindnessDicionario da Real Academia GalegaPortal das Palabras"International Standards: Visual Standards — Aspects and Ranges of Vision Loss with Emphasis on Population Surveys.""Visual impairment and blindness""Presentan un plan para previr a cegueira"o orixinalACCDV Associació Catalana de Cecs i Disminuïts Visuals - PMFTrachoma"Effect of gene therapy on visual function in Leber's congenital amaurosis"1844137110.1056/NEJMoa0802268Cans guía - os mellores amigos dos cegosArquivadoEscola de cans guía para cegos en Mortágua, PortugalArquivado"Tecnología para ciegos y deficientes visuales. Recopilación de recursos gratuitos en la Red""Colorino""‘COL.diesis’, escuchar los sonidos del color""COL.diesis: Transforming Colour into Melody and Implementing the Result in a Colour Sensor Device"o orixinal"Sistema de desarrollo de sinestesia color-sonido para invidentes utilizando un protocolo de audio""Enseñanza táctil - geometría y color. Juegos didácticos para niños ciegos y videntes""Sistema Constanz"L'ocupació laboral dels cecs a l'Estat espanyol està pràcticament equiparada a la de les persones amb visió, entrevista amb Pedro ZuritaONCE (Organización Nacional de Cegos de España)Prevención da cegueiraDescrición de deficiencias visuais (Disc@pnet)Braillín, un boneco atractivo para calquera neno, con ou sen discapacidade, que permite familiarizarse co sistema de escritura e lectura brailleAxudas Técnicas36838ID00897494007150-90057129528256DOID:1432HP:0000618D001766C10.597.751.941.162C97109C0155020