Amazon S3 Website & MySQL Backup The Next CEO of Stack OverflowHosting an image-hosting website on Amazon Web ServicesI/O intensive MySql server on Amazon AWSMySQL lost connection error on mysqldumpFinding out what causes CLOSE_WAIT connections with Apache & PHP & MysqlAmazon Linux EC2 Webserver / MYSQL Upgrade – Traffic causing error establishing a database connectionUser Uploaded Images– Blank Post – Connection reset by peer / FastCGI: incomplete headersCan't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (111)Amazon IP no longer allowing MySQL connection (Error 104)Learning to deal with a large MySQL databaseredirect website while making backup

Robert Sheckley short story about vacation spots being overwhelmed

Does the Brexit deal have to be agreed by both Houses?

Can a caster that cast Polymorph on themselves stop concentrating at any point even if their Int is low?

What is the point of a new vote on May's deal when the indicative votes suggest she will not win?

Why were Madagascar and New Zealand discovered so late?

Is it safe to use c_str() on a temporary string?

Should I tutor a student who I know has cheated on their homework?

I believe this to be a fraud - hired, then asked to cash check and send cash as Bitcoin

How to use tikz in fbox?

Was a professor correct to chastise me for writing "Prof. X" rather than "Professor X"?

Customer Requests (Sometimes) Drive Me Bonkers!

Grabbing quick drinks

How to make a variable always equal to the result of some calculations?

Why didn't Theresa May consult with Parliament before negotiating a deal with the EU?

How can I quit an app using Terminal?

What does this shorthand mean?

Return the Closest Prime Number

Natural language into sentence logic

Is it okay to store user locations?

Does it take more energy to get to Venus or to Mars?

% symbol leads to superlong (forever?) compilations

Implement the Thanos sorting algorithm

Which organization defines CJK Unified Ideographs?

Horror movie/show or scene where a horse creature opens its mouth really wide and devours a man in a stables



Amazon S3 Website & MySQL Backup



The Next CEO of Stack OverflowHosting an image-hosting website on Amazon Web ServicesI/O intensive MySql server on Amazon AWSMySQL lost connection error on mysqldumpFinding out what causes CLOSE_WAIT connections with Apache & PHP & MysqlAmazon Linux EC2 Webserver / MYSQL Upgrade – Traffic causing error establishing a database connectionUser Uploaded Images– Blank Post – Connection reset by peer / FastCGI: incomplete headersCan't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (111)Amazon IP no longer allowing MySQL connection (Error 104)Learning to deal with a large MySQL databaseredirect website while making backup










2















I have a website (a digital asset management system/gallery - http://www.resourcespace.org) that has a huge amount of images. The total size of the website, including the images is approximately 6gb.



The website is in PHP and uses a MySQL database.



What is the best way to automatically backup the website & MySQL database and push to Amazon S3 each night?



Are there any readily available scripts out there that can do this?










share|improve this question














bumped to the homepage by Community 19 hours ago


This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.






migrated from stackoverflow.com Oct 9 '12 at 4:02


This question came from our site for professional and enthusiast programmers.


















  • Just found this if anyone is interested... looks quite good & will investigate website2backup.com

    – user991830
    Mar 28 '12 at 9:09











  • I develop website2backup.com :) The problem is the 6gb it is huge, too big for PHP. As PHP cannot manipulate files of more than 2gb the archive cannot be completed. If you really want to use a PHP solution you must do several backups of your website. For example if your gallery is organized by months do a backup for each month. The incremental files backup functionality of W2B allow you to use less storage and resources, but a full backup is regularly needed. Adding files to archives can be resources consuming for your web hosting, smallest archives do faster backups.

    – Axel
    Mar 28 '12 at 12:54






  • 1





    @Axel - PHP on a 64bit system can handle files more than 2GB in size.

    – Jamie
    Mar 29 '12 at 10:46















2















I have a website (a digital asset management system/gallery - http://www.resourcespace.org) that has a huge amount of images. The total size of the website, including the images is approximately 6gb.



The website is in PHP and uses a MySQL database.



What is the best way to automatically backup the website & MySQL database and push to Amazon S3 each night?



Are there any readily available scripts out there that can do this?










share|improve this question














bumped to the homepage by Community 19 hours ago


This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.






migrated from stackoverflow.com Oct 9 '12 at 4:02


This question came from our site for professional and enthusiast programmers.


















  • Just found this if anyone is interested... looks quite good & will investigate website2backup.com

    – user991830
    Mar 28 '12 at 9:09











  • I develop website2backup.com :) The problem is the 6gb it is huge, too big for PHP. As PHP cannot manipulate files of more than 2gb the archive cannot be completed. If you really want to use a PHP solution you must do several backups of your website. For example if your gallery is organized by months do a backup for each month. The incremental files backup functionality of W2B allow you to use less storage and resources, but a full backup is regularly needed. Adding files to archives can be resources consuming for your web hosting, smallest archives do faster backups.

    – Axel
    Mar 28 '12 at 12:54






  • 1





    @Axel - PHP on a 64bit system can handle files more than 2GB in size.

    – Jamie
    Mar 29 '12 at 10:46













2












2








2








I have a website (a digital asset management system/gallery - http://www.resourcespace.org) that has a huge amount of images. The total size of the website, including the images is approximately 6gb.



The website is in PHP and uses a MySQL database.



What is the best way to automatically backup the website & MySQL database and push to Amazon S3 each night?



Are there any readily available scripts out there that can do this?










share|improve this question














I have a website (a digital asset management system/gallery - http://www.resourcespace.org) that has a huge amount of images. The total size of the website, including the images is approximately 6gb.



The website is in PHP and uses a MySQL database.



What is the best way to automatically backup the website & MySQL database and push to Amazon S3 each night?



Are there any readily available scripts out there that can do this?







php mysql scripting amazon-s3 backup






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked Mar 28 '12 at 8:32







user991830












bumped to the homepage by Community 19 hours ago


This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.







bumped to the homepage by Community 19 hours ago


This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.






migrated from stackoverflow.com Oct 9 '12 at 4:02


This question came from our site for professional and enthusiast programmers.









migrated from stackoverflow.com Oct 9 '12 at 4:02


This question came from our site for professional and enthusiast programmers.














  • Just found this if anyone is interested... looks quite good & will investigate website2backup.com

    – user991830
    Mar 28 '12 at 9:09











  • I develop website2backup.com :) The problem is the 6gb it is huge, too big for PHP. As PHP cannot manipulate files of more than 2gb the archive cannot be completed. If you really want to use a PHP solution you must do several backups of your website. For example if your gallery is organized by months do a backup for each month. The incremental files backup functionality of W2B allow you to use less storage and resources, but a full backup is regularly needed. Adding files to archives can be resources consuming for your web hosting, smallest archives do faster backups.

    – Axel
    Mar 28 '12 at 12:54






  • 1





    @Axel - PHP on a 64bit system can handle files more than 2GB in size.

    – Jamie
    Mar 29 '12 at 10:46

















  • Just found this if anyone is interested... looks quite good & will investigate website2backup.com

    – user991830
    Mar 28 '12 at 9:09











  • I develop website2backup.com :) The problem is the 6gb it is huge, too big for PHP. As PHP cannot manipulate files of more than 2gb the archive cannot be completed. If you really want to use a PHP solution you must do several backups of your website. For example if your gallery is organized by months do a backup for each month. The incremental files backup functionality of W2B allow you to use less storage and resources, but a full backup is regularly needed. Adding files to archives can be resources consuming for your web hosting, smallest archives do faster backups.

    – Axel
    Mar 28 '12 at 12:54






  • 1





    @Axel - PHP on a 64bit system can handle files more than 2GB in size.

    – Jamie
    Mar 29 '12 at 10:46
















Just found this if anyone is interested... looks quite good & will investigate website2backup.com

– user991830
Mar 28 '12 at 9:09





Just found this if anyone is interested... looks quite good & will investigate website2backup.com

– user991830
Mar 28 '12 at 9:09













I develop website2backup.com :) The problem is the 6gb it is huge, too big for PHP. As PHP cannot manipulate files of more than 2gb the archive cannot be completed. If you really want to use a PHP solution you must do several backups of your website. For example if your gallery is organized by months do a backup for each month. The incremental files backup functionality of W2B allow you to use less storage and resources, but a full backup is regularly needed. Adding files to archives can be resources consuming for your web hosting, smallest archives do faster backups.

– Axel
Mar 28 '12 at 12:54





I develop website2backup.com :) The problem is the 6gb it is huge, too big for PHP. As PHP cannot manipulate files of more than 2gb the archive cannot be completed. If you really want to use a PHP solution you must do several backups of your website. For example if your gallery is organized by months do a backup for each month. The incremental files backup functionality of W2B allow you to use less storage and resources, but a full backup is regularly needed. Adding files to archives can be resources consuming for your web hosting, smallest archives do faster backups.

– Axel
Mar 28 '12 at 12:54




1




1





@Axel - PHP on a 64bit system can handle files more than 2GB in size.

– Jamie
Mar 29 '12 at 10:46





@Axel - PHP on a 64bit system can handle files more than 2GB in size.

– Jamie
Mar 29 '12 at 10:46










1 Answer
1






active

oldest

votes


















0














I have not yet dealt with size of data that you are referring to. However, I did find this handy script and tweaked it to push my backup files to Amazon S3.



https://github.com/woxxy/MySQL-backup-to-Amazon-S3



If you have not already seen the recent announcement for Amazon Glacier, you should take a look. It may be more along the lines of what you need for pure backups.



http://aws.amazon.com/glacier/






share|improve this answer























    Your Answer








    StackExchange.ready(function()
    var channelOptions =
    tags: "".split(" "),
    id: "2"
    ;
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function()
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled)
    StackExchange.using("snippets", function()
    createEditor();
    );

    else
    createEditor();

    );

    function createEditor()
    StackExchange.prepareEditor(
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: true,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: 10,
    bindNavPrevention: true,
    postfix: "",
    imageUploader:
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    ,
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    );



    );













    draft saved

    draft discarded


















    StackExchange.ready(
    function ()
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f436247%2famazon-s3-website-mysql-backup%23new-answer', 'question_page');

    );

    Post as a guest















    Required, but never shown
























    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    0














    I have not yet dealt with size of data that you are referring to. However, I did find this handy script and tweaked it to push my backup files to Amazon S3.



    https://github.com/woxxy/MySQL-backup-to-Amazon-S3



    If you have not already seen the recent announcement for Amazon Glacier, you should take a look. It may be more along the lines of what you need for pure backups.



    http://aws.amazon.com/glacier/






    share|improve this answer



























      0














      I have not yet dealt with size of data that you are referring to. However, I did find this handy script and tweaked it to push my backup files to Amazon S3.



      https://github.com/woxxy/MySQL-backup-to-Amazon-S3



      If you have not already seen the recent announcement for Amazon Glacier, you should take a look. It may be more along the lines of what you need for pure backups.



      http://aws.amazon.com/glacier/






      share|improve this answer

























        0












        0








        0







        I have not yet dealt with size of data that you are referring to. However, I did find this handy script and tweaked it to push my backup files to Amazon S3.



        https://github.com/woxxy/MySQL-backup-to-Amazon-S3



        If you have not already seen the recent announcement for Amazon Glacier, you should take a look. It may be more along the lines of what you need for pure backups.



        http://aws.amazon.com/glacier/






        share|improve this answer













        I have not yet dealt with size of data that you are referring to. However, I did find this handy script and tweaked it to push my backup files to Amazon S3.



        https://github.com/woxxy/MySQL-backup-to-Amazon-S3



        If you have not already seen the recent announcement for Amazon Glacier, you should take a look. It may be more along the lines of what you need for pure backups.



        http://aws.amazon.com/glacier/







        share|improve this answer












        share|improve this answer



        share|improve this answer










        answered Aug 22 '12 at 14:57









        SunSparcSunSparc

        4342719




        4342719



























            draft saved

            draft discarded
















































            Thanks for contributing an answer to Server Fault!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid


            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.

            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f436247%2famazon-s3-website-mysql-backup%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            Popular posts from this blog

            Wikipedia:Vital articles Мазмуну Biography - Өмүр баян Philosophy and psychology - Философия жана психология Religion - Дин Social sciences - Коомдук илимдер Language and literature - Тил жана адабият Science - Илим Technology - Технология Arts and recreation - Искусство жана эс алуу History and geography - Тарых жана география Навигация менюсу

            Bruxelas-Capital Índice Historia | Composición | Situación lingüística | Clima | Cidades irmandadas | Notas | Véxase tamén | Menú de navegacióneO uso das linguas en Bruxelas e a situación do neerlandés"Rexión de Bruxelas Capital"o orixinalSitio da rexiónPáxina de Bruselas no sitio da Oficina de Promoción Turística de Valonia e BruxelasMapa Interactivo da Rexión de Bruxelas-CapitaleeWorldCat332144929079854441105155190212ID28008674080552-90000 0001 0666 3698n94104302ID540940339365017018237

            What should I write in an apology letter, since I have decided not to join a company after accepting an offer letterShould I keep looking after accepting a job offer?What should I do when I've been verbally told I would get an offer letter, but still haven't gotten one after 4 weeks?Do I accept an offer from a company that I am not likely to join?New job hasn't confirmed starting date and I want to give current employer as much notice as possibleHow should I address my manager in my resignation letter?HR delayed background verification, now jobless as resignedNo email communication after accepting a formal written offer. How should I phrase the call?What should I do if after receiving a verbal offer letter I am informed that my written job offer is put on hold due to some internal issues?Should I inform the current employer that I am about to resign within 1-2 weeks since I have signed the offer letter and waiting for visa?What company will do, if I send their offer letter to another company