Slow Queries WordPress Site (500k visitors a month and 150k posts)Mysql high queries per second, with high cpu usageWhen loading a wordpress site, is more CPU or RAM better?Wordpress slow when publishingMy wordpress website is deadly slowHolding F5 on Wordpress site causes 100% CPU (Apache)Wordpress High load average 18 and cpu 81% on a dedicated serverMySQL 5.5 and MariaDB5.5 return different number of columns for the same data and same select query?Occasional slow database queries caused by InnoDBPerformance difference between MySQL and MariaDBMariadb 1000% CPU

Why do I get two different answers when solving for arclength?

When a land becomes a creature, is it untapped?

Is there ever any indication in the MCU as to how Spider-Man got his powers?

CPLD based Pierce oscillator

Where to find every-day healthy food near Heathrow Airport?

Can a tourist shoot a gun in the USA?

What to do if SUS scores contradict qualitative feedback?

What's tha name for when you write multiple voices on same staff? And are there any cons?

Longest Text in Latin

Do Life Drain attacks from wights stack?

Unexpected Netflix account registered to my Gmail address - any way it could be a hack attempt?

Would an 8% reduction in drag outweigh the weight addition from this custom CFD-tested winglet?

Why does my circuit work on a breadboard, but not on a perfboard? I am new to soldering

what does a native speaker say when he wanted to leave his work?

Frame adjustment for engine

Why are solar panels kept tilted?

Can someone explain homicide-related death rates?

In books, how many dragons are there in present time?

How can I answer high-school writing prompts without sounding weird and fake?

Ito`s Lemma problem

Does gravity affect the time evolution of a QM wave function?

Labeling matrices/rectangles and drawing Sigma inside rectangle

German characters on US-International keyboard layout

Extracting sublists that contain similar elements



Slow Queries WordPress Site (500k visitors a month and 150k posts)


Mysql high queries per second, with high cpu usageWhen loading a wordpress site, is more CPU or RAM better?Wordpress slow when publishingMy wordpress website is deadly slowHolding F5 on Wordpress site causes 100% CPU (Apache)Wordpress High load average 18 and cpu 81% on a dedicated serverMySQL 5.5 and MariaDB5.5 return different number of columns for the same data and same select query?Occasional slow database queries caused by InnoDBPerformance difference between MySQL and MariaDBMariadb 1000% CPU






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;








0















I'm running a WordPress site with 500k visitors a month and 150k posts with in average 100 pageviews every second. I am trying to figure out if the load on the server is normal or if there is something I can do to fix the performance issues without increasing the server setup and monthly costs.



Here is the server setup i'm running right now:



  • 2 Front-end servers, Nginx: 2 CPU & 4GB RAM

  • 1 DB server, MariaDB: 8 CPU & 16GB RAM

  • 1 Redis server: 2 CPU & 4GB RAM

The WordPress theme is develop from scratch were I have optimize the queries and minimized the use of plugins (5 plugins in total).



I run Nginx with Reverse Proxy Cache where I cache all pages for 5 minutes to be able to handle peaks in traffic (two daily peaks with 3k visitors in 30 min when sending newsletters).



The MariaDB and Redis server is running Debian with out of the box configuration. The only thing I've changed is innodb_buffer_pool_size = 11G and max_connections = 300 in MariaDB.



The DB CPU is running at 50% when having 100 real time visitors and 85-90% with 300-700 real time visitors.



The problem is that the queries take some time to load (3-6 seconds) even with 50% load at the CPU.



My staging environment is running on the exact same servers but with another database table (same amount of posts) and queries time is 0,5-1,5 seconds.



So the only difference is that the production database have more concurrent users.



What can it be that make the queries take this time to load?










share|improve this question






















  • Do an EXPLAIN on the slow queries and look into the execution plan.

    – ceejayoz
    May 2 at 19:57











  • This probably should be moved to dba stackexchange. You will need to monitor and see which queries are taking the longest and figure out why. That will give you a start. Considering your site is most likely a read heavy setup, query and data cache tuning will help quite a bit. But you will need to research the top slowest queries, ideally during a stress scenario, to get a starting point.

    – Jarrod Christman
    May 2 at 19:58

















0















I'm running a WordPress site with 500k visitors a month and 150k posts with in average 100 pageviews every second. I am trying to figure out if the load on the server is normal or if there is something I can do to fix the performance issues without increasing the server setup and monthly costs.



Here is the server setup i'm running right now:



  • 2 Front-end servers, Nginx: 2 CPU & 4GB RAM

  • 1 DB server, MariaDB: 8 CPU & 16GB RAM

  • 1 Redis server: 2 CPU & 4GB RAM

The WordPress theme is develop from scratch were I have optimize the queries and minimized the use of plugins (5 plugins in total).



I run Nginx with Reverse Proxy Cache where I cache all pages for 5 minutes to be able to handle peaks in traffic (two daily peaks with 3k visitors in 30 min when sending newsletters).



The MariaDB and Redis server is running Debian with out of the box configuration. The only thing I've changed is innodb_buffer_pool_size = 11G and max_connections = 300 in MariaDB.



The DB CPU is running at 50% when having 100 real time visitors and 85-90% with 300-700 real time visitors.



The problem is that the queries take some time to load (3-6 seconds) even with 50% load at the CPU.



My staging environment is running on the exact same servers but with another database table (same amount of posts) and queries time is 0,5-1,5 seconds.



So the only difference is that the production database have more concurrent users.



What can it be that make the queries take this time to load?










share|improve this question






















  • Do an EXPLAIN on the slow queries and look into the execution plan.

    – ceejayoz
    May 2 at 19:57











  • This probably should be moved to dba stackexchange. You will need to monitor and see which queries are taking the longest and figure out why. That will give you a start. Considering your site is most likely a read heavy setup, query and data cache tuning will help quite a bit. But you will need to research the top slowest queries, ideally during a stress scenario, to get a starting point.

    – Jarrod Christman
    May 2 at 19:58













0












0








0








I'm running a WordPress site with 500k visitors a month and 150k posts with in average 100 pageviews every second. I am trying to figure out if the load on the server is normal or if there is something I can do to fix the performance issues without increasing the server setup and monthly costs.



Here is the server setup i'm running right now:



  • 2 Front-end servers, Nginx: 2 CPU & 4GB RAM

  • 1 DB server, MariaDB: 8 CPU & 16GB RAM

  • 1 Redis server: 2 CPU & 4GB RAM

The WordPress theme is develop from scratch were I have optimize the queries and minimized the use of plugins (5 plugins in total).



I run Nginx with Reverse Proxy Cache where I cache all pages for 5 minutes to be able to handle peaks in traffic (two daily peaks with 3k visitors in 30 min when sending newsletters).



The MariaDB and Redis server is running Debian with out of the box configuration. The only thing I've changed is innodb_buffer_pool_size = 11G and max_connections = 300 in MariaDB.



The DB CPU is running at 50% when having 100 real time visitors and 85-90% with 300-700 real time visitors.



The problem is that the queries take some time to load (3-6 seconds) even with 50% load at the CPU.



My staging environment is running on the exact same servers but with another database table (same amount of posts) and queries time is 0,5-1,5 seconds.



So the only difference is that the production database have more concurrent users.



What can it be that make the queries take this time to load?










share|improve this question














I'm running a WordPress site with 500k visitors a month and 150k posts with in average 100 pageviews every second. I am trying to figure out if the load on the server is normal or if there is something I can do to fix the performance issues without increasing the server setup and monthly costs.



Here is the server setup i'm running right now:



  • 2 Front-end servers, Nginx: 2 CPU & 4GB RAM

  • 1 DB server, MariaDB: 8 CPU & 16GB RAM

  • 1 Redis server: 2 CPU & 4GB RAM

The WordPress theme is develop from scratch were I have optimize the queries and minimized the use of plugins (5 plugins in total).



I run Nginx with Reverse Proxy Cache where I cache all pages for 5 minutes to be able to handle peaks in traffic (two daily peaks with 3k visitors in 30 min when sending newsletters).



The MariaDB and Redis server is running Debian with out of the box configuration. The only thing I've changed is innodb_buffer_pool_size = 11G and max_connections = 300 in MariaDB.



The DB CPU is running at 50% when having 100 real time visitors and 85-90% with 300-700 real time visitors.



The problem is that the queries take some time to load (3-6 seconds) even with 50% load at the CPU.



My staging environment is running on the exact same servers but with another database table (same amount of posts) and queries time is 0,5-1,5 seconds.



So the only difference is that the production database have more concurrent users.



What can it be that make the queries take this time to load?







nginx mysql wordpress mariadb redis






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked May 2 at 19:36









rccoderccode

1




1












  • Do an EXPLAIN on the slow queries and look into the execution plan.

    – ceejayoz
    May 2 at 19:57











  • This probably should be moved to dba stackexchange. You will need to monitor and see which queries are taking the longest and figure out why. That will give you a start. Considering your site is most likely a read heavy setup, query and data cache tuning will help quite a bit. But you will need to research the top slowest queries, ideally during a stress scenario, to get a starting point.

    – Jarrod Christman
    May 2 at 19:58

















  • Do an EXPLAIN on the slow queries and look into the execution plan.

    – ceejayoz
    May 2 at 19:57











  • This probably should be moved to dba stackexchange. You will need to monitor and see which queries are taking the longest and figure out why. That will give you a start. Considering your site is most likely a read heavy setup, query and data cache tuning will help quite a bit. But you will need to research the top slowest queries, ideally during a stress scenario, to get a starting point.

    – Jarrod Christman
    May 2 at 19:58
















Do an EXPLAIN on the slow queries and look into the execution plan.

– ceejayoz
May 2 at 19:57





Do an EXPLAIN on the slow queries and look into the execution plan.

– ceejayoz
May 2 at 19:57













This probably should be moved to dba stackexchange. You will need to monitor and see which queries are taking the longest and figure out why. That will give you a start. Considering your site is most likely a read heavy setup, query and data cache tuning will help quite a bit. But you will need to research the top slowest queries, ideally during a stress scenario, to get a starting point.

– Jarrod Christman
May 2 at 19:58





This probably should be moved to dba stackexchange. You will need to monitor and see which queries are taking the longest and figure out why. That will give you a start. Considering your site is most likely a read heavy setup, query and data cache tuning will help quite a bit. But you will need to research the top slowest queries, ideally during a stress scenario, to get a starting point.

– Jarrod Christman
May 2 at 19:58










2 Answers
2






active

oldest

votes


















1














Firstly, enable slow query logging if you have not already done so:
https://mariadb.com/kb/en/library/slow-query-log-overview/



Next, you can take one of those queries and put EXPLAIN in front of it. This will show you a table that explains what happened when executing the query. It will for instance show if an index was used why executing the query. The following page explains what all the columns mean:
https://mariadb.com/kb/en/library/explain/



Most of the times placing a well though out index on a column with good cardinality will reduce the time needed to execute the query significantly.






share|improve this answer






























    0














    One of the main slownesses in WP is fixable.



    http://mysql.rjweb.org/doc.php/index_cookbook_mysql#speeding_up_wp_postmeta
    discusses how to change the schema for postmeta (and, optionally, other meta tables) so that the main queries using that table will run faster.






    share|improve this answer























    • Thanks! Can I do this on a existing WordPress DB?

      – rccode
      May 3 at 6:44











    • @rccode - It should be possible in an existing WP. The downtime may be "minutes" for the ALTERs, depending on the table size.

      – Rick James
      May 3 at 13:09











    Your Answer








    StackExchange.ready(function()
    var channelOptions =
    tags: "".split(" "),
    id: "2"
    ;
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function()
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled)
    StackExchange.using("snippets", function()
    createEditor();
    );

    else
    createEditor();

    );

    function createEditor()
    StackExchange.prepareEditor(
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: true,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: 10,
    bindNavPrevention: true,
    postfix: "",
    imageUploader:
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    ,
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    );



    );













    draft saved

    draft discarded


















    StackExchange.ready(
    function ()
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f965636%2fslow-queries-wordpress-site-500k-visitors-a-month-and-150k-posts%23new-answer', 'question_page');

    );

    Post as a guest















    Required, but never shown

























    2 Answers
    2






    active

    oldest

    votes








    2 Answers
    2






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    1














    Firstly, enable slow query logging if you have not already done so:
    https://mariadb.com/kb/en/library/slow-query-log-overview/



    Next, you can take one of those queries and put EXPLAIN in front of it. This will show you a table that explains what happened when executing the query. It will for instance show if an index was used why executing the query. The following page explains what all the columns mean:
    https://mariadb.com/kb/en/library/explain/



    Most of the times placing a well though out index on a column with good cardinality will reduce the time needed to execute the query significantly.






    share|improve this answer



























      1














      Firstly, enable slow query logging if you have not already done so:
      https://mariadb.com/kb/en/library/slow-query-log-overview/



      Next, you can take one of those queries and put EXPLAIN in front of it. This will show you a table that explains what happened when executing the query. It will for instance show if an index was used why executing the query. The following page explains what all the columns mean:
      https://mariadb.com/kb/en/library/explain/



      Most of the times placing a well though out index on a column with good cardinality will reduce the time needed to execute the query significantly.






      share|improve this answer

























        1












        1








        1







        Firstly, enable slow query logging if you have not already done so:
        https://mariadb.com/kb/en/library/slow-query-log-overview/



        Next, you can take one of those queries and put EXPLAIN in front of it. This will show you a table that explains what happened when executing the query. It will for instance show if an index was used why executing the query. The following page explains what all the columns mean:
        https://mariadb.com/kb/en/library/explain/



        Most of the times placing a well though out index on a column with good cardinality will reduce the time needed to execute the query significantly.






        share|improve this answer













        Firstly, enable slow query logging if you have not already done so:
        https://mariadb.com/kb/en/library/slow-query-log-overview/



        Next, you can take one of those queries and put EXPLAIN in front of it. This will show you a table that explains what happened when executing the query. It will for instance show if an index was used why executing the query. The following page explains what all the columns mean:
        https://mariadb.com/kb/en/library/explain/



        Most of the times placing a well though out index on a column with good cardinality will reduce the time needed to execute the query significantly.







        share|improve this answer












        share|improve this answer



        share|improve this answer










        answered May 2 at 20:12









        Jochem BruijnsJochem Bruijns

        111




        111























            0














            One of the main slownesses in WP is fixable.



            http://mysql.rjweb.org/doc.php/index_cookbook_mysql#speeding_up_wp_postmeta
            discusses how to change the schema for postmeta (and, optionally, other meta tables) so that the main queries using that table will run faster.






            share|improve this answer























            • Thanks! Can I do this on a existing WordPress DB?

              – rccode
              May 3 at 6:44











            • @rccode - It should be possible in an existing WP. The downtime may be "minutes" for the ALTERs, depending on the table size.

              – Rick James
              May 3 at 13:09















            0














            One of the main slownesses in WP is fixable.



            http://mysql.rjweb.org/doc.php/index_cookbook_mysql#speeding_up_wp_postmeta
            discusses how to change the schema for postmeta (and, optionally, other meta tables) so that the main queries using that table will run faster.






            share|improve this answer























            • Thanks! Can I do this on a existing WordPress DB?

              – rccode
              May 3 at 6:44











            • @rccode - It should be possible in an existing WP. The downtime may be "minutes" for the ALTERs, depending on the table size.

              – Rick James
              May 3 at 13:09













            0












            0








            0







            One of the main slownesses in WP is fixable.



            http://mysql.rjweb.org/doc.php/index_cookbook_mysql#speeding_up_wp_postmeta
            discusses how to change the schema for postmeta (and, optionally, other meta tables) so that the main queries using that table will run faster.






            share|improve this answer













            One of the main slownesses in WP is fixable.



            http://mysql.rjweb.org/doc.php/index_cookbook_mysql#speeding_up_wp_postmeta
            discusses how to change the schema for postmeta (and, optionally, other meta tables) so that the main queries using that table will run faster.







            share|improve this answer












            share|improve this answer



            share|improve this answer










            answered May 3 at 2:47









            Rick JamesRick James

            2366




            2366












            • Thanks! Can I do this on a existing WordPress DB?

              – rccode
              May 3 at 6:44











            • @rccode - It should be possible in an existing WP. The downtime may be "minutes" for the ALTERs, depending on the table size.

              – Rick James
              May 3 at 13:09

















            • Thanks! Can I do this on a existing WordPress DB?

              – rccode
              May 3 at 6:44











            • @rccode - It should be possible in an existing WP. The downtime may be "minutes" for the ALTERs, depending on the table size.

              – Rick James
              May 3 at 13:09
















            Thanks! Can I do this on a existing WordPress DB?

            – rccode
            May 3 at 6:44





            Thanks! Can I do this on a existing WordPress DB?

            – rccode
            May 3 at 6:44













            @rccode - It should be possible in an existing WP. The downtime may be "minutes" for the ALTERs, depending on the table size.

            – Rick James
            May 3 at 13:09





            @rccode - It should be possible in an existing WP. The downtime may be "minutes" for the ALTERs, depending on the table size.

            – Rick James
            May 3 at 13:09

















            draft saved

            draft discarded
















































            Thanks for contributing an answer to Server Fault!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid


            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.

            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f965636%2fslow-queries-wordpress-site-500k-visitors-a-month-and-150k-posts%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            Popular posts from this blog

            Club Baloncesto Breogán Índice Historia | Pavillón | Nome | O Breogán na cultura popular | Xogadores | Adestradores | Presidentes | Palmarés | Historial | Líderes | Notas | Véxase tamén | Menú de navegacióncbbreogan.galCadroGuía oficial da ACB 2009-10, páxina 201Guía oficial ACB 1992, páxina 183. Editorial DB.É de 6.500 espectadores sentados axeitándose á última normativa"Estudiantes Junior, entre as mellores canteiras"o orixinalHemeroteca El Mundo Deportivo, 16 setembro de 1970, páxina 12Historia do BreogánAlfredo Pérez, o último canoneiroHistoria C.B. BreogánHemeroteca de El Mundo DeportivoJimmy Wright, norteamericano do Breogán deixará Lugo por ameazas de morteResultados de Breogán en 1986-87Resultados de Breogán en 1990-91Ficha de Velimir Perasović en acb.comResultados de Breogán en 1994-95Breogán arrasa al Barça. "El Mundo Deportivo", 27 de setembro de 1999, páxina 58CB Breogán - FC BarcelonaA FEB invita a participar nunha nova Liga EuropeaCharlie Bell na prensa estatalMáximos anotadores 2005Tempada 2005-06 : Tódolos Xogadores da Xornada""Non quero pensar nunha man negra, mais pregúntome que está a pasar""o orixinalRaúl López, orgulloso dos xogadores, presume da boa saúde económica do BreogánJulio González confirma que cesa como presidente del BreogánHomenaxe a Lisardo GómezA tempada do rexurdimento celesteEntrevista a Lisardo GómezEl COB dinamita el Pazo para forzar el quinto (69-73)Cafés Candelas, patrocinador del CB Breogán"Suso Lázare, novo presidente do Breogán"o orixinalCafés Candelas Breogán firma el mayor triunfo de la historiaEl Breogán realizará 17 homenajes por su cincuenta aniversario"O Breogán honra ao seu fundador e primeiro presidente"o orixinalMiguel Giao recibiu a homenaxe do PazoHomenaxe aos primeiros gladiadores celestesO home que nos amosa como ver o Breo co corazónTita Franco será homenaxeada polos #50anosdeBreoJulio Vila recibirá unha homenaxe in memoriam polos #50anosdeBreo"O Breogán homenaxeará aos seus aboados máis veteráns"Pechada ovación a «Capi» Sanmartín e Ricardo «Corazón de González»Homenaxe por décadas de informaciónPaco García volve ao Pazo con motivo do 50 aniversario"Resultados y clasificaciones""O Cafés Candelas Breogán, campión da Copa Princesa""O Cafés Candelas Breogán, equipo ACB"C.B. Breogán"Proxecto social"o orixinal"Centros asociados"o orixinalFicha en imdb.comMario Camus trata la recuperación del amor en 'La vieja música', su última película"Páxina web oficial""Club Baloncesto Breogán""C. B. Breogán S.A.D."eehttp://www.fegaba.com

            Vilaño, A Laracha Índice Patrimonio | Lugares e parroquias | Véxase tamén | Menú de navegación43°14′52″N 8°36′03″O / 43.24775, -8.60070

            Cegueira Índice Epidemioloxía | Deficiencia visual | Tipos de cegueira | Principais causas de cegueira | Tratamento | Técnicas de adaptación e axudas | Vida dos cegos | Primeiros auxilios | Crenzas respecto das persoas cegas | Crenzas das persoas cegas | O neno deficiente visual | Aspectos psicolóxicos da cegueira | Notas | Véxase tamén | Menú de navegación54.054.154.436928256blindnessDicionario da Real Academia GalegaPortal das Palabras"International Standards: Visual Standards — Aspects and Ranges of Vision Loss with Emphasis on Population Surveys.""Visual impairment and blindness""Presentan un plan para previr a cegueira"o orixinalACCDV Associació Catalana de Cecs i Disminuïts Visuals - PMFTrachoma"Effect of gene therapy on visual function in Leber's congenital amaurosis"1844137110.1056/NEJMoa0802268Cans guía - os mellores amigos dos cegosArquivadoEscola de cans guía para cegos en Mortágua, PortugalArquivado"Tecnología para ciegos y deficientes visuales. Recopilación de recursos gratuitos en la Red""Colorino""‘COL.diesis’, escuchar los sonidos del color""COL.diesis: Transforming Colour into Melody and Implementing the Result in a Colour Sensor Device"o orixinal"Sistema de desarrollo de sinestesia color-sonido para invidentes utilizando un protocolo de audio""Enseñanza táctil - geometría y color. Juegos didácticos para niños ciegos y videntes""Sistema Constanz"L'ocupació laboral dels cecs a l'Estat espanyol està pràcticament equiparada a la de les persones amb visió, entrevista amb Pedro ZuritaONCE (Organización Nacional de Cegos de España)Prevención da cegueiraDescrición de deficiencias visuais (Disc@pnet)Braillín, un boneco atractivo para calquera neno, con ou sen discapacidade, que permite familiarizarse co sistema de escritura e lectura brailleAxudas Técnicas36838ID00897494007150-90057129528256DOID:1432HP:0000618D001766C10.597.751.941.162C97109C0155020