How do we explain the use of a software on a math paper?Computer Algebra ErrorsShould computer code be included within publications that present numerical results?Math paper authors' orderHow should the Math Subject Classification (MSC) be revised or improved?Applications of Math: Theory vs. PracticeAm I allowed to do non-rigorous numerical analysis?Non-computational software useful to mathematiciansDoes Pure Mathematics glue Science together?How to write an abstract for a math paper?Publication rates in MathematicsCan the Math 2.0 Forum's Closure be prevented?Should I publish a paper if its results overlap significantly with an earlier paper?

How do we explain the use of a software on a math paper?


Computer Algebra ErrorsShould computer code be included within publications that present numerical results?Math paper authors' orderHow should the Math Subject Classification (MSC) be revised or improved?Applications of Math: Theory vs. PracticeAm I allowed to do non-rigorous numerical analysis?Non-computational software useful to mathematiciansDoes Pure Mathematics glue Science together?How to write an abstract for a math paper?Publication rates in MathematicsCan the Math 2.0 Forum's Closure be prevented?Should I publish a paper if its results overlap significantly with an earlier paper?













20












$begingroup$


Suppose one has written a math/computer science paper that is more focused in the math part of it. I had a very complicated function and needed to find its maximum, so I used Mathematica (Wolfram) to do it. How do I explain that? "Using wolfram we find the maximum of $f$ to be $1.0328...$ therefore...".
It looks very sloppy.










share|cite|improve this question











$endgroup$







  • 33




    $begingroup$
    If that's how you did it, that's how you explain it. Of course, the non-believers in the capability of Wolfram Mathematica (like myself) will not consider the proof complete until they verify the statement by alternative means, but the "sloppiness" is not in the explanation but in the approach itself and you won't be able to eliminate it no matter what nice words you say. So, just be straight, concise, and to the point and let the others judge whether such computations are admissible or not for themselves.
    $endgroup$
    – fedja
    May 16 at 20:33






  • 3




    $begingroup$
    I would use Mathematica as more of a guide than rely on it entirely. The maximum that Mathematica gave to you is probably very accurate; as such, depending on the precision you need, you might try finding ways to bound your function above by $2$ (or $1.033$, etc.).
    $endgroup$
    – Clayton
    May 17 at 0:50






  • 4




    $begingroup$
    Related: Computer algebra errors: mathoverflow.net/questions/11517/computer-algebra-errors
    $endgroup$
    – joro
    May 17 at 9:53










  • $begingroup$
    @Clayton : If the command was NMaximize[], it is not infrequent that the supposedly near-optimal solutions it suggests are not even in the set of all feasible solutions. So, I don't think NMaximize[] can be trusted -- in contrast with Maximize[].
    $endgroup$
    – Iosif Pinelis
    May 17 at 13:42






  • 8




    $begingroup$
    To add to @fedja 's comment, one thing to do is to make your code available so that other people can check it. You can publish it as a Mathematica notebook or make it available for download on a website. That way, people can check what exactly you are doing and try to verify things using alternative methods.
    $endgroup$
    – Gabe K
    May 17 at 15:59















20












$begingroup$


Suppose one has written a math/computer science paper that is more focused in the math part of it. I had a very complicated function and needed to find its maximum, so I used Mathematica (Wolfram) to do it. How do I explain that? "Using wolfram we find the maximum of $f$ to be $1.0328...$ therefore...".
It looks very sloppy.










share|cite|improve this question











$endgroup$







  • 33




    $begingroup$
    If that's how you did it, that's how you explain it. Of course, the non-believers in the capability of Wolfram Mathematica (like myself) will not consider the proof complete until they verify the statement by alternative means, but the "sloppiness" is not in the explanation but in the approach itself and you won't be able to eliminate it no matter what nice words you say. So, just be straight, concise, and to the point and let the others judge whether such computations are admissible or not for themselves.
    $endgroup$
    – fedja
    May 16 at 20:33






  • 3




    $begingroup$
    I would use Mathematica as more of a guide than rely on it entirely. The maximum that Mathematica gave to you is probably very accurate; as such, depending on the precision you need, you might try finding ways to bound your function above by $2$ (or $1.033$, etc.).
    $endgroup$
    – Clayton
    May 17 at 0:50






  • 4




    $begingroup$
    Related: Computer algebra errors: mathoverflow.net/questions/11517/computer-algebra-errors
    $endgroup$
    – joro
    May 17 at 9:53










  • $begingroup$
    @Clayton : If the command was NMaximize[], it is not infrequent that the supposedly near-optimal solutions it suggests are not even in the set of all feasible solutions. So, I don't think NMaximize[] can be trusted -- in contrast with Maximize[].
    $endgroup$
    – Iosif Pinelis
    May 17 at 13:42






  • 8




    $begingroup$
    To add to @fedja 's comment, one thing to do is to make your code available so that other people can check it. You can publish it as a Mathematica notebook or make it available for download on a website. That way, people can check what exactly you are doing and try to verify things using alternative methods.
    $endgroup$
    – Gabe K
    May 17 at 15:59













20












20








20


7



$begingroup$


Suppose one has written a math/computer science paper that is more focused in the math part of it. I had a very complicated function and needed to find its maximum, so I used Mathematica (Wolfram) to do it. How do I explain that? "Using wolfram we find the maximum of $f$ to be $1.0328...$ therefore...".
It looks very sloppy.










share|cite|improve this question











$endgroup$




Suppose one has written a math/computer science paper that is more focused in the math part of it. I had a very complicated function and needed to find its maximum, so I used Mathematica (Wolfram) to do it. How do I explain that? "Using wolfram we find the maximum of $f$ to be $1.0328...$ therefore...".
It looks very sloppy.







soft-question mathematical-software mathematical-writing






share|cite|improve this question















share|cite|improve this question













share|cite|improve this question




share|cite|improve this question








edited May 18 at 16:45


























community wiki





4 revs, 4 users 50%
Pinteco








  • 33




    $begingroup$
    If that's how you did it, that's how you explain it. Of course, the non-believers in the capability of Wolfram Mathematica (like myself) will not consider the proof complete until they verify the statement by alternative means, but the "sloppiness" is not in the explanation but in the approach itself and you won't be able to eliminate it no matter what nice words you say. So, just be straight, concise, and to the point and let the others judge whether such computations are admissible or not for themselves.
    $endgroup$
    – fedja
    May 16 at 20:33






  • 3




    $begingroup$
    I would use Mathematica as more of a guide than rely on it entirely. The maximum that Mathematica gave to you is probably very accurate; as such, depending on the precision you need, you might try finding ways to bound your function above by $2$ (or $1.033$, etc.).
    $endgroup$
    – Clayton
    May 17 at 0:50






  • 4




    $begingroup$
    Related: Computer algebra errors: mathoverflow.net/questions/11517/computer-algebra-errors
    $endgroup$
    – joro
    May 17 at 9:53










  • $begingroup$
    @Clayton : If the command was NMaximize[], it is not infrequent that the supposedly near-optimal solutions it suggests are not even in the set of all feasible solutions. So, I don't think NMaximize[] can be trusted -- in contrast with Maximize[].
    $endgroup$
    – Iosif Pinelis
    May 17 at 13:42






  • 8




    $begingroup$
    To add to @fedja 's comment, one thing to do is to make your code available so that other people can check it. You can publish it as a Mathematica notebook or make it available for download on a website. That way, people can check what exactly you are doing and try to verify things using alternative methods.
    $endgroup$
    – Gabe K
    May 17 at 15:59












  • 33




    $begingroup$
    If that's how you did it, that's how you explain it. Of course, the non-believers in the capability of Wolfram Mathematica (like myself) will not consider the proof complete until they verify the statement by alternative means, but the "sloppiness" is not in the explanation but in the approach itself and you won't be able to eliminate it no matter what nice words you say. So, just be straight, concise, and to the point and let the others judge whether such computations are admissible or not for themselves.
    $endgroup$
    – fedja
    May 16 at 20:33






  • 3




    $begingroup$
    I would use Mathematica as more of a guide than rely on it entirely. The maximum that Mathematica gave to you is probably very accurate; as such, depending on the precision you need, you might try finding ways to bound your function above by $2$ (or $1.033$, etc.).
    $endgroup$
    – Clayton
    May 17 at 0:50






  • 4




    $begingroup$
    Related: Computer algebra errors: mathoverflow.net/questions/11517/computer-algebra-errors
    $endgroup$
    – joro
    May 17 at 9:53










  • $begingroup$
    @Clayton : If the command was NMaximize[], it is not infrequent that the supposedly near-optimal solutions it suggests are not even in the set of all feasible solutions. So, I don't think NMaximize[] can be trusted -- in contrast with Maximize[].
    $endgroup$
    – Iosif Pinelis
    May 17 at 13:42






  • 8




    $begingroup$
    To add to @fedja 's comment, one thing to do is to make your code available so that other people can check it. You can publish it as a Mathematica notebook or make it available for download on a website. That way, people can check what exactly you are doing and try to verify things using alternative methods.
    $endgroup$
    – Gabe K
    May 17 at 15:59







33




33




$begingroup$
If that's how you did it, that's how you explain it. Of course, the non-believers in the capability of Wolfram Mathematica (like myself) will not consider the proof complete until they verify the statement by alternative means, but the "sloppiness" is not in the explanation but in the approach itself and you won't be able to eliminate it no matter what nice words you say. So, just be straight, concise, and to the point and let the others judge whether such computations are admissible or not for themselves.
$endgroup$
– fedja
May 16 at 20:33




$begingroup$
If that's how you did it, that's how you explain it. Of course, the non-believers in the capability of Wolfram Mathematica (like myself) will not consider the proof complete until they verify the statement by alternative means, but the "sloppiness" is not in the explanation but in the approach itself and you won't be able to eliminate it no matter what nice words you say. So, just be straight, concise, and to the point and let the others judge whether such computations are admissible or not for themselves.
$endgroup$
– fedja
May 16 at 20:33




3




3




$begingroup$
I would use Mathematica as more of a guide than rely on it entirely. The maximum that Mathematica gave to you is probably very accurate; as such, depending on the precision you need, you might try finding ways to bound your function above by $2$ (or $1.033$, etc.).
$endgroup$
– Clayton
May 17 at 0:50




$begingroup$
I would use Mathematica as more of a guide than rely on it entirely. The maximum that Mathematica gave to you is probably very accurate; as such, depending on the precision you need, you might try finding ways to bound your function above by $2$ (or $1.033$, etc.).
$endgroup$
– Clayton
May 17 at 0:50




4




4




$begingroup$
Related: Computer algebra errors: mathoverflow.net/questions/11517/computer-algebra-errors
$endgroup$
– joro
May 17 at 9:53




$begingroup$
Related: Computer algebra errors: mathoverflow.net/questions/11517/computer-algebra-errors
$endgroup$
– joro
May 17 at 9:53












$begingroup$
@Clayton : If the command was NMaximize[], it is not infrequent that the supposedly near-optimal solutions it suggests are not even in the set of all feasible solutions. So, I don't think NMaximize[] can be trusted -- in contrast with Maximize[].
$endgroup$
– Iosif Pinelis
May 17 at 13:42




$begingroup$
@Clayton : If the command was NMaximize[], it is not infrequent that the supposedly near-optimal solutions it suggests are not even in the set of all feasible solutions. So, I don't think NMaximize[] can be trusted -- in contrast with Maximize[].
$endgroup$
– Iosif Pinelis
May 17 at 13:42




8




8




$begingroup$
To add to @fedja 's comment, one thing to do is to make your code available so that other people can check it. You can publish it as a Mathematica notebook or make it available for download on a website. That way, people can check what exactly you are doing and try to verify things using alternative methods.
$endgroup$
– Gabe K
May 17 at 15:59




$begingroup$
To add to @fedja 's comment, one thing to do is to make your code available so that other people can check it. You can publish it as a Mathematica notebook or make it available for download on a website. That way, people can check what exactly you are doing and try to verify things using alternative methods.
$endgroup$
– Gabe K
May 17 at 15:59










9 Answers
9






active

oldest

votes


















17












$begingroup$

Welcome to MO! I believe the answer to your question depends on what Mathematica command(s) you used to find the maximum.



If you used the command Maximize[], then its output is exact and, in my view, can in general be trusted no less than the work of about any human. A reason for this belief is that Maximize[] has probably been tested at least hundreds or thousands as many times as an average proof by an average mathematician.



Still, others may disagree with this comparison between human work and the outputs of commands such as Maximize[], and so, then you may have to try to obtain the maximum in a way that can be verified by hand. Also, of course, Maximize[] can only solve comparatively easy maximization problems.



On the other hand, if you just used the command NMaximize[] -- which tries to find the maximum numerically, then its output can only be considered a suggestion -- certainly not a proof.






share|cite|improve this answer











$endgroup$








  • 1




    $begingroup$
    @FrançoisBrunault : There is a command Interval[a1,b1,a2,b2,...] (giving the union of the intervals), and these interval objects can be the values of arguments of a function. This way, interval arithmetic is implemented.
    $endgroup$
    – Iosif Pinelis
    May 16 at 23:35







  • 19




    $begingroup$
    I’m one of those who would disagree that Mathematica can be “trusted no less than the work of about any human”. Mathematica absolutely has bugs, sometimes with embarrassingly simple inputs. I would at minimum cross-check with Sage/Maple/etc., if not actually verify mathematically.
    $endgroup$
    – wchargin
    May 17 at 2:42






  • 1




    $begingroup$
    According to the documentation reference.wolfram.com/language/guide/IntervalArithmetic.html Mathematica has interval arithmetic only for the basic functions.
    $endgroup$
    – François Brunault
    May 17 at 6:34






  • 9




    $begingroup$
    Previous command continued: (ii) To make a proper comparison between the work of humans and the output of Maximize[], you may want to recall that practically all mathematicians have made mistakes as well, sometimes in embarassingly simple situations, too.
    $endgroup$
    – Iosif Pinelis
    May 17 at 13:33






  • 1




    $begingroup$
    In the beginning of my "Previous command continued:" comment, I made an obvious and embarrassing mistake. Of course, I wanted to say "Previous comment continued:". :-) I guess I was tired talking about Mathematica commands.
    $endgroup$
    – Iosif Pinelis
    May 17 at 15:25


















14












$begingroup$

As is evident from the responses, different mathematicians have different attitudes towards computer calculations. If the computer calculation is not actually logically necessary for your proof, then it should be fine to say that you used Mathematica. Unfortunately (or fortunately, depending on your point of view), the world is rapidly progressing to the point where computers are actually needed to prove certain things. If a particular step in your proof requires a computation that consumes 1000 CPU hours then there is no way anyone is going to be able to "do it by hand." It doesn't sound like your computation was that large, but the point is that one is not always going to be able to sidestep the computer, and so the mathematical community needs to come up with a satisfactory approach to this sort of thing.



One approach, addressed in another MO question, is to archive or publish the computer software along with a paper. You might find some of the answers to that MO question useful. If you go this route, then I would recommend trying to perform the computation using some open-source software so that there is no problem with making the entire code publicly available.



Making the software available only addresses the issue of making your computation reproducible, and does not address the question of whether the computation is reliable. Again, assuming that the computer calculation is ineliminable, then formalizing the computation using a proof assistant (Coq, HOL Light, Lean, etc.) is the gold standard nowadays. Unfortunately, proof assistants are still not very user-friendly by the standards of the average mathematician. If you don't want to bite that bullet then probably the best you can do is to perform the calculations two or three times independently, using independent software and (preferably) a different person doing the programming. For a numerical calculation, as others have mentioned, it is important to use interval arithmetic or some other algorithm that guarantees correctness (assuming of course that the algorithm is implemented and executed correctly!). Floating-point computations are usually insufficient, according to commonly accepted standards of mathematical rigor.






share|cite|improve this answer











$endgroup$








  • 12




    $begingroup$
    I’d add that using open-source software is akin to publishing in an open access venue, while using e.g. Mathematica is akin to publishing something behind a permanent paywall.
    $endgroup$
    – Dima Pasechnik
    May 17 at 18:40






  • 3




    $begingroup$
    what is the balance of publishing in Elsevier journal, compared to publishing in a refereed arxiv.org-based journal? well, these without funds wont’t read you. Oh, but the Elsevier shareholders obviously would be happy...
    $endgroup$
    – Dima Pasechnik
    May 17 at 19:20







  • 2




    $begingroup$
    also, imagine for a moment Wolfram Inc stopping with Mathematica for some reason. then all this code would quickly become next to useless... just like texts written in ChiWriter...
    $endgroup$
    – Dima Pasechnik
    May 17 at 19:24






  • 4




    $begingroup$
    @DimaPasechnik : I don't see much relevance of the Elsevier/Springer/etc matter here. Also, in the event that Wolfram Inc stops Mathematica, there still will be a solution: to check the claims by using other software. However, I have rather seen cases when OSS gets abandoned. (As a practical matter, except for the developers, I think hardly anyone would ever check any part of the computer code itself, be it Mathematica or OSS).
    $endgroup$
    – Iosif Pinelis
    May 17 at 22:11






  • 1




    $begingroup$
    @IosifPinelis : If you read through the comments here mathoverflow.net/a/316177/3106 you will see that docker is at least a partial solution to the problem of the operating system being abandoned.
    $endgroup$
    – Timothy Chow
    May 17 at 23:28


















14












$begingroup$

The answer to this will differ from one field of math to another. In my opinion (I work primarily in combinatorics and algebraic geometry) a paper should contain enough data that the reader could verify its claims without relying on a particular software package, or should link to a repository of such data.



The main paper where this came up for me is Version 1 of my paper with Robert Kleinberg and Will Sawin. In Section 7 of this paper, we need to verify that a certain linear program, whose constant terms are polynomials in an algebraic number $rho$, is feasable. What we do in the paper is to find a solution point whose exact coordinates are polynomials in $rho$ and provide the reader with both those exact polynomials and with their numeric values to enough accuracy to confirm that it is a solution. The skeptical reader may use the exact formulas to verify that the equality conditions hold and may then compute the numerical values on their own to enough accuracy to check that the inequalities hold. We didn't provide the (quite hackish) Mathematica code which computed this witness data.



We printed the first few solutions in the paper and then uploaded a text file to the arXiv (see "Download Source" here) with more.



This material is missing from the final version of the paper, because a more general result was proved by Pebody and Norin. Otherwise we would have done something similar in the final paper; I don't know whether the journal would have wanted all the data in print, would have wanted to host the extra data themself, or just to keep it on the arXiv, but I would want to do one of these.






share|cite|improve this answer











$endgroup$




















    10












    $begingroup$

    25 years ago I published a paper where there were computer-based enumerations of certain combinatorial objects. Unfortunately I did not publish the code (in GAP, an OSS system) and it vanished after a place where I used to be a postdoc some years later shut down an ftp server with my files). Fortunately some results there were then verified by hand. Just a month ago I had to sit down and re-do these computations for the remaining cases, as someone asked for it. Fortunately it did not took too much time, and I even learned something new (and publishable).



    Anyhow, publish your code, and make it sufficiently clean to be understood years later...






    share|cite|improve this answer











    $endgroup$












    • $begingroup$
      I think we need to distinguish "computer aided proof" (your case) and "computer calculation" (OP's case). I support the former and regard it as a solid math proof, but I strongly oppose the latter as proof in any sense.
      $endgroup$
      – Hao Chen
      May 17 at 19:58











    • $begingroup$
      well, it is a computer calculation, what I did, using a relatively straightforward recursive search sped up by symmetry considerations (computing orbits).
      $endgroup$
      – Dima Pasechnik
      May 17 at 20:01






    • 1




      $begingroup$
      I also have papers where result depends on running numerical optimization - the answer however verifiable by cheap checking of optimality conditions (which basically only needs matrix arithmetic)
      $endgroup$
      – Dima Pasechnik
      May 17 at 20:04






    • 3




      $begingroup$
      I use "computer aided proof" for the case where a human set up a plan and computers do the work. This can then be verified by checking the plan and the implementation. I use "computer calculation" for the case where a human use a software, whose algorithm he does not read / not completely understand, just for an output.
      $endgroup$
      – Hao Chen
      May 17 at 20:06






    • 1




      $begingroup$
      @TimothyChow my requirements do not extend to compiler, OS or hardware, but let me explain. Fot a proof to be acceptable, there should be a purely logic possibility that any human being, given infinitely much time and enough knowledge, could work out every step of the algorithm. This is possible once the algorithm and the necessary knowledge is accessible. OS etc. doesn't matter here. But if aliens come with a machine that is said to do multiplication with a more advanced method that humans do not have access/understand, then mathematicians should not use this machine for any proof.
      $endgroup$
      – Hao Chen
      May 18 at 4:22


















    7












    $begingroup$

    Other answers and comments have made passing suggestions that you could perhaps consider making your code available. I think that that is far too weak: it is imperative that you should make your code available, and I would not accept your paper as an editor or referee if you did not do that. You should upload the code to the arxiv as a supplementary file, because that is a fairly reliable way to make sure that the original version remains available. You could also put it on github or a personal web page.






    share|cite|improve this answer











    $endgroup$








    • 2




      $begingroup$
      Personal web pages change frequently. Something more stable such as the arXiv seems much more desirable.
      $endgroup$
      – Andrés E. Caicedo
      May 18 at 18:08






    • 1




      $begingroup$
      @AndrésE.Caicedo Are we reading the same thing? It sounds like Neil Strickland is suggesting putting the code on the arXiv, and "also" possibly ("could") on a personal webpage/github. Presumably for ease of access – getting the source on arXiv is a bit annoying.
      $endgroup$
      – Najib Idrissi
      May 20 at 12:32











    • $begingroup$
      To clarify, I am suggesting that code could go on a personal web page as well as the arxiv, it would certainly not be satisfactory to have it only on a personal web page.
      $endgroup$
      – Neil Strickland
      May 20 at 14:54


















    5












    $begingroup$


    How do I explain that? "Using wolfram we find the maximum of $f$ to be $1.0328...$ therefore...". It looks very sloppy.




    Well, it looks sloppy because it kind of is sloppy by your description. Maybe the right framework for thinking about your question is to imagine that the maximization you are claiming is a component in a claimed proof of, say, the Riemann hypothesis. Would you pay serious attention to a paper containing such a claimed proof that purported to rely on an opaque software-based maximization without providing any code, let alone any guarantees that the code and the underlying software platform it runs on do what they say they do? I wouldn’t, nor do I expect any serious person to allow such a paper to be published.



    Now, I‘m guessing the problem your paper claims to solve isn’t as important as the Riemann hypothesis. The question of what authors of math papers can get away with and still get their paper published is distinct from the question of what authors should do as an ideal to aspire to that would make their paper’s claims truly convincing and watertight. People do get away with all kinds of minor (or even major) sloppiness, of the kinds you mention and of other kinds having nothing to do with the use of computers, all the time. I know I have. Nonetheless, since you seem to be asking about what is the “right” way to explain your result, the answer (assuming you are publishing what is meant to be a rigorous theorem with a proof that’s up to the standards of a good pure math journal) is: provide as many details about your claimed maximization as are needed to convince almost everyone in the research community of the validity of your claims.



    For myself, seeing your Mathematica code would be an absolute minimum to satisfy this condition. Depending on the precise nature of your calculations, I may also want to see that they satisfy some combination of the following conditions:



    • They are based on algorithms that have been around for a long time and everyone is sure are correct.

    • They are based on algorithms that have themselves been published in peer-reviewed journals.

    • They can be replicated with relative ease in software packages other than Mathematica.

    Hope this helps.






    share|cite|improve this answer











    $endgroup$




















      4












      $begingroup$

      What you did is a numerical investigation, so make a numerical claim, nothing more. It should not be claimed as a proposition, or be used as a step in a proof/argument. In particular, I don't like the "therefore" in your example. No matter how many times a numerical method has been tested, it is never a proof and should not be considered solid in the mathematical sense (except for, maybe, those symbolic or analytic result that can be verified by hand).



      In many cases of mathematics, the concrete number does not matter. You might be able to prove the existence of a maximum within a range (could be very hard). This is usually better (trustworthy and verifiable) than an actual number. In fact, we often need to prove the existence of a solution whose value has been known since long (recently been there ...)






      share|cite|improve this answer











      $endgroup$




















        2












        $begingroup$

        Did you try softwares doing rigorous numerical computation? For example arb is a C library freely available in Sage. Such software gives guaranteed enclosures $f(I) subset J$ where $I,J$ are intervals. So an obvious (but not necessarily optimal) algorithm for finding the maximum of your function $f:I to mathbbR$ is to subdivide your interval $I$ and apply $f$ to each subinterval, and keep subdividing until you get the maximal value to the precision you want. Personally I would judge this as rigorous and acceptable in a proof. This should work as long as the functions you need are present in arb, at worst the algorithm will be too slow.






        share|cite|improve this answer











        $endgroup$












        • $begingroup$
          I don't see how this is relevant.
          $endgroup$
          – Najib Idrissi
          May 20 at 12:33










        • $begingroup$
          @NajibIdrissi The OP did a computation using Mathematica, which is not rigorous in the usual mathematical sense (I'm not saying this function may have bugs, just that he's trying to maximize a function, so Mathematica uses floating-point numbers, which may cause some problems, see e.g. the first integral here: fredrikj.net/blog/2017/11/… ). Thus a natural thing to do is to use a software implementing floating point computations with rigorous bounds (this is usually called interval arithmetic).
          $endgroup$
          – François Brunault
          May 20 at 12:40











        • $begingroup$
          Mathematica doc: "If Maximize is given an expression containing approximate numbers, it automatically calls NMaximize".
          $endgroup$
          – François Brunault
          May 20 at 12:45










        • $begingroup$
          Sure, but that's not the question that was asked. The question was how to present results obtained (no matter the method) in a paper. I'm not sure why everyone jumped straight on the NMaximize bandwagon.
          $endgroup$
          – Najib Idrissi
          May 20 at 13:40











        • $begingroup$
          @NajibIdrissi If there is no way to present it in a paper because it is not rigorous enough (no matter the presentation), then I think this is a solution. At least this is my interpretation of the question that it was about presenting but also making things rigorous.
          $endgroup$
          – François Brunault
          May 20 at 13:42



















        -5












        $begingroup$

        Here is an example and here are details.






        share|cite|improve this answer











        $endgroup$












        • $begingroup$
          @ The downvoter: please base your vote. TIA.
          $endgroup$
          – user64494
          May 17 at 18:48






        • 14




          $begingroup$
          it was not me, but it is tempting, as it should be possible to understand what you are trying to say without following links.
          $endgroup$
          – Dima Pasechnik
          May 17 at 19:48






        • 3




          $begingroup$
          To add to what @DimaPasechnik and Alexey Ustinov said: even for someone willing to follow links, I don’t think providing an example with no explanation or discussion is particularly helpful. Especially (but, I suspect, not only) since the paper you linked to is in Russian and I am asked to pay $39.95 to download an English version.
          $endgroup$
          – Dan Romik
          May 20 at 7:18












        Your Answer








        StackExchange.ready(function()
        var channelOptions =
        tags: "".split(" "),
        id: "504"
        ;
        initTagRenderer("".split(" "), "".split(" "), channelOptions);

        StackExchange.using("externalEditor", function()
        // Have to fire editor after snippets, if snippets enabled
        if (StackExchange.settings.snippets.snippetsEnabled)
        StackExchange.using("snippets", function()
        createEditor();
        );

        else
        createEditor();

        );

        function createEditor()
        StackExchange.prepareEditor(
        heartbeatType: 'answer',
        autoActivateHeartbeat: false,
        convertImagesToLinks: true,
        noModals: true,
        showLowRepImageUploadWarning: true,
        reputationToPostImages: 10,
        bindNavPrevention: true,
        postfix: "",
        imageUploader:
        brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
        contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
        allowUrls: true
        ,
        noCode: true, onDemand: true,
        discardSelector: ".discard-answer"
        ,immediatelyShowMarkdownHelp:true
        );



        );













        draft saved

        draft discarded


















        StackExchange.ready(
        function ()
        StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmathoverflow.net%2fquestions%2f331728%2fhow-do-we-explain-the-use-of-a-software-on-a-math-paper%23new-answer', 'question_page');

        );

        Post as a guest















        Required, but never shown

























        9 Answers
        9






        active

        oldest

        votes








        9 Answers
        9






        active

        oldest

        votes









        active

        oldest

        votes






        active

        oldest

        votes









        17












        $begingroup$

        Welcome to MO! I believe the answer to your question depends on what Mathematica command(s) you used to find the maximum.



        If you used the command Maximize[], then its output is exact and, in my view, can in general be trusted no less than the work of about any human. A reason for this belief is that Maximize[] has probably been tested at least hundreds or thousands as many times as an average proof by an average mathematician.



        Still, others may disagree with this comparison between human work and the outputs of commands such as Maximize[], and so, then you may have to try to obtain the maximum in a way that can be verified by hand. Also, of course, Maximize[] can only solve comparatively easy maximization problems.



        On the other hand, if you just used the command NMaximize[] -- which tries to find the maximum numerically, then its output can only be considered a suggestion -- certainly not a proof.






        share|cite|improve this answer











        $endgroup$








        • 1




          $begingroup$
          @FrançoisBrunault : There is a command Interval[a1,b1,a2,b2,...] (giving the union of the intervals), and these interval objects can be the values of arguments of a function. This way, interval arithmetic is implemented.
          $endgroup$
          – Iosif Pinelis
          May 16 at 23:35







        • 19




          $begingroup$
          I’m one of those who would disagree that Mathematica can be “trusted no less than the work of about any human”. Mathematica absolutely has bugs, sometimes with embarrassingly simple inputs. I would at minimum cross-check with Sage/Maple/etc., if not actually verify mathematically.
          $endgroup$
          – wchargin
          May 17 at 2:42






        • 1




          $begingroup$
          According to the documentation reference.wolfram.com/language/guide/IntervalArithmetic.html Mathematica has interval arithmetic only for the basic functions.
          $endgroup$
          – François Brunault
          May 17 at 6:34






        • 9




          $begingroup$
          Previous command continued: (ii) To make a proper comparison between the work of humans and the output of Maximize[], you may want to recall that practically all mathematicians have made mistakes as well, sometimes in embarassingly simple situations, too.
          $endgroup$
          – Iosif Pinelis
          May 17 at 13:33






        • 1




          $begingroup$
          In the beginning of my "Previous command continued:" comment, I made an obvious and embarrassing mistake. Of course, I wanted to say "Previous comment continued:". :-) I guess I was tired talking about Mathematica commands.
          $endgroup$
          – Iosif Pinelis
          May 17 at 15:25















        17












        $begingroup$

        Welcome to MO! I believe the answer to your question depends on what Mathematica command(s) you used to find the maximum.



        If you used the command Maximize[], then its output is exact and, in my view, can in general be trusted no less than the work of about any human. A reason for this belief is that Maximize[] has probably been tested at least hundreds or thousands as many times as an average proof by an average mathematician.



        Still, others may disagree with this comparison between human work and the outputs of commands such as Maximize[], and so, then you may have to try to obtain the maximum in a way that can be verified by hand. Also, of course, Maximize[] can only solve comparatively easy maximization problems.



        On the other hand, if you just used the command NMaximize[] -- which tries to find the maximum numerically, then its output can only be considered a suggestion -- certainly not a proof.






        share|cite|improve this answer











        $endgroup$








        • 1




          $begingroup$
          @FrançoisBrunault : There is a command Interval[a1,b1,a2,b2,...] (giving the union of the intervals), and these interval objects can be the values of arguments of a function. This way, interval arithmetic is implemented.
          $endgroup$
          – Iosif Pinelis
          May 16 at 23:35







        • 19




          $begingroup$
          I’m one of those who would disagree that Mathematica can be “trusted no less than the work of about any human”. Mathematica absolutely has bugs, sometimes with embarrassingly simple inputs. I would at minimum cross-check with Sage/Maple/etc., if not actually verify mathematically.
          $endgroup$
          – wchargin
          May 17 at 2:42






        • 1




          $begingroup$
          According to the documentation reference.wolfram.com/language/guide/IntervalArithmetic.html Mathematica has interval arithmetic only for the basic functions.
          $endgroup$
          – François Brunault
          May 17 at 6:34






        • 9




          $begingroup$
          Previous command continued: (ii) To make a proper comparison between the work of humans and the output of Maximize[], you may want to recall that practically all mathematicians have made mistakes as well, sometimes in embarassingly simple situations, too.
          $endgroup$
          – Iosif Pinelis
          May 17 at 13:33






        • 1




          $begingroup$
          In the beginning of my "Previous command continued:" comment, I made an obvious and embarrassing mistake. Of course, I wanted to say "Previous comment continued:". :-) I guess I was tired talking about Mathematica commands.
          $endgroup$
          – Iosif Pinelis
          May 17 at 15:25













        17












        17








        17





        $begingroup$

        Welcome to MO! I believe the answer to your question depends on what Mathematica command(s) you used to find the maximum.



        If you used the command Maximize[], then its output is exact and, in my view, can in general be trusted no less than the work of about any human. A reason for this belief is that Maximize[] has probably been tested at least hundreds or thousands as many times as an average proof by an average mathematician.



        Still, others may disagree with this comparison between human work and the outputs of commands such as Maximize[], and so, then you may have to try to obtain the maximum in a way that can be verified by hand. Also, of course, Maximize[] can only solve comparatively easy maximization problems.



        On the other hand, if you just used the command NMaximize[] -- which tries to find the maximum numerically, then its output can only be considered a suggestion -- certainly not a proof.






        share|cite|improve this answer











        $endgroup$



        Welcome to MO! I believe the answer to your question depends on what Mathematica command(s) you used to find the maximum.



        If you used the command Maximize[], then its output is exact and, in my view, can in general be trusted no less than the work of about any human. A reason for this belief is that Maximize[] has probably been tested at least hundreds or thousands as many times as an average proof by an average mathematician.



        Still, others may disagree with this comparison between human work and the outputs of commands such as Maximize[], and so, then you may have to try to obtain the maximum in a way that can be verified by hand. Also, of course, Maximize[] can only solve comparatively easy maximization problems.



        On the other hand, if you just used the command NMaximize[] -- which tries to find the maximum numerically, then its output can only be considered a suggestion -- certainly not a proof.







        share|cite|improve this answer














        share|cite|improve this answer



        share|cite|improve this answer








        edited May 17 at 13:58


























        community wiki





        Iosif Pinelis








        • 1




          $begingroup$
          @FrançoisBrunault : There is a command Interval[a1,b1,a2,b2,...] (giving the union of the intervals), and these interval objects can be the values of arguments of a function. This way, interval arithmetic is implemented.
          $endgroup$
          – Iosif Pinelis
          May 16 at 23:35







        • 19




          $begingroup$
          I’m one of those who would disagree that Mathematica can be “trusted no less than the work of about any human”. Mathematica absolutely has bugs, sometimes with embarrassingly simple inputs. I would at minimum cross-check with Sage/Maple/etc., if not actually verify mathematically.
          $endgroup$
          – wchargin
          May 17 at 2:42






        • 1




          $begingroup$
          According to the documentation reference.wolfram.com/language/guide/IntervalArithmetic.html Mathematica has interval arithmetic only for the basic functions.
          $endgroup$
          – François Brunault
          May 17 at 6:34






        • 9




          $begingroup$
          Previous command continued: (ii) To make a proper comparison between the work of humans and the output of Maximize[], you may want to recall that practically all mathematicians have made mistakes as well, sometimes in embarassingly simple situations, too.
          $endgroup$
          – Iosif Pinelis
          May 17 at 13:33






        • 1




          $begingroup$
          In the beginning of my "Previous command continued:" comment, I made an obvious and embarrassing mistake. Of course, I wanted to say "Previous comment continued:". :-) I guess I was tired talking about Mathematica commands.
          $endgroup$
          – Iosif Pinelis
          May 17 at 15:25












        • 1




          $begingroup$
          @FrançoisBrunault : There is a command Interval[a1,b1,a2,b2,...] (giving the union of the intervals), and these interval objects can be the values of arguments of a function. This way, interval arithmetic is implemented.
          $endgroup$
          – Iosif Pinelis
          May 16 at 23:35







        • 19




          $begingroup$
          I’m one of those who would disagree that Mathematica can be “trusted no less than the work of about any human”. Mathematica absolutely has bugs, sometimes with embarrassingly simple inputs. I would at minimum cross-check with Sage/Maple/etc., if not actually verify mathematically.
          $endgroup$
          – wchargin
          May 17 at 2:42






        • 1




          $begingroup$
          According to the documentation reference.wolfram.com/language/guide/IntervalArithmetic.html Mathematica has interval arithmetic only for the basic functions.
          $endgroup$
          – François Brunault
          May 17 at 6:34






        • 9




          $begingroup$
          Previous command continued: (ii) To make a proper comparison between the work of humans and the output of Maximize[], you may want to recall that practically all mathematicians have made mistakes as well, sometimes in embarassingly simple situations, too.
          $endgroup$
          – Iosif Pinelis
          May 17 at 13:33






        • 1




          $begingroup$
          In the beginning of my "Previous command continued:" comment, I made an obvious and embarrassing mistake. Of course, I wanted to say "Previous comment continued:". :-) I guess I was tired talking about Mathematica commands.
          $endgroup$
          – Iosif Pinelis
          May 17 at 15:25







        1




        1




        $begingroup$
        @FrançoisBrunault : There is a command Interval[a1,b1,a2,b2,...] (giving the union of the intervals), and these interval objects can be the values of arguments of a function. This way, interval arithmetic is implemented.
        $endgroup$
        – Iosif Pinelis
        May 16 at 23:35





        $begingroup$
        @FrançoisBrunault : There is a command Interval[a1,b1,a2,b2,...] (giving the union of the intervals), and these interval objects can be the values of arguments of a function. This way, interval arithmetic is implemented.
        $endgroup$
        – Iosif Pinelis
        May 16 at 23:35





        19




        19




        $begingroup$
        I’m one of those who would disagree that Mathematica can be “trusted no less than the work of about any human”. Mathematica absolutely has bugs, sometimes with embarrassingly simple inputs. I would at minimum cross-check with Sage/Maple/etc., if not actually verify mathematically.
        $endgroup$
        – wchargin
        May 17 at 2:42




        $begingroup$
        I’m one of those who would disagree that Mathematica can be “trusted no less than the work of about any human”. Mathematica absolutely has bugs, sometimes with embarrassingly simple inputs. I would at minimum cross-check with Sage/Maple/etc., if not actually verify mathematically.
        $endgroup$
        – wchargin
        May 17 at 2:42




        1




        1




        $begingroup$
        According to the documentation reference.wolfram.com/language/guide/IntervalArithmetic.html Mathematica has interval arithmetic only for the basic functions.
        $endgroup$
        – François Brunault
        May 17 at 6:34




        $begingroup$
        According to the documentation reference.wolfram.com/language/guide/IntervalArithmetic.html Mathematica has interval arithmetic only for the basic functions.
        $endgroup$
        – François Brunault
        May 17 at 6:34




        9




        9




        $begingroup$
        Previous command continued: (ii) To make a proper comparison between the work of humans and the output of Maximize[], you may want to recall that practically all mathematicians have made mistakes as well, sometimes in embarassingly simple situations, too.
        $endgroup$
        – Iosif Pinelis
        May 17 at 13:33




        $begingroup$
        Previous command continued: (ii) To make a proper comparison between the work of humans and the output of Maximize[], you may want to recall that practically all mathematicians have made mistakes as well, sometimes in embarassingly simple situations, too.
        $endgroup$
        – Iosif Pinelis
        May 17 at 13:33




        1




        1




        $begingroup$
        In the beginning of my "Previous command continued:" comment, I made an obvious and embarrassing mistake. Of course, I wanted to say "Previous comment continued:". :-) I guess I was tired talking about Mathematica commands.
        $endgroup$
        – Iosif Pinelis
        May 17 at 15:25




        $begingroup$
        In the beginning of my "Previous command continued:" comment, I made an obvious and embarrassing mistake. Of course, I wanted to say "Previous comment continued:". :-) I guess I was tired talking about Mathematica commands.
        $endgroup$
        – Iosif Pinelis
        May 17 at 15:25











        14












        $begingroup$

        As is evident from the responses, different mathematicians have different attitudes towards computer calculations. If the computer calculation is not actually logically necessary for your proof, then it should be fine to say that you used Mathematica. Unfortunately (or fortunately, depending on your point of view), the world is rapidly progressing to the point where computers are actually needed to prove certain things. If a particular step in your proof requires a computation that consumes 1000 CPU hours then there is no way anyone is going to be able to "do it by hand." It doesn't sound like your computation was that large, but the point is that one is not always going to be able to sidestep the computer, and so the mathematical community needs to come up with a satisfactory approach to this sort of thing.



        One approach, addressed in another MO question, is to archive or publish the computer software along with a paper. You might find some of the answers to that MO question useful. If you go this route, then I would recommend trying to perform the computation using some open-source software so that there is no problem with making the entire code publicly available.



        Making the software available only addresses the issue of making your computation reproducible, and does not address the question of whether the computation is reliable. Again, assuming that the computer calculation is ineliminable, then formalizing the computation using a proof assistant (Coq, HOL Light, Lean, etc.) is the gold standard nowadays. Unfortunately, proof assistants are still not very user-friendly by the standards of the average mathematician. If you don't want to bite that bullet then probably the best you can do is to perform the calculations two or three times independently, using independent software and (preferably) a different person doing the programming. For a numerical calculation, as others have mentioned, it is important to use interval arithmetic or some other algorithm that guarantees correctness (assuming of course that the algorithm is implemented and executed correctly!). Floating-point computations are usually insufficient, according to commonly accepted standards of mathematical rigor.






        share|cite|improve this answer











        $endgroup$








        • 12




          $begingroup$
          I’d add that using open-source software is akin to publishing in an open access venue, while using e.g. Mathematica is akin to publishing something behind a permanent paywall.
          $endgroup$
          – Dima Pasechnik
          May 17 at 18:40






        • 3




          $begingroup$
          what is the balance of publishing in Elsevier journal, compared to publishing in a refereed arxiv.org-based journal? well, these without funds wont’t read you. Oh, but the Elsevier shareholders obviously would be happy...
          $endgroup$
          – Dima Pasechnik
          May 17 at 19:20







        • 2




          $begingroup$
          also, imagine for a moment Wolfram Inc stopping with Mathematica for some reason. then all this code would quickly become next to useless... just like texts written in ChiWriter...
          $endgroup$
          – Dima Pasechnik
          May 17 at 19:24






        • 4




          $begingroup$
          @DimaPasechnik : I don't see much relevance of the Elsevier/Springer/etc matter here. Also, in the event that Wolfram Inc stops Mathematica, there still will be a solution: to check the claims by using other software. However, I have rather seen cases when OSS gets abandoned. (As a practical matter, except for the developers, I think hardly anyone would ever check any part of the computer code itself, be it Mathematica or OSS).
          $endgroup$
          – Iosif Pinelis
          May 17 at 22:11






        • 1




          $begingroup$
          @IosifPinelis : If you read through the comments here mathoverflow.net/a/316177/3106 you will see that docker is at least a partial solution to the problem of the operating system being abandoned.
          $endgroup$
          – Timothy Chow
          May 17 at 23:28















        14












        $begingroup$

        As is evident from the responses, different mathematicians have different attitudes towards computer calculations. If the computer calculation is not actually logically necessary for your proof, then it should be fine to say that you used Mathematica. Unfortunately (or fortunately, depending on your point of view), the world is rapidly progressing to the point where computers are actually needed to prove certain things. If a particular step in your proof requires a computation that consumes 1000 CPU hours then there is no way anyone is going to be able to "do it by hand." It doesn't sound like your computation was that large, but the point is that one is not always going to be able to sidestep the computer, and so the mathematical community needs to come up with a satisfactory approach to this sort of thing.



        One approach, addressed in another MO question, is to archive or publish the computer software along with a paper. You might find some of the answers to that MO question useful. If you go this route, then I would recommend trying to perform the computation using some open-source software so that there is no problem with making the entire code publicly available.



        Making the software available only addresses the issue of making your computation reproducible, and does not address the question of whether the computation is reliable. Again, assuming that the computer calculation is ineliminable, then formalizing the computation using a proof assistant (Coq, HOL Light, Lean, etc.) is the gold standard nowadays. Unfortunately, proof assistants are still not very user-friendly by the standards of the average mathematician. If you don't want to bite that bullet then probably the best you can do is to perform the calculations two or three times independently, using independent software and (preferably) a different person doing the programming. For a numerical calculation, as others have mentioned, it is important to use interval arithmetic or some other algorithm that guarantees correctness (assuming of course that the algorithm is implemented and executed correctly!). Floating-point computations are usually insufficient, according to commonly accepted standards of mathematical rigor.






        share|cite|improve this answer











        $endgroup$








        • 12




          $begingroup$
          I’d add that using open-source software is akin to publishing in an open access venue, while using e.g. Mathematica is akin to publishing something behind a permanent paywall.
          $endgroup$
          – Dima Pasechnik
          May 17 at 18:40






        • 3




          $begingroup$
          what is the balance of publishing in Elsevier journal, compared to publishing in a refereed arxiv.org-based journal? well, these without funds wont’t read you. Oh, but the Elsevier shareholders obviously would be happy...
          $endgroup$
          – Dima Pasechnik
          May 17 at 19:20







        • 2




          $begingroup$
          also, imagine for a moment Wolfram Inc stopping with Mathematica for some reason. then all this code would quickly become next to useless... just like texts written in ChiWriter...
          $endgroup$
          – Dima Pasechnik
          May 17 at 19:24






        • 4




          $begingroup$
          @DimaPasechnik : I don't see much relevance of the Elsevier/Springer/etc matter here. Also, in the event that Wolfram Inc stops Mathematica, there still will be a solution: to check the claims by using other software. However, I have rather seen cases when OSS gets abandoned. (As a practical matter, except for the developers, I think hardly anyone would ever check any part of the computer code itself, be it Mathematica or OSS).
          $endgroup$
          – Iosif Pinelis
          May 17 at 22:11






        • 1




          $begingroup$
          @IosifPinelis : If you read through the comments here mathoverflow.net/a/316177/3106 you will see that docker is at least a partial solution to the problem of the operating system being abandoned.
          $endgroup$
          – Timothy Chow
          May 17 at 23:28













        14












        14








        14





        $begingroup$

        As is evident from the responses, different mathematicians have different attitudes towards computer calculations. If the computer calculation is not actually logically necessary for your proof, then it should be fine to say that you used Mathematica. Unfortunately (or fortunately, depending on your point of view), the world is rapidly progressing to the point where computers are actually needed to prove certain things. If a particular step in your proof requires a computation that consumes 1000 CPU hours then there is no way anyone is going to be able to "do it by hand." It doesn't sound like your computation was that large, but the point is that one is not always going to be able to sidestep the computer, and so the mathematical community needs to come up with a satisfactory approach to this sort of thing.



        One approach, addressed in another MO question, is to archive or publish the computer software along with a paper. You might find some of the answers to that MO question useful. If you go this route, then I would recommend trying to perform the computation using some open-source software so that there is no problem with making the entire code publicly available.



        Making the software available only addresses the issue of making your computation reproducible, and does not address the question of whether the computation is reliable. Again, assuming that the computer calculation is ineliminable, then formalizing the computation using a proof assistant (Coq, HOL Light, Lean, etc.) is the gold standard nowadays. Unfortunately, proof assistants are still not very user-friendly by the standards of the average mathematician. If you don't want to bite that bullet then probably the best you can do is to perform the calculations two or three times independently, using independent software and (preferably) a different person doing the programming. For a numerical calculation, as others have mentioned, it is important to use interval arithmetic or some other algorithm that guarantees correctness (assuming of course that the algorithm is implemented and executed correctly!). Floating-point computations are usually insufficient, according to commonly accepted standards of mathematical rigor.






        share|cite|improve this answer











        $endgroup$



        As is evident from the responses, different mathematicians have different attitudes towards computer calculations. If the computer calculation is not actually logically necessary for your proof, then it should be fine to say that you used Mathematica. Unfortunately (or fortunately, depending on your point of view), the world is rapidly progressing to the point where computers are actually needed to prove certain things. If a particular step in your proof requires a computation that consumes 1000 CPU hours then there is no way anyone is going to be able to "do it by hand." It doesn't sound like your computation was that large, but the point is that one is not always going to be able to sidestep the computer, and so the mathematical community needs to come up with a satisfactory approach to this sort of thing.



        One approach, addressed in another MO question, is to archive or publish the computer software along with a paper. You might find some of the answers to that MO question useful. If you go this route, then I would recommend trying to perform the computation using some open-source software so that there is no problem with making the entire code publicly available.



        Making the software available only addresses the issue of making your computation reproducible, and does not address the question of whether the computation is reliable. Again, assuming that the computer calculation is ineliminable, then formalizing the computation using a proof assistant (Coq, HOL Light, Lean, etc.) is the gold standard nowadays. Unfortunately, proof assistants are still not very user-friendly by the standards of the average mathematician. If you don't want to bite that bullet then probably the best you can do is to perform the calculations two or three times independently, using independent software and (preferably) a different person doing the programming. For a numerical calculation, as others have mentioned, it is important to use interval arithmetic or some other algorithm that guarantees correctness (assuming of course that the algorithm is implemented and executed correctly!). Floating-point computations are usually insufficient, according to commonly accepted standards of mathematical rigor.







        share|cite|improve this answer














        share|cite|improve this answer



        share|cite|improve this answer








        answered May 17 at 17:22


























        community wiki





        Timothy Chow








        • 12




          $begingroup$
          I’d add that using open-source software is akin to publishing in an open access venue, while using e.g. Mathematica is akin to publishing something behind a permanent paywall.
          $endgroup$
          – Dima Pasechnik
          May 17 at 18:40






        • 3




          $begingroup$
          what is the balance of publishing in Elsevier journal, compared to publishing in a refereed arxiv.org-based journal? well, these without funds wont’t read you. Oh, but the Elsevier shareholders obviously would be happy...
          $endgroup$
          – Dima Pasechnik
          May 17 at 19:20







        • 2




          $begingroup$
          also, imagine for a moment Wolfram Inc stopping with Mathematica for some reason. then all this code would quickly become next to useless... just like texts written in ChiWriter...
          $endgroup$
          – Dima Pasechnik
          May 17 at 19:24






        • 4




          $begingroup$
          @DimaPasechnik : I don't see much relevance of the Elsevier/Springer/etc matter here. Also, in the event that Wolfram Inc stops Mathematica, there still will be a solution: to check the claims by using other software. However, I have rather seen cases when OSS gets abandoned. (As a practical matter, except for the developers, I think hardly anyone would ever check any part of the computer code itself, be it Mathematica or OSS).
          $endgroup$
          – Iosif Pinelis
          May 17 at 22:11






        • 1




          $begingroup$
          @IosifPinelis : If you read through the comments here mathoverflow.net/a/316177/3106 you will see that docker is at least a partial solution to the problem of the operating system being abandoned.
          $endgroup$
          – Timothy Chow
          May 17 at 23:28












        • 12




          $begingroup$
          I’d add that using open-source software is akin to publishing in an open access venue, while using e.g. Mathematica is akin to publishing something behind a permanent paywall.
          $endgroup$
          – Dima Pasechnik
          May 17 at 18:40






        • 3




          $begingroup$
          what is the balance of publishing in Elsevier journal, compared to publishing in a refereed arxiv.org-based journal? well, these without funds wont’t read you. Oh, but the Elsevier shareholders obviously would be happy...
          $endgroup$
          – Dima Pasechnik
          May 17 at 19:20







        • 2




          $begingroup$
          also, imagine for a moment Wolfram Inc stopping with Mathematica for some reason. then all this code would quickly become next to useless... just like texts written in ChiWriter...
          $endgroup$
          – Dima Pasechnik
          May 17 at 19:24






        • 4




          $begingroup$
          @DimaPasechnik : I don't see much relevance of the Elsevier/Springer/etc matter here. Also, in the event that Wolfram Inc stops Mathematica, there still will be a solution: to check the claims by using other software. However, I have rather seen cases when OSS gets abandoned. (As a practical matter, except for the developers, I think hardly anyone would ever check any part of the computer code itself, be it Mathematica or OSS).
          $endgroup$
          – Iosif Pinelis
          May 17 at 22:11






        • 1




          $begingroup$
          @IosifPinelis : If you read through the comments here mathoverflow.net/a/316177/3106 you will see that docker is at least a partial solution to the problem of the operating system being abandoned.
          $endgroup$
          – Timothy Chow
          May 17 at 23:28







        12




        12




        $begingroup$
        I’d add that using open-source software is akin to publishing in an open access venue, while using e.g. Mathematica is akin to publishing something behind a permanent paywall.
        $endgroup$
        – Dima Pasechnik
        May 17 at 18:40




        $begingroup$
        I’d add that using open-source software is akin to publishing in an open access venue, while using e.g. Mathematica is akin to publishing something behind a permanent paywall.
        $endgroup$
        – Dima Pasechnik
        May 17 at 18:40




        3




        3




        $begingroup$
        what is the balance of publishing in Elsevier journal, compared to publishing in a refereed arxiv.org-based journal? well, these without funds wont’t read you. Oh, but the Elsevier shareholders obviously would be happy...
        $endgroup$
        – Dima Pasechnik
        May 17 at 19:20





        $begingroup$
        what is the balance of publishing in Elsevier journal, compared to publishing in a refereed arxiv.org-based journal? well, these without funds wont’t read you. Oh, but the Elsevier shareholders obviously would be happy...
        $endgroup$
        – Dima Pasechnik
        May 17 at 19:20





        2




        2




        $begingroup$
        also, imagine for a moment Wolfram Inc stopping with Mathematica for some reason. then all this code would quickly become next to useless... just like texts written in ChiWriter...
        $endgroup$
        – Dima Pasechnik
        May 17 at 19:24




        $begingroup$
        also, imagine for a moment Wolfram Inc stopping with Mathematica for some reason. then all this code would quickly become next to useless... just like texts written in ChiWriter...
        $endgroup$
        – Dima Pasechnik
        May 17 at 19:24




        4




        4




        $begingroup$
        @DimaPasechnik : I don't see much relevance of the Elsevier/Springer/etc matter here. Also, in the event that Wolfram Inc stops Mathematica, there still will be a solution: to check the claims by using other software. However, I have rather seen cases when OSS gets abandoned. (As a practical matter, except for the developers, I think hardly anyone would ever check any part of the computer code itself, be it Mathematica or OSS).
        $endgroup$
        – Iosif Pinelis
        May 17 at 22:11




        $begingroup$
        @DimaPasechnik : I don't see much relevance of the Elsevier/Springer/etc matter here. Also, in the event that Wolfram Inc stops Mathematica, there still will be a solution: to check the claims by using other software. However, I have rather seen cases when OSS gets abandoned. (As a practical matter, except for the developers, I think hardly anyone would ever check any part of the computer code itself, be it Mathematica or OSS).
        $endgroup$
        – Iosif Pinelis
        May 17 at 22:11




        1




        1




        $begingroup$
        @IosifPinelis : If you read through the comments here mathoverflow.net/a/316177/3106 you will see that docker is at least a partial solution to the problem of the operating system being abandoned.
        $endgroup$
        – Timothy Chow
        May 17 at 23:28




        $begingroup$
        @IosifPinelis : If you read through the comments here mathoverflow.net/a/316177/3106 you will see that docker is at least a partial solution to the problem of the operating system being abandoned.
        $endgroup$
        – Timothy Chow
        May 17 at 23:28











        14












        $begingroup$

        The answer to this will differ from one field of math to another. In my opinion (I work primarily in combinatorics and algebraic geometry) a paper should contain enough data that the reader could verify its claims without relying on a particular software package, or should link to a repository of such data.



        The main paper where this came up for me is Version 1 of my paper with Robert Kleinberg and Will Sawin. In Section 7 of this paper, we need to verify that a certain linear program, whose constant terms are polynomials in an algebraic number $rho$, is feasable. What we do in the paper is to find a solution point whose exact coordinates are polynomials in $rho$ and provide the reader with both those exact polynomials and with their numeric values to enough accuracy to confirm that it is a solution. The skeptical reader may use the exact formulas to verify that the equality conditions hold and may then compute the numerical values on their own to enough accuracy to check that the inequalities hold. We didn't provide the (quite hackish) Mathematica code which computed this witness data.



        We printed the first few solutions in the paper and then uploaded a text file to the arXiv (see "Download Source" here) with more.



        This material is missing from the final version of the paper, because a more general result was proved by Pebody and Norin. Otherwise we would have done something similar in the final paper; I don't know whether the journal would have wanted all the data in print, would have wanted to host the extra data themself, or just to keep it on the arXiv, but I would want to do one of these.






        share|cite|improve this answer











        $endgroup$

















          14












          $begingroup$

          The answer to this will differ from one field of math to another. In my opinion (I work primarily in combinatorics and algebraic geometry) a paper should contain enough data that the reader could verify its claims without relying on a particular software package, or should link to a repository of such data.



          The main paper where this came up for me is Version 1 of my paper with Robert Kleinberg and Will Sawin. In Section 7 of this paper, we need to verify that a certain linear program, whose constant terms are polynomials in an algebraic number $rho$, is feasable. What we do in the paper is to find a solution point whose exact coordinates are polynomials in $rho$ and provide the reader with both those exact polynomials and with their numeric values to enough accuracy to confirm that it is a solution. The skeptical reader may use the exact formulas to verify that the equality conditions hold and may then compute the numerical values on their own to enough accuracy to check that the inequalities hold. We didn't provide the (quite hackish) Mathematica code which computed this witness data.



          We printed the first few solutions in the paper and then uploaded a text file to the arXiv (see "Download Source" here) with more.



          This material is missing from the final version of the paper, because a more general result was proved by Pebody and Norin. Otherwise we would have done something similar in the final paper; I don't know whether the journal would have wanted all the data in print, would have wanted to host the extra data themself, or just to keep it on the arXiv, but I would want to do one of these.






          share|cite|improve this answer











          $endgroup$















            14












            14








            14





            $begingroup$

            The answer to this will differ from one field of math to another. In my opinion (I work primarily in combinatorics and algebraic geometry) a paper should contain enough data that the reader could verify its claims without relying on a particular software package, or should link to a repository of such data.



            The main paper where this came up for me is Version 1 of my paper with Robert Kleinberg and Will Sawin. In Section 7 of this paper, we need to verify that a certain linear program, whose constant terms are polynomials in an algebraic number $rho$, is feasable. What we do in the paper is to find a solution point whose exact coordinates are polynomials in $rho$ and provide the reader with both those exact polynomials and with their numeric values to enough accuracy to confirm that it is a solution. The skeptical reader may use the exact formulas to verify that the equality conditions hold and may then compute the numerical values on their own to enough accuracy to check that the inequalities hold. We didn't provide the (quite hackish) Mathematica code which computed this witness data.



            We printed the first few solutions in the paper and then uploaded a text file to the arXiv (see "Download Source" here) with more.



            This material is missing from the final version of the paper, because a more general result was proved by Pebody and Norin. Otherwise we would have done something similar in the final paper; I don't know whether the journal would have wanted all the data in print, would have wanted to host the extra data themself, or just to keep it on the arXiv, but I would want to do one of these.






            share|cite|improve this answer











            $endgroup$



            The answer to this will differ from one field of math to another. In my opinion (I work primarily in combinatorics and algebraic geometry) a paper should contain enough data that the reader could verify its claims without relying on a particular software package, or should link to a repository of such data.



            The main paper where this came up for me is Version 1 of my paper with Robert Kleinberg and Will Sawin. In Section 7 of this paper, we need to verify that a certain linear program, whose constant terms are polynomials in an algebraic number $rho$, is feasable. What we do in the paper is to find a solution point whose exact coordinates are polynomials in $rho$ and provide the reader with both those exact polynomials and with their numeric values to enough accuracy to confirm that it is a solution. The skeptical reader may use the exact formulas to verify that the equality conditions hold and may then compute the numerical values on their own to enough accuracy to check that the inequalities hold. We didn't provide the (quite hackish) Mathematica code which computed this witness data.



            We printed the first few solutions in the paper and then uploaded a text file to the arXiv (see "Download Source" here) with more.



            This material is missing from the final version of the paper, because a more general result was proved by Pebody and Norin. Otherwise we would have done something similar in the final paper; I don't know whether the journal would have wanted all the data in print, would have wanted to host the extra data themself, or just to keep it on the arXiv, but I would want to do one of these.







            share|cite|improve this answer














            share|cite|improve this answer



            share|cite|improve this answer








            edited May 17 at 17:26


























            community wiki





            David E Speyer






















                10












                $begingroup$

                25 years ago I published a paper where there were computer-based enumerations of certain combinatorial objects. Unfortunately I did not publish the code (in GAP, an OSS system) and it vanished after a place where I used to be a postdoc some years later shut down an ftp server with my files). Fortunately some results there were then verified by hand. Just a month ago I had to sit down and re-do these computations for the remaining cases, as someone asked for it. Fortunately it did not took too much time, and I even learned something new (and publishable).



                Anyhow, publish your code, and make it sufficiently clean to be understood years later...






                share|cite|improve this answer











                $endgroup$












                • $begingroup$
                  I think we need to distinguish "computer aided proof" (your case) and "computer calculation" (OP's case). I support the former and regard it as a solid math proof, but I strongly oppose the latter as proof in any sense.
                  $endgroup$
                  – Hao Chen
                  May 17 at 19:58











                • $begingroup$
                  well, it is a computer calculation, what I did, using a relatively straightforward recursive search sped up by symmetry considerations (computing orbits).
                  $endgroup$
                  – Dima Pasechnik
                  May 17 at 20:01






                • 1




                  $begingroup$
                  I also have papers where result depends on running numerical optimization - the answer however verifiable by cheap checking of optimality conditions (which basically only needs matrix arithmetic)
                  $endgroup$
                  – Dima Pasechnik
                  May 17 at 20:04






                • 3




                  $begingroup$
                  I use "computer aided proof" for the case where a human set up a plan and computers do the work. This can then be verified by checking the plan and the implementation. I use "computer calculation" for the case where a human use a software, whose algorithm he does not read / not completely understand, just for an output.
                  $endgroup$
                  – Hao Chen
                  May 17 at 20:06






                • 1




                  $begingroup$
                  @TimothyChow my requirements do not extend to compiler, OS or hardware, but let me explain. Fot a proof to be acceptable, there should be a purely logic possibility that any human being, given infinitely much time and enough knowledge, could work out every step of the algorithm. This is possible once the algorithm and the necessary knowledge is accessible. OS etc. doesn't matter here. But if aliens come with a machine that is said to do multiplication with a more advanced method that humans do not have access/understand, then mathematicians should not use this machine for any proof.
                  $endgroup$
                  – Hao Chen
                  May 18 at 4:22















                10












                $begingroup$

                25 years ago I published a paper where there were computer-based enumerations of certain combinatorial objects. Unfortunately I did not publish the code (in GAP, an OSS system) and it vanished after a place where I used to be a postdoc some years later shut down an ftp server with my files). Fortunately some results there were then verified by hand. Just a month ago I had to sit down and re-do these computations for the remaining cases, as someone asked for it. Fortunately it did not took too much time, and I even learned something new (and publishable).



                Anyhow, publish your code, and make it sufficiently clean to be understood years later...






                share|cite|improve this answer











                $endgroup$












                • $begingroup$
                  I think we need to distinguish "computer aided proof" (your case) and "computer calculation" (OP's case). I support the former and regard it as a solid math proof, but I strongly oppose the latter as proof in any sense.
                  $endgroup$
                  – Hao Chen
                  May 17 at 19:58











                • $begingroup$
                  well, it is a computer calculation, what I did, using a relatively straightforward recursive search sped up by symmetry considerations (computing orbits).
                  $endgroup$
                  – Dima Pasechnik
                  May 17 at 20:01






                • 1




                  $begingroup$
                  I also have papers where result depends on running numerical optimization - the answer however verifiable by cheap checking of optimality conditions (which basically only needs matrix arithmetic)
                  $endgroup$
                  – Dima Pasechnik
                  May 17 at 20:04






                • 3




                  $begingroup$
                  I use "computer aided proof" for the case where a human set up a plan and computers do the work. This can then be verified by checking the plan and the implementation. I use "computer calculation" for the case where a human use a software, whose algorithm he does not read / not completely understand, just for an output.
                  $endgroup$
                  – Hao Chen
                  May 17 at 20:06






                • 1




                  $begingroup$
                  @TimothyChow my requirements do not extend to compiler, OS or hardware, but let me explain. Fot a proof to be acceptable, there should be a purely logic possibility that any human being, given infinitely much time and enough knowledge, could work out every step of the algorithm. This is possible once the algorithm and the necessary knowledge is accessible. OS etc. doesn't matter here. But if aliens come with a machine that is said to do multiplication with a more advanced method that humans do not have access/understand, then mathematicians should not use this machine for any proof.
                  $endgroup$
                  – Hao Chen
                  May 18 at 4:22













                10












                10








                10





                $begingroup$

                25 years ago I published a paper where there were computer-based enumerations of certain combinatorial objects. Unfortunately I did not publish the code (in GAP, an OSS system) and it vanished after a place where I used to be a postdoc some years later shut down an ftp server with my files). Fortunately some results there were then verified by hand. Just a month ago I had to sit down and re-do these computations for the remaining cases, as someone asked for it. Fortunately it did not took too much time, and I even learned something new (and publishable).



                Anyhow, publish your code, and make it sufficiently clean to be understood years later...






                share|cite|improve this answer











                $endgroup$



                25 years ago I published a paper where there were computer-based enumerations of certain combinatorial objects. Unfortunately I did not publish the code (in GAP, an OSS system) and it vanished after a place where I used to be a postdoc some years later shut down an ftp server with my files). Fortunately some results there were then verified by hand. Just a month ago I had to sit down and re-do these computations for the remaining cases, as someone asked for it. Fortunately it did not took too much time, and I even learned something new (and publishable).



                Anyhow, publish your code, and make it sufficiently clean to be understood years later...







                share|cite|improve this answer














                share|cite|improve this answer



                share|cite|improve this answer








                answered May 17 at 19:46


























                community wiki





                Dima Pasechnik












                • $begingroup$
                  I think we need to distinguish "computer aided proof" (your case) and "computer calculation" (OP's case). I support the former and regard it as a solid math proof, but I strongly oppose the latter as proof in any sense.
                  $endgroup$
                  – Hao Chen
                  May 17 at 19:58











                • $begingroup$
                  well, it is a computer calculation, what I did, using a relatively straightforward recursive search sped up by symmetry considerations (computing orbits).
                  $endgroup$
                  – Dima Pasechnik
                  May 17 at 20:01






                • 1




                  $begingroup$
                  I also have papers where result depends on running numerical optimization - the answer however verifiable by cheap checking of optimality conditions (which basically only needs matrix arithmetic)
                  $endgroup$
                  – Dima Pasechnik
                  May 17 at 20:04






                • 3




                  $begingroup$
                  I use "computer aided proof" for the case where a human set up a plan and computers do the work. This can then be verified by checking the plan and the implementation. I use "computer calculation" for the case where a human use a software, whose algorithm he does not read / not completely understand, just for an output.
                  $endgroup$
                  – Hao Chen
                  May 17 at 20:06






                • 1




                  $begingroup$
                  @TimothyChow my requirements do not extend to compiler, OS or hardware, but let me explain. Fot a proof to be acceptable, there should be a purely logic possibility that any human being, given infinitely much time and enough knowledge, could work out every step of the algorithm. This is possible once the algorithm and the necessary knowledge is accessible. OS etc. doesn't matter here. But if aliens come with a machine that is said to do multiplication with a more advanced method that humans do not have access/understand, then mathematicians should not use this machine for any proof.
                  $endgroup$
                  – Hao Chen
                  May 18 at 4:22
















                • $begingroup$
                  I think we need to distinguish "computer aided proof" (your case) and "computer calculation" (OP's case). I support the former and regard it as a solid math proof, but I strongly oppose the latter as proof in any sense.
                  $endgroup$
                  – Hao Chen
                  May 17 at 19:58











                • $begingroup$
                  well, it is a computer calculation, what I did, using a relatively straightforward recursive search sped up by symmetry considerations (computing orbits).
                  $endgroup$
                  – Dima Pasechnik
                  May 17 at 20:01






                • 1




                  $begingroup$
                  I also have papers where result depends on running numerical optimization - the answer however verifiable by cheap checking of optimality conditions (which basically only needs matrix arithmetic)
                  $endgroup$
                  – Dima Pasechnik
                  May 17 at 20:04






                • 3




                  $begingroup$
                  I use "computer aided proof" for the case where a human set up a plan and computers do the work. This can then be verified by checking the plan and the implementation. I use "computer calculation" for the case where a human use a software, whose algorithm he does not read / not completely understand, just for an output.
                  $endgroup$
                  – Hao Chen
                  May 17 at 20:06






                • 1




                  $begingroup$
                  @TimothyChow my requirements do not extend to compiler, OS or hardware, but let me explain. Fot a proof to be acceptable, there should be a purely logic possibility that any human being, given infinitely much time and enough knowledge, could work out every step of the algorithm. This is possible once the algorithm and the necessary knowledge is accessible. OS etc. doesn't matter here. But if aliens come with a machine that is said to do multiplication with a more advanced method that humans do not have access/understand, then mathematicians should not use this machine for any proof.
                  $endgroup$
                  – Hao Chen
                  May 18 at 4:22















                $begingroup$
                I think we need to distinguish "computer aided proof" (your case) and "computer calculation" (OP's case). I support the former and regard it as a solid math proof, but I strongly oppose the latter as proof in any sense.
                $endgroup$
                – Hao Chen
                May 17 at 19:58





                $begingroup$
                I think we need to distinguish "computer aided proof" (your case) and "computer calculation" (OP's case). I support the former and regard it as a solid math proof, but I strongly oppose the latter as proof in any sense.
                $endgroup$
                – Hao Chen
                May 17 at 19:58













                $begingroup$
                well, it is a computer calculation, what I did, using a relatively straightforward recursive search sped up by symmetry considerations (computing orbits).
                $endgroup$
                – Dima Pasechnik
                May 17 at 20:01




                $begingroup$
                well, it is a computer calculation, what I did, using a relatively straightforward recursive search sped up by symmetry considerations (computing orbits).
                $endgroup$
                – Dima Pasechnik
                May 17 at 20:01




                1




                1




                $begingroup$
                I also have papers where result depends on running numerical optimization - the answer however verifiable by cheap checking of optimality conditions (which basically only needs matrix arithmetic)
                $endgroup$
                – Dima Pasechnik
                May 17 at 20:04




                $begingroup$
                I also have papers where result depends on running numerical optimization - the answer however verifiable by cheap checking of optimality conditions (which basically only needs matrix arithmetic)
                $endgroup$
                – Dima Pasechnik
                May 17 at 20:04




                3




                3




                $begingroup$
                I use "computer aided proof" for the case where a human set up a plan and computers do the work. This can then be verified by checking the plan and the implementation. I use "computer calculation" for the case where a human use a software, whose algorithm he does not read / not completely understand, just for an output.
                $endgroup$
                – Hao Chen
                May 17 at 20:06




                $begingroup$
                I use "computer aided proof" for the case where a human set up a plan and computers do the work. This can then be verified by checking the plan and the implementation. I use "computer calculation" for the case where a human use a software, whose algorithm he does not read / not completely understand, just for an output.
                $endgroup$
                – Hao Chen
                May 17 at 20:06




                1




                1




                $begingroup$
                @TimothyChow my requirements do not extend to compiler, OS or hardware, but let me explain. Fot a proof to be acceptable, there should be a purely logic possibility that any human being, given infinitely much time and enough knowledge, could work out every step of the algorithm. This is possible once the algorithm and the necessary knowledge is accessible. OS etc. doesn't matter here. But if aliens come with a machine that is said to do multiplication with a more advanced method that humans do not have access/understand, then mathematicians should not use this machine for any proof.
                $endgroup$
                – Hao Chen
                May 18 at 4:22




                $begingroup$
                @TimothyChow my requirements do not extend to compiler, OS or hardware, but let me explain. Fot a proof to be acceptable, there should be a purely logic possibility that any human being, given infinitely much time and enough knowledge, could work out every step of the algorithm. This is possible once the algorithm and the necessary knowledge is accessible. OS etc. doesn't matter here. But if aliens come with a machine that is said to do multiplication with a more advanced method that humans do not have access/understand, then mathematicians should not use this machine for any proof.
                $endgroup$
                – Hao Chen
                May 18 at 4:22











                7












                $begingroup$

                Other answers and comments have made passing suggestions that you could perhaps consider making your code available. I think that that is far too weak: it is imperative that you should make your code available, and I would not accept your paper as an editor or referee if you did not do that. You should upload the code to the arxiv as a supplementary file, because that is a fairly reliable way to make sure that the original version remains available. You could also put it on github or a personal web page.






                share|cite|improve this answer











                $endgroup$








                • 2




                  $begingroup$
                  Personal web pages change frequently. Something more stable such as the arXiv seems much more desirable.
                  $endgroup$
                  – Andrés E. Caicedo
                  May 18 at 18:08






                • 1




                  $begingroup$
                  @AndrésE.Caicedo Are we reading the same thing? It sounds like Neil Strickland is suggesting putting the code on the arXiv, and "also" possibly ("could") on a personal webpage/github. Presumably for ease of access – getting the source on arXiv is a bit annoying.
                  $endgroup$
                  – Najib Idrissi
                  May 20 at 12:32











                • $begingroup$
                  To clarify, I am suggesting that code could go on a personal web page as well as the arxiv, it would certainly not be satisfactory to have it only on a personal web page.
                  $endgroup$
                  – Neil Strickland
                  May 20 at 14:54















                7












                $begingroup$

                Other answers and comments have made passing suggestions that you could perhaps consider making your code available. I think that that is far too weak: it is imperative that you should make your code available, and I would not accept your paper as an editor or referee if you did not do that. You should upload the code to the arxiv as a supplementary file, because that is a fairly reliable way to make sure that the original version remains available. You could also put it on github or a personal web page.






                share|cite|improve this answer











                $endgroup$








                • 2




                  $begingroup$
                  Personal web pages change frequently. Something more stable such as the arXiv seems much more desirable.
                  $endgroup$
                  – Andrés E. Caicedo
                  May 18 at 18:08






                • 1




                  $begingroup$
                  @AndrésE.Caicedo Are we reading the same thing? It sounds like Neil Strickland is suggesting putting the code on the arXiv, and "also" possibly ("could") on a personal webpage/github. Presumably for ease of access – getting the source on arXiv is a bit annoying.
                  $endgroup$
                  – Najib Idrissi
                  May 20 at 12:32











                • $begingroup$
                  To clarify, I am suggesting that code could go on a personal web page as well as the arxiv, it would certainly not be satisfactory to have it only on a personal web page.
                  $endgroup$
                  – Neil Strickland
                  May 20 at 14:54













                7












                7








                7





                $begingroup$

                Other answers and comments have made passing suggestions that you could perhaps consider making your code available. I think that that is far too weak: it is imperative that you should make your code available, and I would not accept your paper as an editor or referee if you did not do that. You should upload the code to the arxiv as a supplementary file, because that is a fairly reliable way to make sure that the original version remains available. You could also put it on github or a personal web page.






                share|cite|improve this answer











                $endgroup$



                Other answers and comments have made passing suggestions that you could perhaps consider making your code available. I think that that is far too weak: it is imperative that you should make your code available, and I would not accept your paper as an editor or referee if you did not do that. You should upload the code to the arxiv as a supplementary file, because that is a fairly reliable way to make sure that the original version remains available. You could also put it on github or a personal web page.







                share|cite|improve this answer














                share|cite|improve this answer



                share|cite|improve this answer








                answered May 18 at 17:29


























                community wiki





                Neil Strickland








                • 2




                  $begingroup$
                  Personal web pages change frequently. Something more stable such as the arXiv seems much more desirable.
                  $endgroup$
                  – Andrés E. Caicedo
                  May 18 at 18:08






                • 1




                  $begingroup$
                  @AndrésE.Caicedo Are we reading the same thing? It sounds like Neil Strickland is suggesting putting the code on the arXiv, and "also" possibly ("could") on a personal webpage/github. Presumably for ease of access – getting the source on arXiv is a bit annoying.
                  $endgroup$
                  – Najib Idrissi
                  May 20 at 12:32











                • $begingroup$
                  To clarify, I am suggesting that code could go on a personal web page as well as the arxiv, it would certainly not be satisfactory to have it only on a personal web page.
                  $endgroup$
                  – Neil Strickland
                  May 20 at 14:54












                • 2




                  $begingroup$
                  Personal web pages change frequently. Something more stable such as the arXiv seems much more desirable.
                  $endgroup$
                  – Andrés E. Caicedo
                  May 18 at 18:08






                • 1




                  $begingroup$
                  @AndrésE.Caicedo Are we reading the same thing? It sounds like Neil Strickland is suggesting putting the code on the arXiv, and "also" possibly ("could") on a personal webpage/github. Presumably for ease of access – getting the source on arXiv is a bit annoying.
                  $endgroup$
                  – Najib Idrissi
                  May 20 at 12:32











                • $begingroup$
                  To clarify, I am suggesting that code could go on a personal web page as well as the arxiv, it would certainly not be satisfactory to have it only on a personal web page.
                  $endgroup$
                  – Neil Strickland
                  May 20 at 14:54







                2




                2




                $begingroup$
                Personal web pages change frequently. Something more stable such as the arXiv seems much more desirable.
                $endgroup$
                – Andrés E. Caicedo
                May 18 at 18:08




                $begingroup$
                Personal web pages change frequently. Something more stable such as the arXiv seems much more desirable.
                $endgroup$
                – Andrés E. Caicedo
                May 18 at 18:08




                1




                1




                $begingroup$
                @AndrésE.Caicedo Are we reading the same thing? It sounds like Neil Strickland is suggesting putting the code on the arXiv, and "also" possibly ("could") on a personal webpage/github. Presumably for ease of access – getting the source on arXiv is a bit annoying.
                $endgroup$
                – Najib Idrissi
                May 20 at 12:32





                $begingroup$
                @AndrésE.Caicedo Are we reading the same thing? It sounds like Neil Strickland is suggesting putting the code on the arXiv, and "also" possibly ("could") on a personal webpage/github. Presumably for ease of access – getting the source on arXiv is a bit annoying.
                $endgroup$
                – Najib Idrissi
                May 20 at 12:32













                $begingroup$
                To clarify, I am suggesting that code could go on a personal web page as well as the arxiv, it would certainly not be satisfactory to have it only on a personal web page.
                $endgroup$
                – Neil Strickland
                May 20 at 14:54




                $begingroup$
                To clarify, I am suggesting that code could go on a personal web page as well as the arxiv, it would certainly not be satisfactory to have it only on a personal web page.
                $endgroup$
                – Neil Strickland
                May 20 at 14:54











                5












                $begingroup$


                How do I explain that? "Using wolfram we find the maximum of $f$ to be $1.0328...$ therefore...". It looks very sloppy.




                Well, it looks sloppy because it kind of is sloppy by your description. Maybe the right framework for thinking about your question is to imagine that the maximization you are claiming is a component in a claimed proof of, say, the Riemann hypothesis. Would you pay serious attention to a paper containing such a claimed proof that purported to rely on an opaque software-based maximization without providing any code, let alone any guarantees that the code and the underlying software platform it runs on do what they say they do? I wouldn’t, nor do I expect any serious person to allow such a paper to be published.



                Now, I‘m guessing the problem your paper claims to solve isn’t as important as the Riemann hypothesis. The question of what authors of math papers can get away with and still get their paper published is distinct from the question of what authors should do as an ideal to aspire to that would make their paper’s claims truly convincing and watertight. People do get away with all kinds of minor (or even major) sloppiness, of the kinds you mention and of other kinds having nothing to do with the use of computers, all the time. I know I have. Nonetheless, since you seem to be asking about what is the “right” way to explain your result, the answer (assuming you are publishing what is meant to be a rigorous theorem with a proof that’s up to the standards of a good pure math journal) is: provide as many details about your claimed maximization as are needed to convince almost everyone in the research community of the validity of your claims.



                For myself, seeing your Mathematica code would be an absolute minimum to satisfy this condition. Depending on the precise nature of your calculations, I may also want to see that they satisfy some combination of the following conditions:



                • They are based on algorithms that have been around for a long time and everyone is sure are correct.

                • They are based on algorithms that have themselves been published in peer-reviewed journals.

                • They can be replicated with relative ease in software packages other than Mathematica.

                Hope this helps.






                share|cite|improve this answer











                $endgroup$

















                  5












                  $begingroup$


                  How do I explain that? "Using wolfram we find the maximum of $f$ to be $1.0328...$ therefore...". It looks very sloppy.




                  Well, it looks sloppy because it kind of is sloppy by your description. Maybe the right framework for thinking about your question is to imagine that the maximization you are claiming is a component in a claimed proof of, say, the Riemann hypothesis. Would you pay serious attention to a paper containing such a claimed proof that purported to rely on an opaque software-based maximization without providing any code, let alone any guarantees that the code and the underlying software platform it runs on do what they say they do? I wouldn’t, nor do I expect any serious person to allow such a paper to be published.



                  Now, I‘m guessing the problem your paper claims to solve isn’t as important as the Riemann hypothesis. The question of what authors of math papers can get away with and still get their paper published is distinct from the question of what authors should do as an ideal to aspire to that would make their paper’s claims truly convincing and watertight. People do get away with all kinds of minor (or even major) sloppiness, of the kinds you mention and of other kinds having nothing to do with the use of computers, all the time. I know I have. Nonetheless, since you seem to be asking about what is the “right” way to explain your result, the answer (assuming you are publishing what is meant to be a rigorous theorem with a proof that’s up to the standards of a good pure math journal) is: provide as many details about your claimed maximization as are needed to convince almost everyone in the research community of the validity of your claims.



                  For myself, seeing your Mathematica code would be an absolute minimum to satisfy this condition. Depending on the precise nature of your calculations, I may also want to see that they satisfy some combination of the following conditions:



                  • They are based on algorithms that have been around for a long time and everyone is sure are correct.

                  • They are based on algorithms that have themselves been published in peer-reviewed journals.

                  • They can be replicated with relative ease in software packages other than Mathematica.

                  Hope this helps.






                  share|cite|improve this answer











                  $endgroup$















                    5












                    5








                    5





                    $begingroup$


                    How do I explain that? "Using wolfram we find the maximum of $f$ to be $1.0328...$ therefore...". It looks very sloppy.




                    Well, it looks sloppy because it kind of is sloppy by your description. Maybe the right framework for thinking about your question is to imagine that the maximization you are claiming is a component in a claimed proof of, say, the Riemann hypothesis. Would you pay serious attention to a paper containing such a claimed proof that purported to rely on an opaque software-based maximization without providing any code, let alone any guarantees that the code and the underlying software platform it runs on do what they say they do? I wouldn’t, nor do I expect any serious person to allow such a paper to be published.



                    Now, I‘m guessing the problem your paper claims to solve isn’t as important as the Riemann hypothesis. The question of what authors of math papers can get away with and still get their paper published is distinct from the question of what authors should do as an ideal to aspire to that would make their paper’s claims truly convincing and watertight. People do get away with all kinds of minor (or even major) sloppiness, of the kinds you mention and of other kinds having nothing to do with the use of computers, all the time. I know I have. Nonetheless, since you seem to be asking about what is the “right” way to explain your result, the answer (assuming you are publishing what is meant to be a rigorous theorem with a proof that’s up to the standards of a good pure math journal) is: provide as many details about your claimed maximization as are needed to convince almost everyone in the research community of the validity of your claims.



                    For myself, seeing your Mathematica code would be an absolute minimum to satisfy this condition. Depending on the precise nature of your calculations, I may also want to see that they satisfy some combination of the following conditions:



                    • They are based on algorithms that have been around for a long time and everyone is sure are correct.

                    • They are based on algorithms that have themselves been published in peer-reviewed journals.

                    • They can be replicated with relative ease in software packages other than Mathematica.

                    Hope this helps.






                    share|cite|improve this answer











                    $endgroup$




                    How do I explain that? "Using wolfram we find the maximum of $f$ to be $1.0328...$ therefore...". It looks very sloppy.




                    Well, it looks sloppy because it kind of is sloppy by your description. Maybe the right framework for thinking about your question is to imagine that the maximization you are claiming is a component in a claimed proof of, say, the Riemann hypothesis. Would you pay serious attention to a paper containing such a claimed proof that purported to rely on an opaque software-based maximization without providing any code, let alone any guarantees that the code and the underlying software platform it runs on do what they say they do? I wouldn’t, nor do I expect any serious person to allow such a paper to be published.



                    Now, I‘m guessing the problem your paper claims to solve isn’t as important as the Riemann hypothesis. The question of what authors of math papers can get away with and still get their paper published is distinct from the question of what authors should do as an ideal to aspire to that would make their paper’s claims truly convincing and watertight. People do get away with all kinds of minor (or even major) sloppiness, of the kinds you mention and of other kinds having nothing to do with the use of computers, all the time. I know I have. Nonetheless, since you seem to be asking about what is the “right” way to explain your result, the answer (assuming you are publishing what is meant to be a rigorous theorem with a proof that’s up to the standards of a good pure math journal) is: provide as many details about your claimed maximization as are needed to convince almost everyone in the research community of the validity of your claims.



                    For myself, seeing your Mathematica code would be an absolute minimum to satisfy this condition. Depending on the precise nature of your calculations, I may also want to see that they satisfy some combination of the following conditions:



                    • They are based on algorithms that have been around for a long time and everyone is sure are correct.

                    • They are based on algorithms that have themselves been published in peer-reviewed journals.

                    • They can be replicated with relative ease in software packages other than Mathematica.

                    Hope this helps.







                    share|cite|improve this answer














                    share|cite|improve this answer



                    share|cite|improve this answer








                    answered May 20 at 6:38


























                    community wiki





                    Dan Romik






















                        4












                        $begingroup$

                        What you did is a numerical investigation, so make a numerical claim, nothing more. It should not be claimed as a proposition, or be used as a step in a proof/argument. In particular, I don't like the "therefore" in your example. No matter how many times a numerical method has been tested, it is never a proof and should not be considered solid in the mathematical sense (except for, maybe, those symbolic or analytic result that can be verified by hand).



                        In many cases of mathematics, the concrete number does not matter. You might be able to prove the existence of a maximum within a range (could be very hard). This is usually better (trustworthy and verifiable) than an actual number. In fact, we often need to prove the existence of a solution whose value has been known since long (recently been there ...)






                        share|cite|improve this answer











                        $endgroup$

















                          4












                          $begingroup$

                          What you did is a numerical investigation, so make a numerical claim, nothing more. It should not be claimed as a proposition, or be used as a step in a proof/argument. In particular, I don't like the "therefore" in your example. No matter how many times a numerical method has been tested, it is never a proof and should not be considered solid in the mathematical sense (except for, maybe, those symbolic or analytic result that can be verified by hand).



                          In many cases of mathematics, the concrete number does not matter. You might be able to prove the existence of a maximum within a range (could be very hard). This is usually better (trustworthy and verifiable) than an actual number. In fact, we often need to prove the existence of a solution whose value has been known since long (recently been there ...)






                          share|cite|improve this answer











                          $endgroup$















                            4












                            4








                            4





                            $begingroup$

                            What you did is a numerical investigation, so make a numerical claim, nothing more. It should not be claimed as a proposition, or be used as a step in a proof/argument. In particular, I don't like the "therefore" in your example. No matter how many times a numerical method has been tested, it is never a proof and should not be considered solid in the mathematical sense (except for, maybe, those symbolic or analytic result that can be verified by hand).



                            In many cases of mathematics, the concrete number does not matter. You might be able to prove the existence of a maximum within a range (could be very hard). This is usually better (trustworthy and verifiable) than an actual number. In fact, we often need to prove the existence of a solution whose value has been known since long (recently been there ...)






                            share|cite|improve this answer











                            $endgroup$



                            What you did is a numerical investigation, so make a numerical claim, nothing more. It should not be claimed as a proposition, or be used as a step in a proof/argument. In particular, I don't like the "therefore" in your example. No matter how many times a numerical method has been tested, it is never a proof and should not be considered solid in the mathematical sense (except for, maybe, those symbolic or analytic result that can be verified by hand).



                            In many cases of mathematics, the concrete number does not matter. You might be able to prove the existence of a maximum within a range (could be very hard). This is usually better (trustworthy and verifiable) than an actual number. In fact, we often need to prove the existence of a solution whose value has been known since long (recently been there ...)







                            share|cite|improve this answer














                            share|cite|improve this answer



                            share|cite|improve this answer








                            answered May 17 at 15:46


























                            community wiki





                            Hao Chen






















                                2












                                $begingroup$

                                Did you try softwares doing rigorous numerical computation? For example arb is a C library freely available in Sage. Such software gives guaranteed enclosures $f(I) subset J$ where $I,J$ are intervals. So an obvious (but not necessarily optimal) algorithm for finding the maximum of your function $f:I to mathbbR$ is to subdivide your interval $I$ and apply $f$ to each subinterval, and keep subdividing until you get the maximal value to the precision you want. Personally I would judge this as rigorous and acceptable in a proof. This should work as long as the functions you need are present in arb, at worst the algorithm will be too slow.






                                share|cite|improve this answer











                                $endgroup$












                                • $begingroup$
                                  I don't see how this is relevant.
                                  $endgroup$
                                  – Najib Idrissi
                                  May 20 at 12:33










                                • $begingroup$
                                  @NajibIdrissi The OP did a computation using Mathematica, which is not rigorous in the usual mathematical sense (I'm not saying this function may have bugs, just that he's trying to maximize a function, so Mathematica uses floating-point numbers, which may cause some problems, see e.g. the first integral here: fredrikj.net/blog/2017/11/… ). Thus a natural thing to do is to use a software implementing floating point computations with rigorous bounds (this is usually called interval arithmetic).
                                  $endgroup$
                                  – François Brunault
                                  May 20 at 12:40











                                • $begingroup$
                                  Mathematica doc: "If Maximize is given an expression containing approximate numbers, it automatically calls NMaximize".
                                  $endgroup$
                                  – François Brunault
                                  May 20 at 12:45










                                • $begingroup$
                                  Sure, but that's not the question that was asked. The question was how to present results obtained (no matter the method) in a paper. I'm not sure why everyone jumped straight on the NMaximize bandwagon.
                                  $endgroup$
                                  – Najib Idrissi
                                  May 20 at 13:40











                                • $begingroup$
                                  @NajibIdrissi If there is no way to present it in a paper because it is not rigorous enough (no matter the presentation), then I think this is a solution. At least this is my interpretation of the question that it was about presenting but also making things rigorous.
                                  $endgroup$
                                  – François Brunault
                                  May 20 at 13:42
















                                2












                                $begingroup$

                                Did you try softwares doing rigorous numerical computation? For example arb is a C library freely available in Sage. Such software gives guaranteed enclosures $f(I) subset J$ where $I,J$ are intervals. So an obvious (but not necessarily optimal) algorithm for finding the maximum of your function $f:I to mathbbR$ is to subdivide your interval $I$ and apply $f$ to each subinterval, and keep subdividing until you get the maximal value to the precision you want. Personally I would judge this as rigorous and acceptable in a proof. This should work as long as the functions you need are present in arb, at worst the algorithm will be too slow.






                                share|cite|improve this answer











                                $endgroup$












                                • $begingroup$
                                  I don't see how this is relevant.
                                  $endgroup$
                                  – Najib Idrissi
                                  May 20 at 12:33










                                • $begingroup$
                                  @NajibIdrissi The OP did a computation using Mathematica, which is not rigorous in the usual mathematical sense (I'm not saying this function may have bugs, just that he's trying to maximize a function, so Mathematica uses floating-point numbers, which may cause some problems, see e.g. the first integral here: fredrikj.net/blog/2017/11/… ). Thus a natural thing to do is to use a software implementing floating point computations with rigorous bounds (this is usually called interval arithmetic).
                                  $endgroup$
                                  – François Brunault
                                  May 20 at 12:40











                                • $begingroup$
                                  Mathematica doc: "If Maximize is given an expression containing approximate numbers, it automatically calls NMaximize".
                                  $endgroup$
                                  – François Brunault
                                  May 20 at 12:45










                                • $begingroup$
                                  Sure, but that's not the question that was asked. The question was how to present results obtained (no matter the method) in a paper. I'm not sure why everyone jumped straight on the NMaximize bandwagon.
                                  $endgroup$
                                  – Najib Idrissi
                                  May 20 at 13:40











                                • $begingroup$
                                  @NajibIdrissi If there is no way to present it in a paper because it is not rigorous enough (no matter the presentation), then I think this is a solution. At least this is my interpretation of the question that it was about presenting but also making things rigorous.
                                  $endgroup$
                                  – François Brunault
                                  May 20 at 13:42














                                2












                                2








                                2





                                $begingroup$

                                Did you try softwares doing rigorous numerical computation? For example arb is a C library freely available in Sage. Such software gives guaranteed enclosures $f(I) subset J$ where $I,J$ are intervals. So an obvious (but not necessarily optimal) algorithm for finding the maximum of your function $f:I to mathbbR$ is to subdivide your interval $I$ and apply $f$ to each subinterval, and keep subdividing until you get the maximal value to the precision you want. Personally I would judge this as rigorous and acceptable in a proof. This should work as long as the functions you need are present in arb, at worst the algorithm will be too slow.






                                share|cite|improve this answer











                                $endgroup$



                                Did you try softwares doing rigorous numerical computation? For example arb is a C library freely available in Sage. Such software gives guaranteed enclosures $f(I) subset J$ where $I,J$ are intervals. So an obvious (but not necessarily optimal) algorithm for finding the maximum of your function $f:I to mathbbR$ is to subdivide your interval $I$ and apply $f$ to each subinterval, and keep subdividing until you get the maximal value to the precision you want. Personally I would judge this as rigorous and acceptable in a proof. This should work as long as the functions you need are present in arb, at worst the algorithm will be too slow.







                                share|cite|improve this answer














                                share|cite|improve this answer



                                share|cite|improve this answer








                                answered May 18 at 19:36


























                                community wiki





                                François Brunault












                                • $begingroup$
                                  I don't see how this is relevant.
                                  $endgroup$
                                  – Najib Idrissi
                                  May 20 at 12:33










                                • $begingroup$
                                  @NajibIdrissi The OP did a computation using Mathematica, which is not rigorous in the usual mathematical sense (I'm not saying this function may have bugs, just that he's trying to maximize a function, so Mathematica uses floating-point numbers, which may cause some problems, see e.g. the first integral here: fredrikj.net/blog/2017/11/… ). Thus a natural thing to do is to use a software implementing floating point computations with rigorous bounds (this is usually called interval arithmetic).
                                  $endgroup$
                                  – François Brunault
                                  May 20 at 12:40











                                • $begingroup$
                                  Mathematica doc: "If Maximize is given an expression containing approximate numbers, it automatically calls NMaximize".
                                  $endgroup$
                                  – François Brunault
                                  May 20 at 12:45










                                • $begingroup$
                                  Sure, but that's not the question that was asked. The question was how to present results obtained (no matter the method) in a paper. I'm not sure why everyone jumped straight on the NMaximize bandwagon.
                                  $endgroup$
                                  – Najib Idrissi
                                  May 20 at 13:40











                                • $begingroup$
                                  @NajibIdrissi If there is no way to present it in a paper because it is not rigorous enough (no matter the presentation), then I think this is a solution. At least this is my interpretation of the question that it was about presenting but also making things rigorous.
                                  $endgroup$
                                  – François Brunault
                                  May 20 at 13:42

















                                • $begingroup$
                                  I don't see how this is relevant.
                                  $endgroup$
                                  – Najib Idrissi
                                  May 20 at 12:33










                                • $begingroup$
                                  @NajibIdrissi The OP did a computation using Mathematica, which is not rigorous in the usual mathematical sense (I'm not saying this function may have bugs, just that he's trying to maximize a function, so Mathematica uses floating-point numbers, which may cause some problems, see e.g. the first integral here: fredrikj.net/blog/2017/11/… ). Thus a natural thing to do is to use a software implementing floating point computations with rigorous bounds (this is usually called interval arithmetic).
                                  $endgroup$
                                  – François Brunault
                                  May 20 at 12:40











                                • $begingroup$
                                  Mathematica doc: "If Maximize is given an expression containing approximate numbers, it automatically calls NMaximize".
                                  $endgroup$
                                  – François Brunault
                                  May 20 at 12:45










                                • $begingroup$
                                  Sure, but that's not the question that was asked. The question was how to present results obtained (no matter the method) in a paper. I'm not sure why everyone jumped straight on the NMaximize bandwagon.
                                  $endgroup$
                                  – Najib Idrissi
                                  May 20 at 13:40











                                • $begingroup$
                                  @NajibIdrissi If there is no way to present it in a paper because it is not rigorous enough (no matter the presentation), then I think this is a solution. At least this is my interpretation of the question that it was about presenting but also making things rigorous.
                                  $endgroup$
                                  – François Brunault
                                  May 20 at 13:42
















                                $begingroup$
                                I don't see how this is relevant.
                                $endgroup$
                                – Najib Idrissi
                                May 20 at 12:33




                                $begingroup$
                                I don't see how this is relevant.
                                $endgroup$
                                – Najib Idrissi
                                May 20 at 12:33












                                $begingroup$
                                @NajibIdrissi The OP did a computation using Mathematica, which is not rigorous in the usual mathematical sense (I'm not saying this function may have bugs, just that he's trying to maximize a function, so Mathematica uses floating-point numbers, which may cause some problems, see e.g. the first integral here: fredrikj.net/blog/2017/11/… ). Thus a natural thing to do is to use a software implementing floating point computations with rigorous bounds (this is usually called interval arithmetic).
                                $endgroup$
                                – François Brunault
                                May 20 at 12:40





                                $begingroup$
                                @NajibIdrissi The OP did a computation using Mathematica, which is not rigorous in the usual mathematical sense (I'm not saying this function may have bugs, just that he's trying to maximize a function, so Mathematica uses floating-point numbers, which may cause some problems, see e.g. the first integral here: fredrikj.net/blog/2017/11/… ). Thus a natural thing to do is to use a software implementing floating point computations with rigorous bounds (this is usually called interval arithmetic).
                                $endgroup$
                                – François Brunault
                                May 20 at 12:40













                                $begingroup$
                                Mathematica doc: "If Maximize is given an expression containing approximate numbers, it automatically calls NMaximize".
                                $endgroup$
                                – François Brunault
                                May 20 at 12:45




                                $begingroup$
                                Mathematica doc: "If Maximize is given an expression containing approximate numbers, it automatically calls NMaximize".
                                $endgroup$
                                – François Brunault
                                May 20 at 12:45












                                $begingroup$
                                Sure, but that's not the question that was asked. The question was how to present results obtained (no matter the method) in a paper. I'm not sure why everyone jumped straight on the NMaximize bandwagon.
                                $endgroup$
                                – Najib Idrissi
                                May 20 at 13:40





                                $begingroup$
                                Sure, but that's not the question that was asked. The question was how to present results obtained (no matter the method) in a paper. I'm not sure why everyone jumped straight on the NMaximize bandwagon.
                                $endgroup$
                                – Najib Idrissi
                                May 20 at 13:40













                                $begingroup$
                                @NajibIdrissi If there is no way to present it in a paper because it is not rigorous enough (no matter the presentation), then I think this is a solution. At least this is my interpretation of the question that it was about presenting but also making things rigorous.
                                $endgroup$
                                – François Brunault
                                May 20 at 13:42





                                $begingroup$
                                @NajibIdrissi If there is no way to present it in a paper because it is not rigorous enough (no matter the presentation), then I think this is a solution. At least this is my interpretation of the question that it was about presenting but also making things rigorous.
                                $endgroup$
                                – François Brunault
                                May 20 at 13:42












                                -5












                                $begingroup$

                                Here is an example and here are details.






                                share|cite|improve this answer











                                $endgroup$












                                • $begingroup$
                                  @ The downvoter: please base your vote. TIA.
                                  $endgroup$
                                  – user64494
                                  May 17 at 18:48






                                • 14




                                  $begingroup$
                                  it was not me, but it is tempting, as it should be possible to understand what you are trying to say without following links.
                                  $endgroup$
                                  – Dima Pasechnik
                                  May 17 at 19:48






                                • 3




                                  $begingroup$
                                  To add to what @DimaPasechnik and Alexey Ustinov said: even for someone willing to follow links, I don’t think providing an example with no explanation or discussion is particularly helpful. Especially (but, I suspect, not only) since the paper you linked to is in Russian and I am asked to pay $39.95 to download an English version.
                                  $endgroup$
                                  – Dan Romik
                                  May 20 at 7:18
















                                -5












                                $begingroup$

                                Here is an example and here are details.






                                share|cite|improve this answer











                                $endgroup$












                                • $begingroup$
                                  @ The downvoter: please base your vote. TIA.
                                  $endgroup$
                                  – user64494
                                  May 17 at 18:48






                                • 14




                                  $begingroup$
                                  it was not me, but it is tempting, as it should be possible to understand what you are trying to say without following links.
                                  $endgroup$
                                  – Dima Pasechnik
                                  May 17 at 19:48






                                • 3




                                  $begingroup$
                                  To add to what @DimaPasechnik and Alexey Ustinov said: even for someone willing to follow links, I don’t think providing an example with no explanation or discussion is particularly helpful. Especially (but, I suspect, not only) since the paper you linked to is in Russian and I am asked to pay $39.95 to download an English version.
                                  $endgroup$
                                  – Dan Romik
                                  May 20 at 7:18














                                -5












                                -5








                                -5





                                $begingroup$

                                Here is an example and here are details.






                                share|cite|improve this answer











                                $endgroup$



                                Here is an example and here are details.







                                share|cite|improve this answer














                                share|cite|improve this answer



                                share|cite|improve this answer








                                answered May 17 at 18:32


























                                community wiki





                                user64494












                                • $begingroup$
                                  @ The downvoter: please base your vote. TIA.
                                  $endgroup$
                                  – user64494
                                  May 17 at 18:48






                                • 14




                                  $begingroup$
                                  it was not me, but it is tempting, as it should be possible to understand what you are trying to say without following links.
                                  $endgroup$
                                  – Dima Pasechnik
                                  May 17 at 19:48






                                • 3




                                  $begingroup$
                                  To add to what @DimaPasechnik and Alexey Ustinov said: even for someone willing to follow links, I don’t think providing an example with no explanation or discussion is particularly helpful. Especially (but, I suspect, not only) since the paper you linked to is in Russian and I am asked to pay $39.95 to download an English version.
                                  $endgroup$
                                  – Dan Romik
                                  May 20 at 7:18

















                                • $begingroup$
                                  @ The downvoter: please base your vote. TIA.
                                  $endgroup$
                                  – user64494
                                  May 17 at 18:48






                                • 14




                                  $begingroup$
                                  it was not me, but it is tempting, as it should be possible to understand what you are trying to say without following links.
                                  $endgroup$
                                  – Dima Pasechnik
                                  May 17 at 19:48






                                • 3




                                  $begingroup$
                                  To add to what @DimaPasechnik and Alexey Ustinov said: even for someone willing to follow links, I don’t think providing an example with no explanation or discussion is particularly helpful. Especially (but, I suspect, not only) since the paper you linked to is in Russian and I am asked to pay $39.95 to download an English version.
                                  $endgroup$
                                  – Dan Romik
                                  May 20 at 7:18
















                                $begingroup$
                                @ The downvoter: please base your vote. TIA.
                                $endgroup$
                                – user64494
                                May 17 at 18:48




                                $begingroup$
                                @ The downvoter: please base your vote. TIA.
                                $endgroup$
                                – user64494
                                May 17 at 18:48




                                14




                                14




                                $begingroup$
                                it was not me, but it is tempting, as it should be possible to understand what you are trying to say without following links.
                                $endgroup$
                                – Dima Pasechnik
                                May 17 at 19:48




                                $begingroup$
                                it was not me, but it is tempting, as it should be possible to understand what you are trying to say without following links.
                                $endgroup$
                                – Dima Pasechnik
                                May 17 at 19:48




                                3




                                3




                                $begingroup$
                                To add to what @DimaPasechnik and Alexey Ustinov said: even for someone willing to follow links, I don’t think providing an example with no explanation or discussion is particularly helpful. Especially (but, I suspect, not only) since the paper you linked to is in Russian and I am asked to pay $39.95 to download an English version.
                                $endgroup$
                                – Dan Romik
                                May 20 at 7:18





                                $begingroup$
                                To add to what @DimaPasechnik and Alexey Ustinov said: even for someone willing to follow links, I don’t think providing an example with no explanation or discussion is particularly helpful. Especially (but, I suspect, not only) since the paper you linked to is in Russian and I am asked to pay $39.95 to download an English version.
                                $endgroup$
                                – Dan Romik
                                May 20 at 7:18


















                                draft saved

                                draft discarded
















































                                Thanks for contributing an answer to MathOverflow!


                                • Please be sure to answer the question. Provide details and share your research!

                                But avoid


                                • Asking for help, clarification, or responding to other answers.

                                • Making statements based on opinion; back them up with references or personal experience.

                                Use MathJax to format equations. MathJax reference.


                                To learn more, see our tips on writing great answers.




                                draft saved


                                draft discarded














                                StackExchange.ready(
                                function ()
                                StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmathoverflow.net%2fquestions%2f331728%2fhow-do-we-explain-the-use-of-a-software-on-a-math-paper%23new-answer', 'question_page');

                                );

                                Post as a guest















                                Required, but never shown





















































                                Required, but never shown














                                Required, but never shown












                                Required, but never shown







                                Required, but never shown

































                                Required, but never shown














                                Required, but never shown












                                Required, but never shown







                                Required, but never shown







                                Popular posts from this blog

                                Club Baloncesto Breogán Índice Historia | Pavillón | Nome | O Breogán na cultura popular | Xogadores | Adestradores | Presidentes | Palmarés | Historial | Líderes | Notas | Véxase tamén | Menú de navegacióncbbreogan.galCadroGuía oficial da ACB 2009-10, páxina 201Guía oficial ACB 1992, páxina 183. Editorial DB.É de 6.500 espectadores sentados axeitándose á última normativa"Estudiantes Junior, entre as mellores canteiras"o orixinalHemeroteca El Mundo Deportivo, 16 setembro de 1970, páxina 12Historia do BreogánAlfredo Pérez, o último canoneiroHistoria C.B. BreogánHemeroteca de El Mundo DeportivoJimmy Wright, norteamericano do Breogán deixará Lugo por ameazas de morteResultados de Breogán en 1986-87Resultados de Breogán en 1990-91Ficha de Velimir Perasović en acb.comResultados de Breogán en 1994-95Breogán arrasa al Barça. "El Mundo Deportivo", 27 de setembro de 1999, páxina 58CB Breogán - FC BarcelonaA FEB invita a participar nunha nova Liga EuropeaCharlie Bell na prensa estatalMáximos anotadores 2005Tempada 2005-06 : Tódolos Xogadores da Xornada""Non quero pensar nunha man negra, mais pregúntome que está a pasar""o orixinalRaúl López, orgulloso dos xogadores, presume da boa saúde económica do BreogánJulio González confirma que cesa como presidente del BreogánHomenaxe a Lisardo GómezA tempada do rexurdimento celesteEntrevista a Lisardo GómezEl COB dinamita el Pazo para forzar el quinto (69-73)Cafés Candelas, patrocinador del CB Breogán"Suso Lázare, novo presidente do Breogán"o orixinalCafés Candelas Breogán firma el mayor triunfo de la historiaEl Breogán realizará 17 homenajes por su cincuenta aniversario"O Breogán honra ao seu fundador e primeiro presidente"o orixinalMiguel Giao recibiu a homenaxe do PazoHomenaxe aos primeiros gladiadores celestesO home que nos amosa como ver o Breo co corazónTita Franco será homenaxeada polos #50anosdeBreoJulio Vila recibirá unha homenaxe in memoriam polos #50anosdeBreo"O Breogán homenaxeará aos seus aboados máis veteráns"Pechada ovación a «Capi» Sanmartín e Ricardo «Corazón de González»Homenaxe por décadas de informaciónPaco García volve ao Pazo con motivo do 50 aniversario"Resultados y clasificaciones""O Cafés Candelas Breogán, campión da Copa Princesa""O Cafés Candelas Breogán, equipo ACB"C.B. Breogán"Proxecto social"o orixinal"Centros asociados"o orixinalFicha en imdb.comMario Camus trata la recuperación del amor en 'La vieja música', su última película"Páxina web oficial""Club Baloncesto Breogán""C. B. Breogán S.A.D."eehttp://www.fegaba.com

                                Vilaño, A Laracha Índice Patrimonio | Lugares e parroquias | Véxase tamén | Menú de navegación43°14′52″N 8°36′03″O / 43.24775, -8.60070

                                Cegueira Índice Epidemioloxía | Deficiencia visual | Tipos de cegueira | Principais causas de cegueira | Tratamento | Técnicas de adaptación e axudas | Vida dos cegos | Primeiros auxilios | Crenzas respecto das persoas cegas | Crenzas das persoas cegas | O neno deficiente visual | Aspectos psicolóxicos da cegueira | Notas | Véxase tamén | Menú de navegación54.054.154.436928256blindnessDicionario da Real Academia GalegaPortal das Palabras"International Standards: Visual Standards — Aspects and Ranges of Vision Loss with Emphasis on Population Surveys.""Visual impairment and blindness""Presentan un plan para previr a cegueira"o orixinalACCDV Associació Catalana de Cecs i Disminuïts Visuals - PMFTrachoma"Effect of gene therapy on visual function in Leber's congenital amaurosis"1844137110.1056/NEJMoa0802268Cans guía - os mellores amigos dos cegosArquivadoEscola de cans guía para cegos en Mortágua, PortugalArquivado"Tecnología para ciegos y deficientes visuales. Recopilación de recursos gratuitos en la Red""Colorino""‘COL.diesis’, escuchar los sonidos del color""COL.diesis: Transforming Colour into Melody and Implementing the Result in a Colour Sensor Device"o orixinal"Sistema de desarrollo de sinestesia color-sonido para invidentes utilizando un protocolo de audio""Enseñanza táctil - geometría y color. Juegos didácticos para niños ciegos y videntes""Sistema Constanz"L'ocupació laboral dels cecs a l'Estat espanyol està pràcticament equiparada a la de les persones amb visió, entrevista amb Pedro ZuritaONCE (Organización Nacional de Cegos de España)Prevención da cegueiraDescrición de deficiencias visuais (Disc@pnet)Braillín, un boneco atractivo para calquera neno, con ou sen discapacidade, que permite familiarizarse co sistema de escritura e lectura brailleAxudas Técnicas36838ID00897494007150-90057129528256DOID:1432HP:0000618D001766C10.597.751.941.162C97109C0155020