What is the difference between a single precision floating point operation and double precision floating operation? I’m especially interested in practical terms in … Read more
I understand gcc’s –ffast-math flag can greatly increase speed for float ops, and goes outside of IEEE standards, but I can’t seem to … Read more
For clarity, if I’m using a language that implements IEE 754 floats and I declare: float f0 = 0.f; float f1 = 1.f; … Read more
I have a function taking float arguments (generally integers or decimals with one significant digit), and I need to output the values in … Read more
Here’s my code: x = 1.0 y = 100000.0 print x/y My quotient displays as 1.00000e-05. Is there any way to suppress scientific … Read more
I have a question about JUnit assertEquals to test double values. Reading the API doc I can see: @Deprecated public static void assertEquals(double … Read more
I am trying hard to compare two floating point numbers within a Bash script. I have two variables, e.g. let num1=3.17648e-22 let num2=1.5 … Read more
Today, I was looking through some C++ code (written by somebody else) and found this section: double someValue = … if (someValue < … Read more
A colleague of mine stumbled upon a method to floor float numbers using a bitwise or: var a = 13.6 | 0; //a … Read more
I need to format a float to “n”decimal places. was trying to BigDecimal, but the return value is not correct… public static float … Read more