floating-point Archives - Page 4 of 8

Why can’t decimal numbers be represented exactly in binary?

There have been several questions posted to SO about floating-point representation. For example, the decimal number 0.1 doesn’t have an exact binary representation, ...

May 16, 2022
0 Comments

Random float number generation

How do I generate random floats in C++? I thought I could take the integer rand and divide it by something, would that ...

May 16, 2022
0 Comments

Why does changing the sum order returns a different result?

Why does changing the sum order returns a different result? 23.53 + 5.88 + 17.64 = 47.05 23.53 + 17.64 + 5.88 = ...

May 16, 2022
0 Comments

Float vs Decimal in ActiveRecord

Sometimes, Activerecord data types confuse me. Err, often. One of my eternal questions is, for a given case, Should I use :decimal or ...

May 16, 2022
0 Comments

What MySQL data type should be used for Latitude/Longitude with 8 decimal places?

I’m working with map data, and the Latitude/Longitude extends to 8 decimal places. For example: Latitude 40.71727401 Longitude -74.00898606 I saw in the ...

May 16, 2022
0 Comments

Python JSON serialize a Decimal object

I have a Decimal('3.9') as part of an object, and wish to encode this to a JSON string which should look like {'x': ...

May 16, 2022
0 Comments

What does the constant 0.0039215689 represent?

I keep seeing this constant pop up in various graphics header files 0.0039215689 It seems to have something to do with color maybe? ...

May 15, 2022
0 Comments

Get decimal portion of a number with JavaScript

I have float numbers like 3.2 and 1.6. I need to separate the number into the integer and decimal part. For example, a ...

May 15, 2022
0 Comments

Convert floats to ints in Pandas?

I’ve been working with data imported from a CSV. Pandas changed some columns to float, so now the numbers in these columns get ...

May 15, 2022
0 Comments

What is the rationale for all comparisons returning false for IEEE754 NaN values?

Why do comparisons of NaN values behave differently from all other values? That is, all comparisons with the operators ==, <=, >=, <, ...

May 14, 2022
0 Comments