aspose file tools*
The moose likes Beginning Java and the fly likes Rounding problems (maths) Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


Win a copy of EJB 3 in Action this week in the EJB and other Java EE Technologies forum!
JavaRanch » Java Forums » Java » Beginning Java
Bookmark "Rounding problems (maths)" Watch "Rounding problems (maths)" New topic
Author

Rounding problems (maths)

merlin bar
Ranch Hand

Joined: Feb 16, 2003
Posts: 54
my method takes two arguments
(int maxCapacity, int currentCapacity )
so if a 100 litre tank is half full, you do
(100, 50)
However, I want to convert this scale to a 0 - 75 scale. Rounding errors are giving me hell. Can anyone help?
This doesnt work for me.
float asInverseFraction = capacity/level + (capacity%level)/100;
Thanks in advance,
merlin


Regards,<br /> merlin_bar
merlin bar
Ranch Hand

Joined: Feb 16, 2003
Posts: 54
Erm, that wasnt very clear. Heres the code:

[ edited to better format code -ds ]
[ December 07, 2003: Message edited by: Dirk Schreckmann ]
Dirk Schreckmann
Sheriff

Joined: Dec 10, 2001
Posts: 7023
Rounding errors are giving me hell.
What do you mean?


[How To Ask Good Questions] [JavaRanch FAQ Wiki] [JavaRanch Radio]
merlin bar
Ranch Hand

Joined: Feb 16, 2003
Posts: 54
OK, my method takes the max value possible, and the actual value within this limit.
TotalCapacity / currentVolume omits the remainder so I dont get a proper ratio.
Eg
100 / 75 = 1 //in java
if I do 100 % 75 I get 25.
The correct answer for 100 / 75 is 1.3333......
How do I get this?
Michael Morris
Ranch Hand

Joined: Jan 30, 2002
Posts: 3451
If you want to convert an int (or long) for floating point operations without loss of precision, you can use the java.math.BigInteger and java.math.BigDecimal classes. For example:

Once you convert back to the double then precision will be lost of course. You can also set the scale (or precision) of the BigDecimal to any arbitrary length. Take a look at the API docs and see if this may help to solve your problem.
[ December 07, 2003: Message edited by: Michael Morris ]

Any intelligent fool can make things bigger, more complex, and more violent. It takes a touch of genius - and a lot of courage - to move in the opposite direction. - Ernst F. Schumacher
Dirk Schreckmann
Sheriff

Joined: Dec 10, 2001
Posts: 7023
I just want to point out the simple answer, just in case you're not aware of it.
Using the code in your second post, if you want the division expression to result in a floating point number, just convert one or both of the integral operands before the division operation -- (float)capacity/level -- and the result will be a floating point number.
Now, it won't be 1.333... with the 3's repeating forever, because Java is running on a computer and there is a need to represent data (and numbers) in a finite amount of space, and so begins the not-so-simple answer. The bit pattern used for floating point numbers (IEEE 754) doesn't provide for never-ending values to be represented. Instead, it makes an approximation that can be stored in the amount of space allocated (which in the case of floats is 4 bytes).
Even if you were to work with BigDecimal, which can represent floating point numbers to an arbitrary degree of precision, the never-ending 3's would still need to be truncated at some point. If float or double don't offer enough decimal points for you, then use BigDecimal and specify your own number of decimal points.
Is your solution becoming clearer?
[ December 08, 2003: Message edited by: Dirk Schreckmann ]
merlin bar
Ranch Hand

Joined: Feb 16, 2003
Posts: 54
Thanks folks, that answers my question. I wasnt aware of the BigDecimal classes, but Dirk, that was what I really wanted, converting just before the calculation does the job.
Thanks again!
merlin
[ December 08, 2003: Message edited by: merlin bar ]
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: Rounding problems (maths)
 
Similar Threads
problem rescaling
Assign a range to an integer variable
Rounding BigDecimal Calculation Yielded Wrong Result
Rounding Numbers Down / Truncating
BigDecimal ROUND_HALF_EVEN rounding mode and the number of digits to the right of the decimal point