Why do 0.1 and 1/10 work but 0.3-0.2 doesn't?

  • Python
  • Thread starter SamRoss
  • Start date
  • Tags
    Work
In summary: It is worse than I thought:>>> print(0.3-0.2)0.09999999999999998What is this awful precision?What do you expect ##0.1 - 2^{-55}## to look like?If you want to reduce precision you can do that yourself using either Math.round or sigfig.round as appropriate.
  • #106
anorlunda said:
Haven't we flogged this topic to death yet?
I think it's machine esilon away from death and, due to finite precision arithmetic, it always will be...
 
  • Like
  • Haha
Likes vela and jbriggs444
Technology news on Phys.org
  • #108
After moderator review, the thread will remain closed as the topic has been sufficiently discussed and the OP is long gone. Thanks to all who participated!
 
  • Like
Likes scottdave

Similar threads

How do for loops work in python?
    • Programming and Computer Science
Replies
5
Views
1K
Finding the "Runner Up" (Second Highest Value)
    • Programming and Computer Science
Replies
29
Views
2K
Python What is the Winning Probability in Monte Carlo Spinner Game?
    • Programming and Computer Science
Replies
3
Views
1K
Query runs fine in MySQL, but returns empty list in Python
    • Programming and Computer Science
Replies
7
Views
552
Python UnimplementedError: Cast string to float is not supported
    • Programming and Computer Science
Replies
5
Views
3K
Solving Fourier's Law w/ Splines & Derivatives
    • Programming and Computer Science
Replies
2
Views
1K
Python Why Order Matters in an 'and' Statement
    • Programming and Computer Science
Replies
5
Views
1K
Python How can I retrieve integers from a file in Python?
    • Programming and Computer Science
Replies
8
Views
912
Python RecursionError at a place where I have defined no recursive function
    • Programming and Computer Science
Replies
17
Views
2K
Python How does this recursive code work?
    • Programming and Computer Science
Replies
11
Views
829

Hot Threads

Recent Insights

Back
Top