Home | Contact Us | FAQ | Search & Site Map | Link to Us
Sign In | Join | Other 45 Sites in Network
Home
DiscussionsAccessExcelInfoPathOutlookPowerPointPublisherWord
DirectoryUser Groups
Related Topics
Outlook ExpressInternet ExplorerWindowsMS Server ProductsMore Topics ...

MS Office Forum / Excel / Excel Errors / March 2006

Tip: Looking for answers? Try searching our database.

Bug using series

Thread view: 
Enable EMail Alerts  Start New Thread
Thread rating: 
BCA - 28 Mar 2006 12:58 GMT
Hello,
This gives a strange result :
Type in
   Cell A1 : -5
   Cell B1 : -4.9
Select both cells and increment the serie -> -4.8, -4.7, ...
Below, you get suddenly the following result :
-3.7000000000000000000000
-3.6000000000000000000000
-3.5000000000000100000000
-3.4000000000000100000000
-3.3000000000000100000000
and so on...
vandenberg p - 29 Mar 2006 05:58 GMT
Hello:

This is as old as computing, and it is not a bug. See

http://www.cpearson.com/excel/rounding.htm

for an explanation.

Pieter Vandenberg

: Hello,
: This gives a strange result :
[quoted text clipped - 9 lines]
: -3.3000000000000100000000
: and so on...
Jerry W. Lewis - 29 Mar 2006 12:18 GMT
As Pieter Vandenberg has pointed out, this is a known and natural consequence
of computers doing math in binary.  The binary approximation to 4.9
(4.90000000000000035527...) is slightly larger than the nominal value, hence
the increment used in your series is slightly smaller than you intended.

You cannot directly see this approximation in 4.9, because Excel (as
documented) will display no more than 15 figures, but you can see the full
values of binary approximations using the D2D function at
http://groups.google.com/group/microsoft.public.excel/msg/b106871cf92f8465

There are several ways to get your intended result using formulas, such as
 =ROUND(A1+0.1)
in B1, and copied across or
 =(-51+column())/10
in A1 and copied across.

The subject of this group is things that cause Excel to crash.  Your post
would have been more on topic in the general group.

Jerry

> Hello,
> This gives a strange result :
[quoted text clipped - 9 lines]
> -3.3000000000000100000000
> and so on...
 
Sign In
Join
My Latest Posts
My Monitored Threads
My Blog
My Photo Gallery
My Profile
My Homepage

Start New Thread
Enable EMail Alerts
Rate this Thread



©2008 Advenet LLC   Privacy Policy - Terms of Use
This website includes both content owned or controlled by Advenet as well as content owned or controlled by third parties.