Re: Math Bug
This WebDNA talk-list message is from 1999
It keeps the original formatting.
numero = 25447
interpreted = N
texte = >I've run across a math bug when summarizing a large number of records using >this technique: >[some search context] >[math][founditems][commission]+[/founditems]0[/math] >[/search] > >Once the search hits about the 130-135th record the total which should look >like: 79924.24 instead gets formatted as 79924.2399999999. I've zapped >gremlins, reloaded the database, changed the startat value, verified that >all values are integers (all are formatted x.xx ), even modified the >contents of the records with different values and still the computed value >gets formatted as .xx99999999. > >As a further test I created a test db and wrote out the commission values >from the problem db to the test db and the results are the same - although >the problem begins at the 125th record - *does not* appear in the 126th >record but comes back at the 127th record. What the heck is going on here? This sounds like a problem for webcatalog@smithmicro.com ... :)================================ Kenneth Grome, WebDNA Consultant 808-737-6499, http://webdna.net ================================------------------------------------------------------------- Brought to you by CommuniGate Pro - The Buzz Word Compliant Messaging Server. To end your Mail problems go to
.This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to
Associated Messages, from the most recent to the oldest:
>I've run across a math bug when summarizing a large number of records using >this technique: >[some search context] >[math][founditems][commission]+[/founditems]0[/math] >[/search] > >Once the search hits about the 130-135th record the total which should look >like: 79924.24 instead gets formatted as 79924.2399999999. I've zapped >gremlins, reloaded the database, changed the startat value, verified that >all values are integers (all are formatted x.xx ), even modified the >contents of the records with different values and still the computed value >gets formatted as .xx99999999. > >As a further test I created a test db and wrote out the commission values >from the problem db to the test db and the results are the same - although >the problem begins at the 125th record - *does not* appear in the 126th >record but comes back at the 127th record. What the heck is going on here? This sounds like a problem for webcatalog@smithmicro.com ... :)================================ Kenneth Grome, WebDNA Consultant 808-737-6499, http://webdna.net ================================------------------------------------------------------------- Brought to you by CommuniGate Pro - The Buzz Word Compliant Messaging Server. To end your Mail problems go to .This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to
Kenneth Grome
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
[interpret] inside the db field? (1997)
Error Log.db --however (1997)
WebCat2 - Getting to the browser's username/password data (1997)
WCS Newbie question (1997)
Counting downloads (1998)
Signal Raised error (1997)
PCS Frames (1997)
Proper file locations (1997)
Sendmail & Time Issue (2001)
A multi-processor savvy WebCatalog? (1997)
JavaScript form question (2001)
Separate SSL Server (1997)
Mac Os X and WebCat (1999)
OT: question about traveling abroad (UK) (2005)
Help name our technology! (1997)
Limit picture size on upload (2005)
More on the email templates (I like it) (1997)
Week # problem (1998)
make a beep (2004)
Sorting LISTFILES (1997)