Re: [WebDNA] Strange MATH result
This WebDNA talk-list message is from 2010
It keeps the original formatting.
numero = 104369
interpreted = N
texte = --Apple-Mail-13--651058075 Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit I feel like I want to look up scientific notation to be sure what "e-015" means.. but I think it means to move the decimal to the left 15 places... which means the number is not zero (as you expected), but instead just very very small.. (close to zero).. and I suspect it has to do with the way webdna source is working with numbers... you know in coding languages there are various kinds of numbers (like 'integer' or 'long').. with varying amounts of ram/HD alloted to store them.. and the more space alloted - the more accurate/fine- grained the calculations. Well in webdna we do not have access to those number var types so I think the answer is that you just have to live with it.. and round to get a reasonable result that works for your purposes.. Or there could be tricks to workaround.. maybe if you show what you are really doing in a larger context (and/or show your algorithm before it evaluates to those numbers) then someone will have a creative idea.. -G On Jan 11, 2010, at 9:17 PM, Stuart Tremain wrote: > Why does [math]36.70+0.00+0.00+0.00-6.95-29.75[/math] = > 3.5527136788005e-015 ????? > > > Regards > > Stuart Tremain > IDFK Web Developments > AUSTRALIA > webdna@idfk.com.au > > > > ------------ Govinda govinda.webdnatalk@gmail.com --Apple-Mail-13--651058075 Content-Type: text/html; charset=US-ASCII Content-Transfer-Encoding: quoted-printable I feel like I want to look up = scientific notation to be sure what "
e-015" means.. = but I think it means to move the decimal to the left 15 places... = which means the number is not zero (as you expected), but instead just = very very small.. (close to zero).. and I suspect it has to = do with the way webdna source is working with numbers... you know = in coding languages there are various kinds of numbers (like 'integer' = or 'long').. with varying amounts of ram/HD alloted to store = them.. and the more space alloted - the more accurate/fine-grained the = calculations. Well in webdna we do not have access to those number = var types so I think the answer is that you just have to live with = it.. and round to get a reasonable result that works for your purposes.. =
Or there could be tricks to workaround.. maybe if = you show what you are really doing in a larger context (and/or show your = algorithm before it evaluates to those numbers) then someone will have a = creative idea..
-G
On Jan 11, 2010, at 9:17 PM, Stuart = Tremain wrote:
Why = does [math]36.70+0.00+0.00+0.00-6.95-29.75[/math] = =3D 3.5527136788005e-015 ?????
webdna@idfk.com.au
= --Apple-Mail-13--651058075--
Associated Messages, from the most recent to the oldest:The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...