Re: Does anyone know what precision Oracle uses in arithmatic?

From: Adrian P Challinor <adrian_at_a-cha.demon.co.uk>
Date: Fri, 17 Feb 1995 08:39:37 GMT
Message-ID: <adrian-1702950839370001_at_a-cha.demon.co.uk>


In article <3hr7vm$hj4_at_toon.ctp.com>, rvele_at_ctp.com (Raymond Velez) wrote:

> select
> (old_qty / (qty1/qty2)) * price,
> from
> blah blah
>
> I was wondering what the precision of the first parenthesized statement
> will be. I am hoping that it uses out the fifteenth decimal place
> precision. That is what most C code uses. Any input would be
> appreciated.
> -Ray Velez
> --
>

 ((((((((((((((((((((((((((((((((((((((((*))))))))))))))))))))))))))))))))))))))

> rvele_at_ctp.com | Cambridge Technology Partners |
> Raymond Velez | 304 Vassar St, Cambridge, MA | WORK: (617)374-8399
>
((((((((((((((((((((((((((((((((((((((((*))))))))))))))))))))))))))))))))))))))

I'm not sure what the precision will be exactly, as this will depend on the hardware / C implementation. But internally, Oracle stores all numbers in a strange base 100 offset 65 format that delivers, at best, with a maximum fo 38 significant digits!

-- 
Adrian Challinor
CEO, Osiris Consultants Ltd
Received on Fri Feb 17 1995 - 09:39:37 CET

Original text of this message