Re: Does anyone know what precision Oracle uses in arithmatic?
Date: 18 Feb 1995 18:10:20 GMT
Message-ID: <3i5d6c$6l6_at_dcsun4.us.oracle.com>
adrian_at_a-cha.demon.co.uk (Adrian P Challinor) writes:
>In article <3hr7vm$hj4_at_toon.ctp.com>, rvele_at_ctp.com (Raymond Velez) wrote:
>
>> select
>> (old_qty / (qty1/qty2)) * price,
>> from
>> blah blah
>>
>> I was wondering what the precision of the first parenthesized statement
>> will be. I am hoping that it uses out the fifteenth decimal place
>
>I'm not sure what the precision will be exactly, as this will depend on
>the hardware / C implementation. But internally, Oracle stores all numbers
>in a strange base 100 offset 65 format that delivers, at best, with a
>maximum fo 38 significant digits!
>
Oracle delivers the same level of precision on all platforms. This is how we
can guarantee the same answer on all platforms and why Oracle wasn't
affected by the Pentium flaw.
Precision is equal to or less than 38 digits depending on the definition of the columns:
column_name NUMBER (precision, scale)
Dave (ddargo_at_us.oracle.com) Received on Sat Feb 18 1995 - 19:10:20 CET