Re: Does anyone know what precision Oracle uses in arithmatic?

All arithmetic (for better or worse) is done to 38 digits of precision i.e. the number(n,m) is ignored for calculations. (n,m) is only used to store numbers in the database but once they're being used they are fully formed.

Raymond Velez (rvele_at_ctp.com) wrote:
: select
: (old_qty / (qty1/qty2)) * price,
: from
: blah blah
 

: I was wondering what the precision of the first parenthesized statement
: will be. I am hoping that it uses out the fifteenth decimal place
: precision. That is what most C code uses. Any input would be
: appreciated.
: -Ray Velez
: --
: ((((((((((((((((((((((((((((((((((((((((*))))))))))))))))))))))))))))))))))))))
: rvele_at_ctp.com | Cambridge Technology Partners |
: Raymond Velez | 304 Vassar St, Cambridge, MA | WORK: (617)374-8399
: ((((((((((((((((((((((((((((((((((((((((*))))))))))))))))))))))))))))))))))))))

--
Kirk Bradley
Oracle Corporation
Mainframe and Integration Technologies Group