Exactly.
We had a system that used to drag emails (from qmail
so each mail was a file) into clobs in the database.
After a year or so we had about 15 million emails in
the database - no problems at all.
Then one day the some idiot (aka me) put a new version
of the program in which successfully loaded the clob
but (to cut a long story short) started replicating
the email files left, right and centre...It took
literally days to clean up millions of (zero byte
size) files...after which point that file system
needed to be rebuilt anyway, the directory structure
was in such a mess
Cheers
Connor
- Jared.Still_at_radisys.com wrote: > Arup,
>
> What Connor may have been referring to is the
> inefficiency
> of managing 20 million files in a filesystem.
>
> That's a lot of inodes ( assuming unix ). It's a
> bit much
> for a filesystem to deal with.
>
> Jared
>
>
>
>
>
>
> "Arup Nanda" <arupnanda_at_hotmail.com>
> Sent by: root_at_fatcity.com
> 12/03/2002 07:14 AM
> Please respond to ORACLE-L
>
>
> To: Multiple recipients of list ORACLE-L
> <ORACLE-L_at_fatcity.com>
> cc:
> Subject: Re: image storage confusion
> ??
>
>
> Connor,
>
> I seem to think otherwise. Storing 100 GB of image
> is not necessarily a
> pretty proposition either when you consider hot
> backups and archived log
> generation, etc. I presume you are concerned about
> the management of the
> image files considering the sheer volume of it. But
> that's precisely what
> BFILE is expected to help with. The images are in a
> file ssytem and the
> pointers are in the database and that's managed
> pretty well.
>
> However I do concede tht this might pose a problem
> on two fronts -
> (1) Security - beign on filesystem anyone can
> potentially see these.
> However
> this is not necesarily a concern at all sites. Good
> OS security can
> prevent
> this.
> (2) Backup - the ssy admin has to explicitly backup
> all these files. This,
> again, may not be that bad when you store your files
> on a single
> filesystem
> and a backup software can be easily programmed to
> check only the changed
> files, based on timestamp.
>
> Just my two cents.
>
> Arup Nanda
>
> ----- Original Message -----
> To: "Multiple recipients of list ORACLE-L"
> <ORACLE-L_at_fatcity.com>
> Sent: Tuesday, December 03, 2002 7:39 AM
>
>
> > Managing 20mil of anything (images/text/etc) in a
> file
> > system isn't a nice proposition. Go with the
> database
> >
> > hth
> > connor
> >
> > --- oraora oraora <oraoraora_at_rediffmail.com>
> wrote:
> > > Guys , i posted this already and this time my
> > > question is a bit
> > > different .
> > >
> > > I have to store 20,000,000 images of 5k each
> either
> > > in DB ( on
> > > win2k) or linux o/s file system.
> > >
> > > the images are to be displayed over mobile
> phones.so
> > > the time to
> > > retrieve the images should be minimum.
> > >
> > > for this to be achieved , i am confused ,
> whether
> > > the images
> > > should be stored in o/s file system or in the
> DB ?
> > >
> > > --selecting a file from linux o/s file system
> > > -------
> > > or
> > > --querying it from oracle DB ( on win2k)
> > > ---------------
> > >
> > > which of the above will be faster ?
> > >
> > > all these will be done with java . this being
> > > condition , i
> > > would
> > > like to know ur suggestion guys.
> > >
> > > my DB is oracle 8.1.6 on Win2k.
> > >
> > > TIA
> > > --
> > > Please see the official ORACLE-L FAQ:
> > > http://www.orafaq.com
> > > --
> > > Author: oraora oraora
> > > INET: oraoraora_at_rediffmail.com
> > >
> > > Fat City Network Services -- 858-538-5051
> > > http://www.fatcity.com
> > > San Diego, California -- Mailing list and
> web
> > > hosting services
> > >
> >
>
> > > To REMOVE yourself from this mailing list, send
> an
> > > E-Mail message
> > > to: ListGuru_at_fatcity.com (note EXACT spelling of
> > > 'ListGuru') and in
> > > the message BODY, include a line containing:
> UNSUB
> > > ORACLE-L
> > > (or the name of mailing list you want to be
> removed
> > > from). You may
> > > also send the HELP command for other information
> > > (like subscribing).
> > >
> >
> > =====
> > Connor McDonald
> > http://www.oracledba.co.uk
> > http://www.oaktable.net
> >
> > "GIVE a man a fish and he will eat for a day. But
> TEACH him how to fish,
> and...he will sit in a boat and drink beer all day"
> >
> > __________________________________________________
> > Do You Yahoo!?
> > Everything you'll ever need on one web page
> > from News and Sport to Email and Music Charts
> > http://uk.my.yahoo.com
> > --
> > Please see the official ORACLE-L FAQ:
> http://www.orafaq.com
> > --
> > Author: =?iso-8859-1?q?Connor=20McDonald?=
> > INET: hamcdc_at_yahoo.co.uk
> >
> > Fat City Network Services -- 858-538-5051
> http://www.fatcity.com
> > San Diego, California -- Mailing list and
> web hosting services
> >
>
> > To REMOVE yourself from this mailing list, send an
> E-Mail message
> > to: ListGuru_at_fatcity.com (note EXACT spelling of
> 'ListGuru') and in
> > the message BODY, include a line containing: UNSUB
> ORACLE-L
> > (or the name of mailing list you want to be
> removed from). You may
> > also send the HELP command for other information
> (like subscribing).
> >
> --
> Please see the official ORACLE-L FAQ:
> http://www.orafaq.com
> --
> Author: Arup Nanda
> INET: arupnanda_at_hotmail.com
>
> Fat City Network Services -- 858-538-5051
> http://www.fatcity.com
> San Diego, California -- Mailing list and web
> hosting services
>
> To REMOVE yourself from this mailing list, send an
> E-Mail message
> to: ListGuru_at_fatcity.com (note EXACT spelling of
> 'ListGuru') and in
> the message BODY, include a line containing: UNSUB
> ORACLE-L
> (or the name of mailing list you want to be removed
> from). You may
> also send the HELP command for other information
> (like subscribing).
>
>
>
>
> --
> Please see the official ORACLE-L FAQ:
> http://www.orafaq.com
> --
> Author:
> INET: Jared.Still_at_radisys.com
>
> Fat City Network Services -- 858-538-5051
> http://www.fatcity.com
> San Diego, California -- Mailing list and web
> hosting services
>
> To REMOVE yourself from this mailing list, send an
> E-Mail message
> to: ListGuru_at_fatcity.com (note EXACT spelling of
> 'ListGuru') and in
> the message BODY, include a line containing: UNSUB
> ORACLE-L
> (or the name of mailing list you want to be removed
> from). You may
> also send the HELP command for other information
> (like subscribing).
>
Connor McDonald
http://www.oracledba.co.uk
http://www.oaktable.net
"GIVE a man a fish and he will eat for a day. But TEACH him how to fish, and...he will sit in a boat and drink beer all day"
Do You Yahoo!?
Everything you'll ever need on one web page
from News and Sport to Email and Music Charts
http://uk.my.yahoo.com
--
Please see the official ORACLE-L FAQ: http://www.orafaq.com
--
Author: =?iso-8859-1?q?Connor=20McDonald?=
INET: hamcdc_at_yahoo.co.uk
Fat City Network Services -- 858-538-5051 http://www.fatcity.com
San Diego, California -- Mailing list and web hosting services
---------------------------------------------------------------------
To REMOVE yourself from this mailing list, send an E-Mail message
to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in
the message BODY, include a line containing: UNSUB ORACLE-L
(or the name of mailing list you want to be removed from). You may
also send the HELP command for other information (like subscribing).
Received on Tue Dec 03 2002 - 13:44:28 CST
