Re: Database or store to handle 30 Mb/sec and 40,000 inserts/sec

uspensky_at_gmail.com wrote:
> We have a need for some sort of database package that can handle the
> following specs:
>
> Average data rate - 30 megabits/sec.
> Max # inserts - 40,000 records/sec.
>
> What sort of database or store could handle this load? I'm looking to
> price out a repository, basically capturing the best bid/ask and last
> information from all 6 option exchanges, and then have a retrieval
> application query this data in a timely fashion.
>
> suggestions (with links to benchmarks/info) are much appreciated
>
> thanks much
>

given those rates, the flip answer would be a 'memory-based' db except for the fact that 40,000 recs/sec might approach a billion records in 8 hours!

are you sure those rates are right? (i find it hard to believe that a single option exchange, let alone six is doing 40,000/6*3,600 = something like 21 million inserts in an hour!)

the data rate would also seem to imply a dedicated network.

p Received on Tue Feb 07 2006 - 16:50:02 CET