[Bizgres-general] Sizing a server to host Bizgres...

[Charly Clairmont]

Hello !

I use Bizgres for a test project which manage large volume of datas. In
fact, Bizgres is designed for that. I load 2 Gb a day that represents
6,000,000 records a day.
however it's only for test...

I try some modifications in the postgresql.conf to improve performance
but Bizgres works always slowly.

So I think that my test server is not well appropriate to manage this
amount of datas.

My computer settings :
----------------------
 * linux kernel : 2.6.15-1.1833_FC4
 * OS : Fedora Core 4

processor
------------------------------------
processor       : 0
vendor_id       : AuthenticAMD
cpu family      : 15
model           : 4
model name      : AMD Athlon(tm) 64 Processor 2800+
stepping        : 10
cpu MHz         : 1800.122
cache size      : 512 KB
fpu             : yes
fpu_exception   : yes
cpuid level     : 1
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge
mca cmov
pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext lm 3dnowext 3dnow
bogomips        : 3606.82
TLB size        : 1024 4K pages
clflush size    : 64
cache_alignment : 64
address sizes   : 40 bits physical, 48 bits virtual
power management: ts fid vid ttp

memory
-------------------------------------------------
MemTotal:      1026560 kB
MemFree:         12424 kB
Buffers:         67904 kB
Cached:         274044 kB
SwapCached:      61456 kB
Active:         789120 kB
Inactive:       137816 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      1026560 kB
LowFree:         12424 kB
SwapTotal:     2096440 kB
SwapFree:      1925652 kB
Dirty:              36 kB
Writeback:           0 kB
Mapped:         675772 kB
Slab:            47136 kB
CommitLimit:   2609720 kB
Committed_AS:  1261616 kB
PageTables:      13968 kB
VmallocTotal: 34359738367 kB
VmallocUsed:      5496 kB
VmallocChunk: 34359732219 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB


And my hard disk is an ide one. A SCSI disk will be better ! I know
but...

Disk information :
-----------------

/dev/hda:

 Model=HDS722516VLAT80, FwRev=V34OA6EA, SerialNo=VNR42AC4CT1L2S
 Config={ HardSect NotMFM HdSw>15uSec Fixed DTR>10Mbs }
 RawCHS=16383/16/63, TrkSize=0, SectSize=0, ECCbytes=52
 BuffType=DualPortCache, BuffSize=7938kB, MaxMultSect=16, MultSect=16
 CurCHS=4047/16/255, CurSects=16511760, LBA=yes, LBAsects=268435455
 IORDY=on/off, tPIO={min:240,w/IORDY:120}, tDMA={min:120,rec:120}
 PIO modes:  pio0 pio1 pio2 pio3 pio4
 DMA modes:  mdma0 mdma1 mdma2
 UDMA modes: udma0 udma1 udma2
 AdvancedPM=yes: disabled (255) WriteCache=enabled
 Drive conforms to: ATA/ATAPI-6 T13 1410D revision 3a:

 * signifies the current active mode

Disk performace
---------------
/dev/hda:
 Timing buffered disk reads:   12 MB in  3.27 seconds =   3.67 MB/sec


I just want to know what is the smallest server (cpu, ram) I have to set
up to test my bizgres data warehouse with 6,000,000 records a day ?

Thanks a lot...

-- 
Charly CLAIRMONT 
________________________________________________________________________
CTO
ALTIC, une ALTernative à  votre système d'Information et de
Communication
mail : charly.clairmont at altic.org
mob : +33(0)661736013
tel : +33(0)870286663
site : www.altic.org