RMAN backup failure on a 700 GB database.

From: <vasant.naidu_at_gmail.com>
Date: 26 Jan 2006 02:22:08 -0800
Message-ID: <1138270928.281826.276850@z14g2000cwz.googlegroups.com>

Hi,

Let me start with the details:

Database: Oracle8i Enterprise Edition Release 8.1.7.4.0 - 64bit Production
OS: SunOS P0021ADCDA 5.8 Generic_117350-20 sun4u sparc SUNW,Sun-Fire Backup System: NetBackup-Solaris2.6 4.5GA

Ours is a 700 GB database which runs a critical application concerned with telecom systems. We take RMAN Hotbackup everyday.

Giving you a format of our script:
RUN {

ALLOCATE CHANNEL ch00 TYPE 'SBT_TAPE';
ALLOCATE CHANNEL ch01 TYPE 'SBT_TAPE';
ALLOCATE CHANNEL ch02 TYPE 'SBT_TAPE';

BACKUP
    $BACKUP_TYPE
    SKIP INACCESSIBLE
    TAG hot_db_bk_level0
    FILESPERSET 5
    # recommended format
    FORMAT 'bk_%s_%p_%t'
    DATABASE;
    sql 'alter system archive log current';

RELEASE CHANNEL ch00;
RELEASE CHANNEL ch01;
RELEASE CHANNEL ch02;

}

The database is run during night when the load is low. But since the size has grown to this much big propotion it fails everyday with the following error:

File Name: -rw-rw-rw- 1 root root 15911 Jan 26 14:34 hot_database_SV_VBPDF_backup.sh.Jan26_0012.out

End contents:

RMAN-08522: input datafile fno=00080
name=/u175/oradata/SVM_VBPDF/data/VBPDF_data_74.dbf

RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================

RMAN-03007: retryable error occurred during execution of command: backup
RMAN-07004: unhandled exception during command execution on channel ch02
RMAN-10035: exception raised in RPC: ORA-19502: write error on file "bk_20461_1_580742991", blockno 21016449 (blocksize=512) ORA-27030: skgfwrt: sbtwrite2 returned error ORA-19511: sbtwrite2: sbtwrite2() failed. RMAN-10031: ORA-19624 occurred during call to DBMS_BACKUP_RESTORE.BACKUPPIECECREATE Let me also tell that sometimes this backup happens successfully, like the below fired on 24th Jan.
-rw-rw-rw- 1 root root 27905 Jan 24 23:57 hot_database_SV_VBPDF_backup.sh.Jan24_0430.out

So what might be the problem:

Is it due to the database size
Is it due to the fact that our backup system cannot handle this big a database, during peak loads (most of the backup happens during night)

Can anybody clear me on this?

Thanks.

Regards,
Vasant Naidu Received on Thu Jan 26 2006 - 04:22:08 CST