BR0233E Backup utility has reported an error while saving file

Issue: SAP oracle database Archive log backup failing using BR Tool


Error:

BR0233E Backup utility has reported an error while saving file
ERROR: incorrect format or option in .utl file (-p)
BR0231E Backup utility call failed
ERROR: Can't change to working directory Errno = 13 : Permission denied
BR0005I BRARCHIVE terminated with errors

Background/Analysis:

SAP archive backup policy started failing which is using brarchive ( SAP supplied backup utility BR Tool ) command executed via backup policy

As a first action logs & errors identified 

Secondly , brarchive command executed manually from database server which is client to backup media server as below


brarchive -u / -c -d util_file -r /oracle/PRD/102_64/dbs/initPRD-logs.utl -s

Be careful , "-s" flag is for saving archive log files to backup device & "-sd" to save & delete from source post backup to backup device

First error observed was "ERROR: Can't change to working directory:  Errno = 13 : Permission denied " on specific folder mentioned in the error

BR0280I BRARCHIVE time stamp: 2013-03-25 19.29.54
BR0229I Calling backup utility with function 'backup'...
BR0278I Command output of 'backint -u PRD -f backup -i /oracle/PRD/saparch/.aekviixr.lst -t file -p /oracle/PRD/102_64/dbs/initPRD-logs.utl -c':
ERROR: Can't change to working directory: /usr/openv/netbackup/logs/user_ops/sap Errno = 13 : Permission denied
WARNING: sort_backup_type not specified in .utl file
WARNING: default sort_backup_type to <size> for backup
ERROR: incorrect format or option in .utl file (-p)

Action taken was to make such folder available with proper permission using & re-execute the manual backup command


mkdir -p /usr/openv/netbackup/logs/user_ops/sap

Previous error disappeared , but got new error "BR0233E Backup utility has reported an error while saving file"

BR0280I BRARCHIVE time stamp: 2013-03-25 19.57.04
BR0229I Calling backup utility with function 'backup'...
BR0278I Command output of 'backint -u PRD -f backup -i /oracle/PRD/saparch/.aekvilii.lst -t file -p /oracle/PRD/102_64/dbs/initPRD-logs.utl -c':
WARNING: sort_backup_type not specified in .utl file
WARNING: default sort_backup_type to <size> for backup
********************************************************************************
Program:                backint 7.1
Input File:             /oracle/PRD/saparch/.aekvilii.lst
Profile:                /oracle/PRD/102_64/dbs/initPRD-logs.utl
Function:               BACKUP
Backup Type:            BACKUP_FILE
********************************************************************************
BR0233E Backup utility has reported an error while saving file /oracle/PRD/oraarch/PRDarch1_242217_759153586.arcBR0233E Backup utility has reported an error while saving file /oracle/PRD/oraarch/PRDarch1_242218_759153586.arc
BR0233E Backup utility has reported an error while saving file /oracle/PRD/oraarch/PRDarch1_242219_759153586.arc
BR0233E Backup utility has reported an error while saving file /oracle/PRD/oraarch/PRDarch1_242220_759153586.arc
BR0233E Backup utility has reported an error while saving file /oracle/PRD/oraarch/PRDarch1_242221_759153586.arc
BR0233E Backup utility has reported an error while saving file /oracle/PRD/oraarch/PRDarch1_242222_759153586.arc 

Action taken was  ..

=> Restarted backup client processes (bpcd -standalone & bpcompatd) on db server

=> Ensured backup master to client connectivity 

=> Verified drive availability

=> Verified if any media issue

But no luck !

Finally , Backup got successfully completed after restoring below folders in logs from Backup

cd /usr/openv/netbackup/logs/
ls -lrtdrwxrwxrwx 2 root root  4096 2011-01-13 15:28 bpbackupdrwxrwxrwx 6 root bin   4096 2011-03-06 13:59 user_opsdrwxrwxrwx 2 root root  4096 2011-10-05 12:42 brbackupdrwxrwxrwx 2 root bin   4096 2012-03-06 18:32 nbliveupdrwxr-xr-x 2 root root  4096 2013-03-26 01:45 bpbkardrwxrwxrwx 2 root root  4096 2013-03-26 04:43 backintdrwxrwxrwx 2 root root 12288 2013-03-26 04:44 bphdb 

BR0280I BRARCHIVE time stamp: 2013-03-25 20.35.39
BR0229I Calling backup utility with function 'backup'...
BR0278I Command output of 'backint -u PRD -f backup -i /oracle/PRD/saparch/.aekviotl.lst -t file -p /oracle/PRD/102_64/dbs/initPRD-logs.utl -c':
WARNING: sort_backup_type not specified in .utl file
WARNING: default sort_backup_type to <size> for backup
********************************************************************************
Program:                backint 7.1
Input File:             /oracle/PRD/saparch/.aekviotl.lst
Profile:                /oracle/PRD/102_64/dbs/initPRD-logs.utl
Function:               BACKUP
Backup Type:            BACKUP_FILE
********************************************************************************
[5715.01] 20:35:50 INF - Processing /oracle/PRD/oraarch/PRDarch1_242217_759153586.arc
20:35:51.263 [5715] <1> :  Backup of </oracle/PRD/oraarch/PRDarch1_242217_759153586.arc> is in progress.
[5715.01] 20:35:51 INF - Data buffer size = 262144
[5715.01] 20:35:53 INF - Using Media ID @AAAAD for Backup ID SAPDB_1364223945
[5715.01] 20:35:55 INF - Processing /oracle/PRD/oraarch/PRDarch1_242218_759153586.arc
20:35:55.265 [5715] <1> :  Backup of </oracle/PRD/oraarch/PRDarch1_242218_759153586.arc> is in progress.
[5715.01] 20:35:58 INF - Processing /oracle/PRD/oraarch/PRDarch1_242219_759153586.arc
20:35:59.268 [5715] <1> :  Backup of </oracle/PRD/oraarch/PRDarch1_242219_759153586.arc> is in progress.
[5715.01] 20:36:02 INF - Processing /oracle/PRD/oraarch/PRDarch1_242220_759153586.arc
20:36:02.270 [5715] <1> :  Backup of </oracle/PRD/oraarch/PRDarch1_242220_759153586.arc> is in progress.

Solution:

create below folders in /usr/openv/netbackup/logs/

bpbackup
user_ops
brbackup
nbliveup
bpbkar
backint
bphdb

Lesson Learned:

As above folders got deleted during cleanup operation of logs , cleanup activity should not delete folders & rm should be used ( not rm -rf ) using extension of file