Re: OCI Maintenance ExaCS storage warnings - is this normal?

Hi Chris,

In my Exadata Cloud Customer (ExaCC) environment, Oracle applied the monthly patches to the cell servers, and the cell servers were rebooted in a rolling manner. Consequently, we received alerts in Oracle Enterprise Manager (OEM) indicating that the ASM disks went offline. It's possible that a similar process is followed for Exadata Cloud Service (ExaCS) where ASM disks may also go offline temporarily during patching and rolling server reboots.

On Wed, 1 Nov 2023 at 19:21, Chris Taylor <christopherdtaylor1994_at_gmail.com> wrote:

> Hey guys, we had an OCI maintenance a few days ago and I was doing an RMAN
> duplicate which failed with storage/ASM errors (which is fine), but my
> other databases also threw warnings in their alert logs as well like the
> below.
>
> These databases stayed online and don't seem any worse for wear but seeing
> storage messages makes me nervous.
>
> I'm wondering if this is normal/expected or not?
>
> <snip>
> NOTE: updating disk modes to 0x1 from 0x5 for disk 4
> (DATAC1_CD_10_LHR300407EXDCL05) in group 1 (DATAC1): lflags 0x0
> NOTE: updating disk modes to 0x1 from 0x5 for disk 6
> (DATAC1_CD_06_LHR300407EXDCL05) in group 1 (DATAC1): lflags 0x0
> NOTE: updating disk modes to 0x1 from 0x5 for disk 7
> (DATAC1_CD_07_LHR300407EXDCL05) in group 1 (DATAC1): lflags 0x0
> NOTE: updating disk modes to 0x1 from 0x5 for disk 9
> (DATAC1_CD_02_LHR300407EXDCL05) in group 1 (DATAC1): lflags 0x0
> NOTE: updating disk modes to 0x1 from 0x5 for disk 13
> (DATAC1_CD_11_LHR300407EXDCL05) in group 1 (DATAC1): lflags 0x0
> NOTE: updating disk modes to 0x1 from 0x5 for disk 15
> (DATAC1_CD_03_LHR300407EXDCL05) in group 1 (DATAC1): lflags 0x0
> NOTE: updating disk modes to 0x1 from 0x5 for disk 16
> (DATAC1_CD_08_LHR300407EXDCL05) in group 1 (DATAC1): lflags 0x0
> NOTE: updating disk modes to 0x1 from 0x5 for disk 22
> (DATAC1_CD_04_LHR300407EXDCL05) in group 1 (DATAC1): lflags 0x0
> NOTE: updating disk modes to 0x1 from 0x5 for disk 23
> (DATAC1_CD_09_LHR300407EXDCL05) in group 1 (DATAC1): lflags 0x0
> NOTE: updating disk modes to 0x1 from 0x5 for disk 29
> (DATAC1_CD_00_LHR300407EXDCL05) in group 1 (DATAC1): lflags 0x0
> NOTE: updating disk modes to 0x1 from 0x5 for disk 32
> (DATAC1_CD_05_LHR300407EXDCL05) in group 1 (DATAC1): lflags 0x0
> NOTE: updating disk modes to 0x1 from 0x5 for disk 33
> (DATAC1_CD_01_LHR300407EXDCL05) in group 1 (DATAC1): lflags 0x0
> NOTE: disk 4 (DATAC1_CD_10_LHR300407EXDCL05) in group 1 (DATAC1) is
> offline for writes
> NOTE: disk 6 (DATAC1_CD_06_LHR300407EXDCL05) in group 1 (DATAC1) is
> offline for writes
> NOTE: disk 7 (DATAC1_CD_07_LHR300407EXDCL05) in group 1 (DATAC1) is
> offline for writes
> NOTE: disk 9 (DATAC1_CD_02_LHR300407EXDCL05) in group 1 (DATAC1) is
> offline for writes
> NOTE: disk 13 (DATAC1_CD_11_LHR300407EXDCL05) in group 1 (DATAC1) is
> offline for writes
> NOTE: disk 15 (DATAC1_CD_03_LHR300407EXDCL05) in group 1 (DATAC1) is
> offline for writes
> NOTE: disk 16 (DATAC1_CD_08_LHR300407EXDCL05) in group 1 (DATAC1) is
> offline for writes
> NOTE: disk 22 (DATAC1_CD_04_LHR300407EXDCL05) in group 1 (DATAC1) is
> offline for writes
> NOTE: disk 23 (DATAC1_CD_09_LHR300407EXDCL05) in group 1 (DATAC1) is
> offline for writes
> NOTE: disk 29 (DATAC1_CD_00_LHR300407EXDCL05) in group 1 (DATAC1) is
> offline for writes
> NOTE: disk 32 (DATAC1_CD_05_LHR300407EXDCL05) in group 1 (DATAC1) is
> offline for writes
> NOTE: disk 33 (DATAC1_CD_01_LHR300407EXDCL05) in group 1 (DATAC1) is
> offline for writes
> 2023-10-30T23:06:54.487905+00:00
> WARNING: group 1 file 541 block 35 read failed.
> ...
> 2023-10-30T23:06:55.132866+00:00
> VJP1DEV(3):WARNING: group 1 file 541 block 1 read failed.
> 2023-10-30T23:06:55.372918+00:00
> WARNING: (post-reap) disk offline and rejecting I/O
> disk: 32, AU: 46031, file number: 545, extent: 18
> 2023-10-30T23:06:55.522459+00:00
> WARNING: group 1 file 541 block 35 read failed.
> 2023-10-30T23:06:55.523436+00:00
> VJP1DEV(3):WARNING: (post-reap) disk offline and rejecting I/O
> VJP1DEV(3): disk: 6, AU: 45266, file number: 554, extent: 7823
> VJP1DEV(3):WARNING: (post-reap) disk offline and rejecting I/O
> VJP1DEV(3): disk: 6, AU: 45266, file number: 554, extent: 7823
> 2023-10-30T23:06:56.527132+00:00
> WARNING: group 1 file 541 block 35 read failed.
> 2023-10-30T23:06:56.956122+00:00
> WARNING: group 1 file 541 block 1 read failed.
> WARNING: group 1 file 541 block 1 read failed.
> 2023-10-30T23:06:57.156280+00:00
> WARNING: group 1 file 541 block 1 read failed.
> 2023-10-30T23:06:57.530830+00:00
> WARNING: group 1 file 541 block 35 read failed.
> 2023-10-30T23:06:57.635218+00:00
> WARNING: group 1 file 541 block 1 read failed.
> WARNING: group 1 file 541 block 1 read failed.
> WARNING: group 1 file 541 block 1 read failed.
> WARNING: group 1 file 541 block 1 read failed.
> VJP1DEV(3):WARNING: group 1 file 541 block 1 read failed.
> VJP1DEV(3):WARNING: group 1 file 541 block 1 read failed.
> VJP1DEV(3):WARNING: group 1 file 541 block 1 read failed.
> VJP1DEV(3):WARNING: group 1 file 541 block 1 read failed.
> VJP1DEV(3):WARNING: group 1 file 541 block 1 read failed.
> ...
> </snip>
>

--
http://www.freelists.org/webpage/oracle-l