Re: 10g clusterware causes reboots

From: Michael Austin <maustin_at_firstdbasource.com>
Date: Mon, 13 Apr 2009 17:15:49 -0500
Message-ID: <tIOEl.15657$8_3.9944_at_flpi147.ffdc.sbc.com>



The Derfer wrote:
> I have Linux (OEL5.2) running 10g clusterware on 2 nodes.
> OCFS2 is running as well, with a SAN-based OCFS2 filesystem
> mounted on both hosts (written to by only one until the other fails
> over).
>
> When I reboot one host, the ethernet interface eth0:2 appears on the
> other, assuming the VIP of the downed host.
> But then when that host comes back up, the 2nd host reboots
> itself outright. Has anyone seen this behavior in either
> clusterware or OCFS2 before? Oracle engineers claim it's
> OCFS2 doing this but I'm not sure. Why would wither host
> reboot at all without me doing the rebooting?
>
> Some lines from dmesg on the first host:
>
> Apr 8 12:04:35 node1 kernel: 0000:00:04.0: eth3: Link is Down
> Apr 8 12:04:38 node1 kernel: o2net: no longer connected to node node2
> (num 1) at 10.156.90.62:7777
> Apr 8 12:04:41 node1 kernel: 0000:00:04.0: eth3: Link is Up 1000 Mbps
> Full Duplex, Flow Control: RX/TX
> Apr 8 12:05:08 node1 kernel: (3485,0):o2net_connect_expired:1637
> ERROR: no connection established with node 1 after 30.0 seconds,
> giving up and returning errors.
> Apr 8 12:05:13 node1 kernel: (3606,0):dlm_send_proxy_ast_msg:457
> ERROR: status = -107
> Apr 8 12:05:13 node1 kernel: (3606,0):dlm_flush_asts:584 ERROR:
> status = -107
> Apr 8 12:05:13 node1 kernel: (3606,0):dlm_send_proxy_ast_msg:457
> ERROR: status = -107
> Apr 8 12:05:13 node1 kernel: (3606,0):dlm_flush_asts:584 ERROR:
> status = -107
> Apr 8 12:05:13 node1 kernel: (3606,0):dlm_send_proxy_ast_msg:457
> ERROR: status = -107
> Apr 8 12:05:13 node1 kernel: (3606,0):dlm_flush_asts:584 ERROR:
> status = -107
> Apr 8 12:05:38 node1 kernel: (3485,0):o2net_connect_expired:1637
> ERROR: no connection established with node 1 after 30.0 seconds,
> giving up and returning errors.
> Apr 8 12:05:47 node1 kernel: 0000:00:04.0: eth3: Link is Down
> Apr 8 12:05:49 node1 kernel: 0000:00:04.0: eth3: Link is Up 10 Mbps
> Full Duplex, Flow Control: RX/TX
> Apr 8 12:05:49 node1 kernel: 0000:00:04.0: eth3: 10/100 speed:
> disabling TSO
> Apr 8 12:06:06 node1 kernel: 0000:00:04.0: eth3: Link is Down
> Apr 8 12:06:08 node1 kernel: 0000:00:04.0: eth3: Link is Up 1000 Mbps
> Full Duplex, Flow Control: RX/TX
> Apr 8 12:06:08 node1 kernel: (3485,0):o2net_connect_expired:1637
> ERROR: no connection established with node 1 after 30.0 seconds,
> giving up and returning errors.
> Apr 8 12:06:38 node1 kernel: (3485,0):o2net_connect_expired:1637
> ERROR: no connection established with node 1 after 30.0 seconds,
> giving up and returning errors.
> Apr 8 12:06:48 node1 kernel: (3591,1):ocfs2_dlm_eviction_cb:98 device
> (120,1): dlm has evicted node 1
> Apr 8 12:06:48 node1 kernel: (14161,1):dlm_get_lock_resource:839
> 3930352DB2134782B730C44078E58F29:M000000000000000000001957f095b1: at
> least one node (1) to recover before lock mastery can begin
> Apr 8 12:06:49 node1 kernel: (14161,1):dlm_get_lock_resource:893
> 3930352DB2134782B730C44078E58F29:M000000000000000000001957f095b1: at
> least one node (1) to recover before lock mastery can begin
> Apr 8 12:06:50 node1 kernel: (3607,1):dlm_get_lock_resource:839
> 3930352DB2134782B730C44078E58F29:$RECOVERY: at least one node (1) to
> recover before lock mastery can begin
> Apr 8 12:06:50 node1 kernel: (3607,1):dlm_get_lock_resource:873
> 3930352DB2134782B730C44078E58F29: recovery map is not empty, but must
> master $RECOVERY lock now
> Apr 8 12:06:50 node1 kernel: (3607,1):dlm_do_recovery:524 (3607) Node
> 0 is the Recovery Master for the Dead Node 1 for Domain
> 3930352DB2134782B730C44078E58F29
> Apr 8 12:07:00 node1 kernel: (14161,1):ocfs2_replay_journal:1076
> Recovering node 1 from slot 1 on device (120,1)
> Apr 8 12:07:02 node1 kernel: kjournald starting. Commit interval 5
> seconds
> Apr 8 12:07:35 node1 sshd[14480]: Accepted password for fbaker from
> 10.156.20.20 port 48972 ssh2
> Apr 8 12:08:25 node1 kernel: 0000:00:04.0: eth3: Link is Down
> Apr 8 12:08:27 node1 kernel: 0000:00:04.0: eth3: Link is Up 1000 Mbps
> Full Duplex, Flow Control: RX/TX
> Apr 8 12:08:44 node1 kernel: 0000:00:04.0: eth3: Link is Down
> Apr 8 12:08:46 node1 kernel: 0000:00:04.0: eth3: Link is Up 1000 Mbps
> Full Duplex, Flow Control: RX/TX
> Apr 8 12:08:57 node1 kernel: o2net: accepted connection from node
> node2 (num 1) at 10.156.90.62:7777
> Apr 8 12:09:01 node1 kernel: ocfs2_dlm: Node 1 joins domain
> 3930352DB2134782B730C44078E58F29
> Apr 8 12:09:01 node1 kernel: ocfs2_dlm: Nodes in domain
> ("3930352DB2134782B730C44078E58F29"): 0 1
> Apr 8 13:47:46 node1 sshd[17710]: Accepted password for btsvetko from
> 10.156.20.20 port 50015 ssh2
> Apr 8 13:55:50 node1 sshd[20717]: Failed password for dmaki from
> 10.156.20.20 port 50108 ssh2
> Apr 8 13:55:58 node1 sshd[20717]: Accepted password for dmaki from
> 10.156.20.20 port 50108 ssh2
> Apr 8 13:55:58 node1 sshd[20808]: subsystem request for sftp
> Apr 8 13:57:20 node1 sshd[21307]: Accepted password for dmaki from
> 10.156.20.20 port 50124 ssh2
> Apr 8 14:20:11 node1 kernel: bnx2: eth0: using MSI
> Apr 8 14:20:11 node1 kernel: ADDRCONF(NETDEV_UP): eth0: link is not
> ready
> Apr 8 14:20:14 node1 kernel: bnx2: eth0 NIC Copper Link is Up, 1000
> Mbps full duplex, receive & transmit flow control ON
> Apr 8 14:20:14 node1 kernel: ADDRCONF(NETDEV_CHANGE): eth0: link
> becomes ready
> Apr 8 14:20:15 node1 kernel: ADDRCONF(NETDEV_UP): eth3: link is not
> ready
> Apr 8 14:20:16 node1 kernel: o2net: no longer connected to node node2
> (num 1) at 10.156.90.62:7777
> Apr 8 14:20:17 node1 kernel: 0000:00:04.0: eth3: Link is Up 1000 Mbps
> Full Duplex, Flow Control: RX/TX
> Apr 8 14:20:17 node1 kernel: ADDRCONF(NETDEV_CHANGE): eth3: link
> becomes ready
> Apr 8 14:20:46 node1 kernel: (3485,0):o2net_connect_expired:1637
> ERROR: no connection established with node 1 after 30.0 seconds,
> giving up and returning errors.
> Apr 8 14:21:14 node1 kernel: (3606,2):dlm_send_proxy_ast_msg:457
> ERROR: status = -107
> Apr 8 14:21:14 node1 kernel: (3606,2):dlm_flush_asts:584 ERROR:
> status = -107
> Apr 8 14:21:14 node1 kernel: (3606,2):dlm_send_proxy_ast_msg:457
> ERROR: status = -107
> Apr 8 14:21:14 node1 kernel: (3606,2):dlm_flush_asts:584 ERROR:
> status = -107
> Apr 8 14:21:14 node1 kernel: (3606,2):dlm_send_proxy_ast_msg:457
> ERROR: status = -107
> Apr 8 14:21:14 node1 kernel: (3606,2):dlm_flush_asts:584 ERROR:
> status = -107
> Apr 8 14:21:16 node1 kernel: (3485,0):o2net_connect_expired:1637
> ERROR: no connection established with node 1 after 30.0 seconds,
> giving up and returning errors.
> Apr 8 14:21:20 node1 kernel: 0000:00:04.0: eth3: Link is Down
> Apr 8 14:21:22 node1 kernel: 0000:00:04.0: eth3: Link is Up 10 Mbps
> Full Duplex, Flow Control: RX/TX
> Apr 8 14:21:22 node1 kernel: 0000:00:04.0: eth3: 10/100 speed:
> disabling TSO
> Apr 8 14:21:40 node1 kernel: 0000:00:04.0: eth3: Link is Down
> Apr 8 14:21:42 node1 kernel: 0000:00:04.0: eth3: Link is Up 1000 Mbps
> Full Duplex, Flow Control: RX/TX
> Apr 8 14:21:46 node1 kernel: (3485,0):o2net_connect_expired:1637
> ERROR: no connection established with node 1 after 30.0 seconds,
> giving up and returning errors.
> Apr 8 14:22:16 node1 kernel: (3485,0):o2net_connect_expired:1637
> ERROR: no connection established with node 1 after 30.0 seconds,
> giving up and returning errors.
> Apr 8 14:22:22 node1 kernel: (3591,1):ocfs2_dlm_eviction_cb:98 device
> (120,1): dlm has evicted node 1
> Apr 8 14:22:22 node1 kernel: (30933,1):ocfs2_replay_journal:1076
> Recovering node 1 from slot 1 on device (120,1)
> Apr 8 14:22:23 node1 kernel: kjournald starting. Commit interval 5
> seconds
> Apr 8 14:22:23 node1 kernel: (3603,1):dlm_get_lock_resource:839
> 3930352DB2134782B730C44078E58F29:M000000000000000000000d57f095b1: at
> least one node (1) to recover before lock mastery can begin
> Apr 8 14:22:24 node1 kernel: (3603,1):dlm_get_lock_resource:893
> 3930352DB2134782B730C44078E58F29:M000000000000000000000d57f095b1: at
> least one node (1) to recover before lock mastery can begin
> Apr 8 14:22:25 node1 kernel: (3607,1):dlm_get_lock_resource:839
> 3930352DB2134782B730C44078E58F29:$RECOVERY: at least one node (1) to
> recover before lock mastery can begin
> Apr 8 14:22:25 node1 kernel: (3607,1):dlm_get_lock_resource:873
> 3930352DB2134782B730C44078E58F29: recovery map is not empty, but must
> master $RECOVERY lock now
> Apr 8 14:22:25 node1 kernel: (3607,1):dlm_do_recovery:524 (3607) Node
> 0 is the Recovery Master for the Dead Node 1 for Domain
> 3930352DB2134782B730C44078E58F29
> Apr 8 14:23:59 node1 kernel: 0000:00:04.0: eth3: Link is Down
> Apr 8 14:24:01 node1 kernel: 0000:00:04.0: eth3: Link is Up 1000 Mbps
> Full Duplex, Flow Control: RX/TX
> Apr 8 14:24:17 node1 kernel: 0000:00:04.0: eth3: Link is Down
> Apr 8 14:24:19 node1 kernel: 0000:00:04.0: eth3: Link is Up 1000 Mbps
> Full Duplex, Flow Control: RX/TX
> Apr 8 14:24:30 node1 kernel: o2net: accepted connection from node
> node2 (num 1) at 10.156.90.62:7777
> Apr 8 14:24:34 node1 kernel: ocfs2_dlm: Node 1 joins domain
> 3930352DB2134782B730C44078E58F29
> Apr 8 14:24:34 node1 kernel: ocfs2_dlm: Nodes in domain
> ("3930352DB2134782B730C44078E58F29"): 0 1
> Apr 8 14:26:01 node1 sshd[32356]: Accepted password for fbaker from
> 10.156.20.20 port 50752 ssh2
> Apr 8 15:21:27 node1 sshd[19725]: Accepted password for fbaker from
> 10.156.20.20 port 51383 ssh2
> Apr 8 15:24:52 node1 kernel: ocfs2_hb_ctl[21047]: segfault at
> 0000000000000000 rip 0000000000428fa0 rsp 00007fff77c60688 error 4
> Apr 8 15:24:52 node1 kernel: ocfs2: Unmounting device (120,1) on
> (node 0)
> Apr 8 15:24:53 node1 xinetd[3676]: Exiting...
> Apr 8 15:24:56 node1 ntpd[3694]: ntpd exiting on signal 15
> Apr 8 15:24:56 node1 rpc.statd[3421]: Caught signal 15, un-
> registering and exiting.
> Apr 8 15:24:56 node1 portmap[21164]: connect from 127.0.0.1 to unset
> (status): request from unprivileged port
> Apr 8 15:24:57 node1 auditd[3036]: The audit daemon is exiting.
> Apr 8 15:24:57 node1 kernel: printk: 233 messages suppressed.
> Apr 8 15:24:57 node1 kernel: audit(1239218697.229:9819): audit_pid=0
> old=3036 by auid=4294967295
> Apr 8 15:24:57 node1 kernel: Kernel logging (proc) stopped.
> Apr 8 15:24:57 node1 kernel: Kernel log daemon terminating.
> Apr 8 15:24:58 node1 exiting on signal 15
> Apr 8 15:26:58 node1 syslogd 1.4.1: restart.
> Apr 8 15:26:58 node1 kernel: klogd 1.4.1, log source = /proc/kmsg
> started.
> Apr 8 15:26:58 node1 kernel: Linux version 2.6.18-92.el5
> (mockbuild_at_ca-build15.us.oracle.com) (gcc version 4.1.2 20071124 (Red
> Hat 4.1.2-41)) #1 SMP Fri May 23 23:40:43 EDT 2008
> Apr 8 15:26:58 node1 kernel: Command line: ro root=LABEL=/ rhgb quiet
> Apr 8 15:26:58 node1 kernel: BIOS-provided physical RAM map:
> Apr 8 15:26:58 node1 kernel: BIOS-e820: 0000000000000000 -
> 00000000000a0000 (usable)
> Apr 8 15:26:58 node1 kernel: BIOS-e820: 0000000000100000 -
> 00000000cfb50000 (usable)
> Apr 8 15:26:58 node1 kernel: BIOS-e820: 00000000cfb50000 -
> 00000000cfb66000 (reserved)
> Apr 8 15:26:58 node1 kernel: BIOS-e820: 00000000cfb66000 -
> 00000000cfb85c00 (ACPI data)
> Apr 8 15:26:58 node1 kernel: BIOS-e820: 00000000cfb85c00 -
> 00000000d0000000 (reserved)
> Apr 8 15:26:58 node1 kernel: BIOS-e820: 00000000e0000000 -
> 00000000f0000000 (reserved)
> Apr 8 15:26:58 node1 kernel: BIOS-e820: 00000000fe000000 -
> 0000000100000000 (reserved)
> Apr 8 15:26:58 node1 kernel: BIOS-e820: 0000000100000000 -
> 0000000130000000 (usable)
> Apr 8 15:26:58 node1 kernel: DMI 2.5 present.
> Apr 8 15:26:58 node1 rpc.statd[3348]: Version 1.0.9 Starting
> Apr 8 15:26:58 node1 modprobe: FATAL: Module ocfs2_stackglue not
> found.
> Apr 8 15:26:59 node1 kernel: No NUMA configuration found
> Apr 8 15:26:59 node1 kernel: Faking a node at
> 0000000000000000-0000000130000000
> Apr 8 15:26:59 node1 kernel: Bootmem setup node 0
> 0000000000000000-0000000130000000
> Apr 8 15:26:59 node1 kernel: Memory for crash kernel (0x0 to 0x0)
> notwithin permissible range
> Apr 8 15:26:59 node1 kernel: disabling kdump
> Apr 8 15:26:59 node1 kernel: ACPI: PM-Timer IO Port: 0x808
> Apr 8 15:26:59 node1 kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id
> [0x00] enabled)
> Apr 8 15:26:59 node1 kernel: Processor #0 7:7 APIC version 20
> Apr 8 15:26:59 node1 kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id
> [0x02] enabled)
> Apr 8 15:26:59 node1 kernel: Processor #2 7:7 APIC version 20
> Apr 8 15:26:59 node1 kernel: ACPI: LAPIC (acpi_id[0x03] lapic_id
> [0x01] enabled)
> Apr 8 15:26:59 node1 kernel: Processor #1 7:7 APIC version 20
> Apr 8 15:26:59 node1 kernel: ACPI: LAPIC (acpi_id[0x04] lapic_id
> [0x03] enabled)
> Apr 8 15:26:59 node1 kernel: Processor #3 7:7 APIC version 20
> Apr 8 15:26:59 node1 kernel: ACPI: LAPIC (acpi_id[0x05] lapic_id
> [0x14] disabled)
> Apr 8 15:26:59 node1 kernel: ACPI: LAPIC (acpi_id[0x06] lapic_id
> [0x15] disabled)
> Apr 8 15:26:59 node1 kernel: ACPI: LAPIC (acpi_id[0x07] lapic_id
> [0x16] disabled)
> Apr 8 15:26:59 node1 kernel: ACPI: LAPIC (acpi_id[0x08] lapic_id
> [0x17] disabled)
> Apr 8 15:26:59 node1 kernel: ACPI: LAPIC_NMI (acpi_id[0xff] high edge
> lint[0x1])
> Apr 8 15:26:59 node1 kernel: ACPI: IOAPIC (id[0x04] address
> [0xfec00000] gsi_base[0])
> Apr 8 15:26:59 node1 kernel: IOAPIC[0]: apic_id 4, version 32,
> address 0xfec00000, GSI 0-23
> Apr 8 15:26:59 node1 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0
> global_irq 2 dfl dfl)
> Apr 8 15:26:59 node1 EV_AGENT[3437]: Line Not Parsed, Line#108
> search /user root - Application and revision : _at_(#) libraid++ Revision
> 6.26.2.0.2 for Linux on 12/5/2007 8:12:01, Error Origination:
> EV_ConfigInfoFileManager::_parseConfigfile()
> Apr 8 15:26:59 node1 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9
> global_irq 9 high level)
> Apr 8 15:26:59 node1 kernel: Setting APIC routing to physical flat
> Apr 8 15:27:00 node1 kernel: ACPI: HPET id: 0x8086a201 base:
> 0xfed00000
> Apr 8 15:27:00 node1 kernel: Using ACPI (MADT) for SMP configuration
> information
> Apr 8 15:27:00 node1 kernel: Nosave address range: 00000000000a0000 -
> 0000000000100000
> Apr 8 15:27:00 node1 kernel: Nosave address range: 00000000cfb50000 -
> 00000000cfb66000
> Apr 8 15:27:00 node1 kernel: Nosave address range: 00000000cfb66000 -
> 00000000cfb85000
> Apr 8 15:27:00 node1 kernel: Nosave address range: 00000000cfb85000 -
> 00000000cfb86000
> Apr 8 15:27:00 node1 kernel: Nosave address range: 00000000cfb86000 -
> 00000000d0000000
> Apr 8 15:27:00 node1 kernel: Nosave address range: 00000000d0000000 -
> 00000000e0000000
> Apr 8 15:27:00 node1 kernel: Nosave address range: 00000000e0000000 -
> 00000000f0000000
> Apr 8 15:27:00 node1 kernel: Nosave address range: 00000000f0000000 -
> 00000000fe000000
> Apr 8 15:27:00 node1 kernel: Nosave address range: 00000000fe000000 -
> 0000000100000000
> Apr 8 15:27:00 node1 kernel: Allocating PCI resources starting at
> d1000000 (gap: d0000000:10000000)
> Apr 8 15:27:00 node1 kernel: SMP: Allowing 8 CPUs, 4 hotplug CPUs
> Apr 8 15:27:00 node1 kernel: Built 1 zonelists. Total pages: 1029006
> Apr 8 15:27:00 node1 kernel: Kernel command line: ro root=LABEL=/
> rhgb quiet
> Apr 8 15:27:00 node1 kernel: Initializing CPU#0
> Apr 8 15:27:00 node1 kernel: PID hash table entries: 4096 (order: 12,
> 32768 bytes)
> Apr 8 15:27:00 node1 kernel: Console: colour VGA+ 80x25
> Apr 8 15:27:00 node1 kernel: Dentry cache hash table entries: 524288
> (order: 10, 4194304 bytes)
> Apr 8 15:27:00 node1 kernel: Inode-cache hash table entries: 262144
> (order: 9, 2097152 bytes)
> Apr 8 15:27:00 node1 kernel: Checking aperture...
> Apr 8 15:27:00 node1 kernel: PCI-DMA: Using software bounce buffering
> for IO (SWIOTLB)
> Apr 8 15:27:00 node1 kernel: Placing software IO TLB between
> 0x165d000 - 0x565d000
> Apr 8 15:27:00 node1 kernel: Memory: 4040256k/4980736k available
> (2457k kernel code, 148864k reserved, 1246k data, 196k init)
> Apr 8 15:27:00 node1 kernel: Calibrating delay using timer specific
> routine.. 5989.09 BogoMIPS (lpj=2994549)
> Apr 8 15:27:00 node1 kernel: Security Framework v1.0.0 initialized
> Apr 8 15:27:00 node1 kernel: SELinux: Initializing.
> Apr 8 15:27:00 node1 kernel: selinux_register_security: Registering
> secondary module capability
> Apr 8 15:27:00 node1 kernel: Capability LSM initialized as secondary
> Apr 8 15:27:01 node1 kernel: Mount-cache hash table entries: 256
> Apr 8 15:27:01 node1 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
> Apr 8 15:27:01 node1 kernel: CPU: L2 cache: 6144K
> Apr 8 15:27:01 node1 kernel: using mwait in idle threads.
> Apr 8 15:27:01 node1 kernel: CPU: Physical Processor ID: 0
> Apr 8 15:27:01 node1 kernel: CPU: Processor Core ID: 0
> Apr 8 15:27:01 node1 kernel: CPU0: Thermal monitoring enabled (TM1)
> Apr 8 15:27:01 node1 kernel: SMP alternatives: switching to UP code
> Apr 8 15:27:01 node1 kernel: ACPI: Core revision 20060707
> Apr 8 15:27:01 node1 kernel: Using local APIC timer interrupts.
> Apr 8 15:27:01 node1 kernel: result 20781505
> Apr 8 15:27:01 node1 kernel: Detected 20.781 MHz APIC timer.
> Apr 8 15:27:01 node1 kernel: SMP alternatives: switching to SMP code
> Apr 8 15:27:01 node1 Navisphere Agent[3437]: Agent initializing with
> pid 3437
> Apr 8 15:27:01 node1 kernel: Booting processor 1/4 APIC 0x2
> Apr 8 15:27:01 node1 kernel: Initializing CPU#1
> Apr 8 15:27:01 node1 kernel: Calibrating delay using timer specific
> routine.. 5985.00 BogoMIPS (lpj=2992504)
> Apr 8 15:27:01 node1 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
> Apr 8 15:27:01 node1 kernel: CPU: L2 cache: 6144K
> Apr 8 15:27:01 node1 kernel: CPU: Physical Processor ID: 0
> Apr 8 15:27:01 node1 kernel: CPU: Processor Core ID: 2
> Apr 8 15:27:01 node1 kernel: CPU1: Thermal monitoring enabled (TM2)
> Apr 8 15:27:01 node1 kernel: Intel(R) Xeon(R) CPU E5450 _at_
> 3.00GHz stepping 06
> Apr 8 15:27:01 node1 kernel: CPU 1: Syncing TSC to CPU 0.
> Apr 8 15:27:01 node1 kernel: CPU 1: synchronized TSC with CPU 0 (last
> diff -2071 cycles, maxerr 594 cycles)
> Apr 8 15:27:01 node1 kernel: SMP alternatives: switching to SMP code
> Apr 8 15:27:01 node1 kernel: Booting processor 2/4 APIC 0x1
> Apr 8 15:27:01 node1 kernel: Initializing CPU#2
> Apr 8 15:27:02 node1 kernel: Calibrating delay using timer specific
> routine.. 5984.25 BogoMIPS (lpj=2992127)
> Apr 8 15:27:02 node1 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
> Apr 8 15:27:02 node1 kernel: CPU: L2 cache: 6144K
> Apr 8 15:27:02 node1 kernel: CPU: Physical Processor ID: 0
> Apr 8 15:27:02 node1 kernel: CPU: Processor Core ID: 1
> Apr 8 15:27:02 node1 kernel: CPU2: Thermal monitoring enabled (TM2)
> Apr 8 15:27:02 node1 kernel: Intel(R) Xeon(R) CPU E5450 _at_
> 3.00GHz stepping 06
> Apr 8 15:27:02 node1 kernel: CPU 2: Syncing TSC to CPU 0.
> Apr 8 15:27:02 node1 kernel: CPU 2: synchronized TSC with CPU 0 (last
> diff -2056 cycles, maxerr 594 cycles)
> Apr 8 15:27:02 node1 kernel: SMP alternatives: switching to SMP code
> Apr 8 15:27:02 node1 kernel: Booting processor 3/4 APIC 0x3
> Apr 8 15:27:02 node1 kernel: Initializing CPU#3
> Apr 8 15:27:02 node1 kernel: Calibrating delay using timer specific
> routine.. 5985.00 BogoMIPS (lpj=2992504)
> Apr 8 15:27:02 node1 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
> Apr 8 15:27:02 node1 EV_AGENT[3493]: Agent daemon process created,
> pid 3493
> Apr 8 15:27:02 node1 kernel: CPU: L2 cache: 6144K
> Apr 8 15:27:02 node1 EV_AGENT[3493]: Agent has started up.
> Apr 8 15:27:02 node1 kernel: CPU: Physical Processor ID: 0
> Apr 8 15:27:02 node1 kernel: CPU: Processor Core ID: 3
> Apr 8 15:27:02 node1 kernel: CPU3: Thermal monitoring enabled (TM2)
> Apr 8 15:27:02 node1 kernel: Intel(R) Xeon(R) CPU E5450 _at_
> 3.00GHz stepping 06
> Apr 8 15:27:02 node1 kernel: CPU 3: Syncing TSC to CPU 0.
> Apr 8 15:27:02 node1 kernel: CPU 3: synchronized TSC with CPU 0 (last
> diff -2052 cycles, maxerr 594 cycles)
> Apr 8 15:27:02 node1 kernel: Brought up 4 CPUs
> Apr 8 15:27:02 node1 kernel: testing NMI watchdog ... OK.
> Apr 8 15:27:02 node1 kernel: time.c: Using 14.318180 MHz WALL HPET
> GTOD HPET timer.
> Apr 8 15:27:02 node1 kernel: time.c: Detected 2992.536 MHz processor.
> Apr 8 15:27:03 node1 kernel: migration_cost=18,3689
> Apr 8 15:27:03 node1 kernel: checking if image is initramfs... it is
> Apr 8 15:27:03 node1 kernel: Freeing initrd memory: 2970k freed
> Apr 8 15:27:03 node1 kernel: NET: Registered protocol family 16
> Apr 8 15:27:03 node1 kernel: No dock devices found.
> Apr 8 15:27:03 node1 kernel: ACPI: bus type pci registered
> Apr 8 15:27:03 node1 kernel: PCI: Using MMCONFIG at e0000000
> Apr 8 15:27:03 node1 kernel: PCI: Buses that can't use MMCONFIG will
> use type 1 PCI conf access.
> Apr 8 15:27:03 node1 kernel: ACPI: Interpreter enabled
> Apr 8 15:27:03 node1 kernel: ACPI: Using IOAPIC for interrupt routing
> Apr 8 15:27:03 node1 kernel: ACPI: PCI Root Bridge [PCI0] (0000:00)
> Apr 8 15:27:03 node1 kernel: PCI: Dell PowerEdge 1950 detected,
> enabling pci=bfsort.
> Apr 8 15:27:03 node1 kernel: PCI: Ignoring BAR0-3 of IDE controller
> 0000:00:1f.1
> Apr 8 15:27:03 node1 kernel: PCI: Transparent bridge - 0000:00:1e.0
> Apr 8 15:27:04 node1 kernel: ACPI: PCI Interrupt Link [LK00] (IRQs 3
> 4 5 *6 7 10 11 12)
> Apr 8 15:27:04 node1 kernel: ACPI: PCI Interrupt Link [LK01] (IRQs 3
> 4 *5 6 7 10 11 12)
> Apr 8 15:27:04 node1 kernel: ACPI: PCI Interrupt Link [LK02] (IRQs 3
> 4 5 6 7 10 11 12) *0, disabled.
> Apr 8 15:27:04 node1 kernel: ACPI: PCI Interrupt Link [LK03] (IRQs 3
> 4 5 6 7 10 *11 12)
> Apr 8 15:27:04 node1 kernel: ACPI: PCI Interrupt Link [LK04] (IRQs 3
> 4 5 6 7 *10 11 12)
> Apr 8 15:27:04 node1 kernel: ACPI: PCI Interrupt Link [LK05] (IRQs 3
> 4 5 6 7 10 *11 12)
> Apr 8 15:27:04 node1 kernel: ACPI: PCI Interrupt Link [LK06] (IRQs 3
> 4 5 6 7 10 11 12) *0, disabled.
> Apr 8 15:27:04 node1 kernel: ACPI: PCI Interrupt Link [LK07] (IRQs 3
> 4 5 6 7 10 11 12) *0, disabled.
> Apr 8 15:27:04 node1 kernel: Linux Plug and Play Support v0.97 (c)
> Adam Belay
> Apr 8 15:27:04 node1 kernel: pnp: PnP ACPI init
> Apr 8 15:27:04 node1 kernel: pnp: PnP ACPI: found 12 devices
> Apr 8 15:27:04 node1 kernel: usbcore: registered new driver usbfs
> Apr 8 15:27:04 node1 kernel: usbcore: registered new driver hub
> Apr 8 15:27:04 node1 kernel: PCI: Using ACPI for IRQ routing
> Apr 8 15:27:04 node1 kernel: PCI: If a device doesn't work, try
> "pci=routeirq". If it helps, post a report
> Apr 8 15:27:04 node1 kernel: NetLabel: Initializing
> Apr 8 15:27:04 node1 kernel: NetLabel: domain hash size = 128
> Apr 8 15:27:04 node1 kernel: NetLabel: protocols = UNLABELED CIPSOv4
> Apr 8 15:27:04 node1 kernel: NetLabel: unlabeled traffic allowed by
> default
> Apr 8 15:27:04 node1 kernel: hpet0: at MMIO 0xfed00000 (virtual
> 0xffffffffff5fe000), IRQs 2, 8, 0
> Apr 8 15:27:04 node1 kernel: hpet0: 3 64-bit timers, 14318180 Hz
> Apr 8 15:27:04 node1 kernel: PCI-GART: No AMD northbridge found.
> Apr 8 15:27:04 node1 kernel: pnp: 00:08: ioport range 0x800-0x87f
> could not be reserved
> Apr 8 15:27:04 node1 kernel: pnp: 00:08: ioport range 0x880-0x8bf has
> been reserved
> Apr 8 15:27:04 node1 kernel: pnp: 00:08: ioport range 0x8c0-0x8df has
> been reserved
> Apr 8 15:27:04 node1 kernel: pnp: 00:08: ioport range 0x8e0-0x8e3 has
> been reserved
> Apr 8 15:27:04 node1 kernel: pnp: 00:08: ioport range 0x900-0x900 has
> been reserved
> Apr 8 15:27:04 node1 kernel: pnp: 00:08: ioport range 0xc00-0xc7f has
> been reserved
> Apr 8 15:27:04 node1 kernel: pnp: 00:08: ioport range 0xca0-0xca7 has
> been reserved
> Apr 8 15:27:04 node1 kernel: pnp: 00:08: ioport range 0xca9-0xcab has
> been reserved
> Apr 8 15:27:04 node1 kernel: pnp: 00:09: ioport range 0xca8-0xca8 has
> been reserved
> Apr 8 15:27:04 node1 kernel: pnp: 00:09: ioport range 0xcac-0xcac has
> been reserved
> Apr 8 15:27:05 node1 kernel: PCI: Bridge: 0000:06:00.0
> Apr 8 15:27:05 node1 kernel: IO window: disabled.
> Apr 8 15:27:05 node1 kernel: MEM window: f4000000-f7ffffff
> Apr 8 15:27:05 node1 kernel: PREFETCH window: disabled.
> Apr 8 15:27:05 node1 kernel: PCI: Bridge: 0000:05:00.0
> Apr 8 15:27:05 node1 kernel: IO window: disabled.
> Apr 8 15:27:05 node1 kernel: MEM window: f4000000-f7ffffff
> Apr 8 15:27:05 node1 kernel: PREFETCH window: disabled.
> Apr 8 15:27:05 node1 kernel: PCI: Bridge: 0000:05:01.0
> Apr 8 15:27:05 node1 kernel: IO window: disabled.
> Apr 8 15:27:05 node1 kernel: MEM window: disabled.
> Apr 8 15:27:05 node1 kernel: PREFETCH window: disabled.
> Apr 8 15:27:05 node1 kernel: PCI: Bridge: 0000:04:00.0
> Apr 8 15:27:05 node1 kernel: IO window: disabled.
> Apr 8 15:27:05 node1 kernel: MEM window: f4000000-f7ffffff
> Apr 8 15:27:05 node1 kernel: PREFETCH window: disabled.
> Apr 8 15:27:05 node1 kernel: PCI: Bridge: 0000:04:00.3
> Apr 8 15:27:05 node1 kernel: IO window: disabled.
> Apr 8 15:27:05 node1 kernel: MEM window: disabled.
> Apr 8 15:27:05 node1 kernel: PREFETCH window: disabled.
> Apr 8 15:27:05 node1 kernel: PCI: Bridge: 0000:00:02.0
> Apr 8 15:27:05 node1 kernel: IO window: disabled.
> Apr 8 15:27:05 node1 kernel: MEM window: f2000000-f7ffffff
> Apr 8 15:27:05 node1 kernel: PREFETCH window: disabled.
> Apr 8 15:27:05 node1 kernel: PCI: Bridge: 0000:00:03.0
> Apr 8 15:27:05 node1 kernel: IO window: e000-efff
> Apr 8 15:27:05 node1 kernel: MEM window: fc700000-fc8fffff
> Apr 8 15:27:05 node1 kernel: PREFETCH window: disabled.
> Apr 8 15:27:06 node1 kernel: PCI: Bridge: 0000:00:04.0
> Apr 8 15:27:06 node1 kernel: IO window: d000-dfff
> Apr 8 15:27:06 node1 kernel: MEM window: fc500000-fc6fffff
> Apr 8 15:27:06 node1 kernel: PREFETCH window: disabled.
> Apr 8 15:27:06 node1 kernel: PCI: Bridge: 0000:00:05.0
> Apr 8 15:27:06 node1 kernel: IO window: disabled.
> Apr 8 15:27:06 node1 kernel: MEM window: disabled.
> Apr 8 15:27:06 node1 kernel: PREFETCH window: disabled.
> Apr 8 15:27:06 node1 kernel: PCI: Bridge: 0000:00:06.0
> Apr 8 15:27:06 node1 kernel: IO window: c000-cfff
> Apr 8 15:27:06 node1 kernel: MEM window: fc300000-fc4fffff
> Apr 8 15:27:06 node1 kernel: PREFETCH window: d1000000-d10fffff
> Apr 8 15:27:06 node1 kernel: PCI: Bridge: 0000:00:07.0
> Apr 8 15:27:06 node1 kernel: IO window: disabled.
> Apr 8 15:27:06 node1 kernel: MEM window: disabled.
> Apr 8 15:27:06 node1 kernel: PREFETCH window: disabled.
> Apr 8 15:27:06 node1 kernel: PCI: Bridge: 0000:02:00.0
> Apr 8 15:27:06 node1 kernel: IO window: disabled.
> Apr 8 15:27:06 node1 kernel: MEM window: f8000000-fbffffff
> Apr 8 15:27:06 node1 kernel: PREFETCH window: disabled.
> Apr 8 15:27:06 node1 kernel: PCI: Bridge: 0000:00:1c.0
> Apr 8 15:27:06 node1 kernel: IO window: disabled.
> Apr 8 15:27:06 node1 kernel: MEM window: f8000000-fbffffff
> Apr 8 15:27:06 node1 kernel: PREFETCH window: disabled.
> Apr 8 15:27:06 node1 kernel: PCI: Bridge: 0000:00:1e.0
> Apr 8 15:27:06 node1 kernel: IO window: b000-bfff
> Apr 8 15:27:06 node1 kernel: MEM window: fc100000-fc2fffff
> Apr 8 15:27:06 node1 kernel: PREFETCH window: d8000000-dfffffff
> Apr 8 15:27:07 node1 kernel: GSI 16 sharing vector 0xA9 and IRQ 16
> Apr 8 15:27:07 node1 kernel: ACPI: PCI Interrupt 0000:00:02.0[A] ->
> GSI 16 (level, low) -> IRQ 169
> Apr 8 15:27:07 node1 kernel: ACPI: PCI Interrupt 0000:04:00.0[A] ->
> GSI 16 (level, low) -> IRQ 169
> Apr 8 15:27:07 node1 kernel: ACPI: PCI Interrupt 0000:05:00.0[A] ->
> GSI 16 (level, low) -> IRQ 169
> Apr 8 15:27:07 node1 kernel: ACPI: PCI Interrupt 0000:05:01.0[A] ->
> GSI 16 (level, low) -> IRQ 169
> Apr 8 15:27:07 node1 kernel: ACPI: PCI Interrupt 0000:00:03.0[A] ->
> GSI 16 (level, low) -> IRQ 169
> Apr 8 15:27:07 node1 kernel: ACPI: PCI Interrupt 0000:00:04.0[A] ->
> GSI 16 (level, low) -> IRQ 169
> Apr 8 15:27:07 node1 kernel: ACPI: PCI Interrupt 0000:00:06.0[A] ->
> GSI 16 (level, low) -> IRQ 169
> Apr 8 15:27:07 node1 kernel: ACPI: PCI Interrupt 0000:00:1c.0[A] ->
> GSI 16 (level, low) -> IRQ 169
> Apr 8 15:27:07 node1 kernel: NET: Registered protocol family 2
> Apr 8 15:27:07 node1 kernel: IP route cache hash table entries:
> 131072 (order: 8, 1048576 bytes)
> Apr 8 15:27:07 node1 kernel: TCP established hash table entries:
> 262144 (order: 10, 4194304 bytes)
> Apr 8 15:27:07 node1 kernel: TCP bind hash table entries: 65536
> (order: 8, 1048576 bytes)
> Apr 8 15:27:07 node1 kernel: TCP: Hash tables configured (established
> 262144 bind 65536)
> Apr 8 15:27:07 node1 kernel: TCP reno registered
> Apr 8 15:27:07 node1 kernel: audit: initializing netlink socket
> (disabled)
> Apr 8 15:27:07 node1 kernel: audit(1239218779.491:1): initialized
> Apr 8 15:27:07 node1 kernel: Total HugeTLB memory allocated, 0
> Apr 8 15:27:07 node1 kernel: VFS: Disk quotas dquot_6.5.1
> Apr 8 15:27:07 node1 kernel: Dquot-cache hash table entries: 512
> (order 0, 4096 bytes)
> Apr 8 15:27:08 node1 kernel: Initializing Cryptographic API
> Apr 8 15:27:08 node1 kernel: ksign: Installing public key data
> Apr 8 15:27:08 node1 kernel: Loading keyring
> Apr 8 15:27:08 node1 kernel: - Added public key 660501D58C5397BD
> Apr 8 15:27:08 node1 kernel: - User ID: Red Hat, Inc. (Kernel Module
> GPG key)
> Apr 8 15:27:08 node1 kernel: io scheduler noop registered
> Apr 8 15:27:08 node1 kernel: io scheduler anticipatory registered
> Apr 8 15:27:08 node1 kernel: io scheduler deadline registered
> Apr 8 15:27:08 node1 kernel: io scheduler cfq registered (default)
> Apr 8 15:27:08 node1 kernel: assign_interrupt_mode Found MSI
> capability
> Apr 8 15:27:08 node1 last message repeated 5 times
> Apr 8 15:27:08 node1 automount[3552]: lookup_read_master: lookup
> (nisplus): couldn't locate nis+ table auto.master
> Apr 8 15:27:08 node1 kernel: assign_interrupt_mode Found MSI
> capability
> Apr 8 15:27:09 node1 last message repeated 2 times
> Apr 8 15:27:09 node1 kernel: pci_hotplug: PCI Hot Plug PCI Core
> version: 0.5
> Apr 8 15:27:09 node1 kernel: ACPI: CPU0 (power states: C1[C1] C3[C3])
> Apr 8 15:27:09 node1 kernel: ACPI: CPU1 (power states: C1[C1] C3[C3])
> Apr 8 15:27:09 node1 kernel: ACPI: CPU2 (power states: C1[C1] C3[C3])
> Apr 8 15:27:09 node1 kernel: ACPI: CPU3 (power states: C1[C1] C3[C3])
> Apr 8 15:27:09 node1 kernel: ACPI Exception (acpi_processor-0681):
> AE_NOT_FOUND, Processor Device is not present [20060707]
> Apr 8 15:27:09 node1 kernel: ACPI: Getting cpuindex for acpiid 0x5
> Apr 8 15:27:09 node1 kernel: ACPI Exception (acpi_processor-0681):
> AE_NOT_FOUND, Processor Device is not present [20060707]
> Apr 8 15:27:09 node1 kernel: ACPI: Getting cpuindex for acpiid 0x6
> Apr 8 15:27:09 node1 kernel: ACPI Exception (acpi_processor-0681):
> AE_NOT_FOUND, Processor Device is not present [20060707]
> Apr 8 15:27:09 node1 kernel: ACPI: Getting cpuindex for acpiid 0x7
> Apr 8 15:27:09 node1 kernel: ACPI Exception (acpi_processor-0681):
> AE_NOT_FOUND, Processor Device is not present [20060707]
> Apr 8 15:27:09 node1 kernel: ACPI: Getting cpuindex for acpiid 0x8
> Apr 8 15:27:09 node1 kernel: Real Time Clock Driver v1.12ac
> Apr 8 15:27:09 node1 kernel: Non-volatile memory driver v1.2
> Apr 8 15:27:09 node1 kernel: Linux agpgart interface v0.101 (c) Dave
> Jones
> Apr 8 15:27:09 node1 kernel: Serial: 8250/16550 driver $Revision:
> 1.90 $ 4 ports, IRQ sharing enabled
> Apr 8 15:27:09 node1 kernel: serial8250: ttyS0 at I/O 0x3f8 (irq = 4)
> is a 16550A
> Apr 8 15:27:09 node1 kernel: serial8250: ttyS1 at I/O 0x2f8 (irq = 3)
> is a 16550A
> Apr 8 15:27:09 node1 kernel: 00:06: ttyS0 at I/O 0x3f8 (irq = 4) is a
> 16550A
> Apr 8 15:27:09 node1 kernel: 00:07: ttyS1 at I/O 0x2f8 (irq = 3) is a
> 16550A
> Apr 8 15:27:09 node1 kernel: RAMDISK driver initialized: 16 RAM disks
> of 16384K size 4096 blocksize
> Apr 8 15:27:09 node1 kernel: Uniform Multi-Platform E-IDE driver
> Revision: 7.00alpha2
> Apr 8 15:27:09 node1 kernel: ide: Assuming 33MHz system bus speed for
> PIO modes; override with idebus=xx
> Apr 8 15:27:09 node1 kernel: ESB2: IDE controller at PCI slot
> 0000:00:1f.1
> Apr 8 15:27:10 node1 kernel: ACPI: PCI Interrupt 0000:00:1f.1[A] ->
> GSI 16 (level, low) -> IRQ 169
> Apr 8 15:27:10 node1 kernel: ESB2: chipset revision 9
> Apr 8 15:27:10 node1 kernel: ESB2: not 100% native mode: will probe
> irqs later
> Apr 8 15:27:10 node1 kernel: ide0: BM-DMA at 0xfc00-0xfc07, BIOS
> settings: hda:DMA, hdb:pio
> Apr 8 15:27:10 node1 kernel: hda: TEAC DVD-ROM DV28EV, ATAPI CD/DVD-
> ROM drive
> Apr 8 15:27:10 node1 kernel: ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
> Apr 8 15:27:10 node1 kernel: ide-floppy driver 0.99.newide
> Apr 8 15:27:10 node1 kernel: usbcore: registered new driver hiddev
> Apr 8 15:27:10 node1 kernel: usbcore: registered new driver usbhid
> Apr 8 15:27:10 node1 kernel: drivers/usb/input/hid-core.c: v2.6:USB
> HID core driver
> Apr 8 15:27:10 node1 kernel: PNP: No PS/2 controller found. Probing
> ports directly.
> Apr 8 15:27:10 node1 kernel: serio: i8042 KBD port at 0x60,0x64 irq 1
> Apr 8 15:27:10 node1 kernel: serio: i8042 AUX port at 0x60,0x64 irq
> 12
> Apr 8 15:27:10 node1 kernel: mice: PS/2 mouse device common for all
> mice
> Apr 8 15:27:10 node1 kernel: md: md driver 0.90.3 MAX_MD_DEVS=256,
> MD_SB_DISKS=27
> Apr 8 15:27:10 node1 kernel: md: bitmap version 4.39
> Apr 8 15:27:10 node1 kernel: TCP bic registered
> Apr 8 15:27:10 node1 kernel: Initializing IPsec netlink socket
> Apr 8 15:27:10 node1 kernel: NET: Registered protocol family 1
> Apr 8 15:27:10 node1 kernel: NET: Registered protocol family 17
> Apr 8 15:27:10 node1 kernel: ACPI: (supports S0 S4 S5)
> Apr 8 15:27:10 node1 kernel: Freeing unused kernel memory: 196k freed
> Apr 8 15:27:10 node1 kernel: Write protecting the kernel read-only
> data: 475k
> Apr 8 15:27:10 node1 kernel: SCSI subsystem initialized
> Apr 8 15:27:10 node1 kernel: QLogic Fibre Channel HBA Driver:
> 8.02.14.01
> Apr 8 15:27:10 node1 kernel: ACPI: PCI Interrupt 0000:0c:00.0[A] ->
> GSI 16 (level, low) -> IRQ 169
> Apr 8 15:27:10 node1 kernel: qla2xxx 0000:0c:00.0: Found an ISP2432,
> irq 169, iobase 0xffffc20000002000
> Apr 8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: Configuring PCI
> space...
> Apr 8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: Configure NVRAM
> parameters...
> Apr 8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: Verifying loaded
> RISC code...
> Apr 8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: Allocated (64 KB)
> for EFT...
> Apr 8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: Allocated (1413
> KB) for firmware dump...
> Apr 8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: Waiting for LIP to
> complete...
> Apr 8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: LIP reset occured
> (f700).
> Apr 8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: LIP occured
> (f700).
> Apr 8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: LIP reset occured
> (f7f7).
> Apr 8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: LOOP UP detected
> (4 Gbps).
> Apr 8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: Topology -
> (F_Port), Host Loop address 0x0
> Apr 8 15:27:11 node1 kernel: scsi0 : qla2xxx
> Apr 8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0:
> Apr 8 15:27:11 node1 kernel: QLogic Fibre Channel HBA Driver:
> 8.02.14.01
> Apr 8 15:27:11 node1 kernel: QLogic QLE2462 - PCI-Express to 4Gb
> FC, Dual Channel
> Apr 8 15:27:11 node1 kernel: ISP2432: PCIe (2.5GT/s x4) _at_ 0000:0c:
> 00.0 hdma+, host#=0, fw=4.04.00 [IP] [84XX]
> Apr 8 15:27:11 node1 kernel: Vendor: DGC Model: RAID
> 5 Rev: 0326
> Apr 8 15:27:11 node1 kernel: Type: Direct-
> Access ANSI SCSI revision: 04
> Apr 8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: scsi(0:0:0:0):
> Enabled tagged queuing, queue depth 32.
> Apr 8 15:27:11 node1 kernel: SCSI device sda: 560557312 512-byte hdwr
> sectors (287005 MB)
> Apr 8 15:27:11 node1 kernel: sda: test WP failed, assume Write
> Enabled
> Apr 8 15:27:11 node1 kernel: sda: asking for cache data failed
> Apr 8 15:27:11 node1 kernel: sda: assuming drive cache: write through
> Apr 8 15:27:11 node1 kernel: SCSI device sda: 560557312 512-byte hdwr
> sectors (287005 MB)
> Apr 8 15:27:11 node1 kernel: sda: test WP failed, assume Write
> Enabled
> Apr 8 15:27:11 node1 kernel: sda: asking for cache data failed
> Apr 8 15:27:11 node1 kernel: sda: assuming drive cache: write through
> Apr 8 15:27:11 node1 kernel: sda:<6>sd 0:0:0:0: Device not ready:
> <6>: Current: sense key: Not Ready
> Apr 8 15:27:12 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:12 node1 kernel:
> Apr 8 15:27:12 node1 kernel: end_request: I/O error, dev sda, sector
> 0
> Apr 8 15:27:12 node1 kernel: Buffer I/O error on device sda, logical
> block 0
> Apr 8 15:27:12 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:12 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:12 node1 kernel:
> Apr 8 15:27:12 node1 kernel: end_request: I/O error, dev sda, sector
> 0
> Apr 8 15:27:12 node1 kernel: Buffer I/O error on device sda, logical
> block 0
> Apr 8 15:27:12 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:12 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:12 node1 kernel:
> Apr 8 15:27:12 node1 kernel: end_request: I/O error, dev sda, sector
> 0
> Apr 8 15:27:12 node1 kernel: Buffer I/O error on device sda, logical
> block 0
> Apr 8 15:27:12 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:12 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:12 node1 kernel:
> Apr 8 15:27:12 node1 kernel: end_request: I/O error, dev sda, sector
> 0
> Apr 8 15:27:12 node1 kernel: Buffer I/O error on device sda, logical
> block 0
> Apr 8 15:27:12 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:12 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:12 node1 kernel:
> Apr 8 15:27:12 node1 kernel: end_request: I/O error, dev sda, sector
> 0
> Apr 8 15:27:12 node1 kernel: Buffer I/O error on device sda, logical
> block 0
> Apr 8 15:27:12 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:12 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:12 node1 kernel:
> Apr 8 15:27:12 node1 kernel: end_request: I/O error, dev sda, sector
> 0
> Apr 8 15:27:13 node1 kernel: Buffer I/O error on device sda, logical
> block 0
> Apr 8 15:27:13 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:13 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:13 node1 kernel:
> Apr 8 15:27:13 node1 kernel: end_request: I/O error, dev sda, sector
> 0
> Apr 8 15:27:13 node1 kernel: Buffer I/O error on device sda, logical
> block 0
> Apr 8 15:27:13 node1 kernel: Dev sda: unable to read RDB block 0
> Apr 8 15:27:13 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:13 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:13 node1 kernel:
> Apr 8 15:27:13 node1 kernel: end_request: I/O error, dev sda, sector
> 0
> Apr 8 15:27:13 node1 kernel: Buffer I/O error on device sda, logical
> block 0
> Apr 8 15:27:13 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:13 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:13 node1 kernel:
> Apr 8 15:27:13 node1 kernel: end_request: I/O error, dev sda, sector
> 0
> Apr 8 15:27:13 node1 kernel: Buffer I/O error on device sda, logical
> block 0
> Apr 8 15:27:13 node1 kernel: unable to read partition table
> Apr 8 15:27:13 node1 kernel: sd 0:0:0:0: Attached scsi disk sda
> Apr 8 15:27:13 node1 kernel: Vendor: DGC Model: RAID
> 5 Rev: 0326
> Apr 8 15:27:13 node1 kernel: Type: Direct-
> Access ANSI SCSI revision: 04
> Apr 8 15:27:13 node1 kernel: qla2xxx 0000:0c:00.0: scsi(0:0:1:0):
> Enabled tagged queuing, queue depth 32.
> Apr 8 15:27:13 node1 kernel: SCSI device sdb: 560557312 512-byte hdwr
> sectors (287005 MB)
> Apr 8 15:27:13 node1 kernel: sdb: Write Protect is off
> Apr 8 15:27:13 node1 kernel: SCSI device sdb: drive cache: write
> through
> Apr 8 15:27:13 node1 kernel: SCSI device sdb: 560557312 512-byte hdwr
> sectors (287005 MB)
> Apr 8 15:27:13 node1 kernel: sdb: Write Protect is off
> Apr 8 15:27:14 node1 kernel: SCSI device sdb: drive cache: write
> through
> Apr 8 15:27:14 node1 kernel: sdb: sdb1
> Apr 8 15:27:14 node1 kernel: sd 0:0:1:0: Attached scsi disk sdb
> Apr 8 15:27:14 node1 kernel: GSI 17 sharing vector 0x42 and IRQ 17
> Apr 8 15:27:14 node1 kernel: ACPI: PCI Interrupt 0000:0c:00.1[B] ->
> GSI 17 (level, low) -> IRQ 66
> Apr 8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: Found an ISP2432,
> irq 66, iobase 0xffffc20000004000
> Apr 8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: Configuring PCI
> space...
> Apr 8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: Configure NVRAM
> parameters...
> Apr 8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: Verifying loaded
> RISC code...
> Apr 8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: Allocated (64 KB)
> for EFT...
> Apr 8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: Allocated (1413
> KB) for firmware dump...
> Apr 8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: Waiting for LIP to
> complete...
> Apr 8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: LIP reset occured
> (f700).
> Apr 8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: LIP occured
> (f700).
> Apr 8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: LIP reset occured
> (f7f7).
> Apr 8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: LOOP UP detected
> (4 Gbps).
> Apr 8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: Topology -
> (F_Port), Host Loop address 0x0
> Apr 8 15:27:14 node1 kernel: scsi1 : qla2xxx
> Apr 8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1:
> Apr 8 15:27:14 node1 kernel: QLogic Fibre Channel HBA Driver:
> 8.02.14.01
> Apr 8 15:27:14 node1 kernel: QLogic QLE2462 - PCI-Express to 4Gb
> FC, Dual Channel
> Apr 8 15:27:14 node1 kernel: ISP2432: PCIe (2.5GT/s x4) _at_ 0000:0c:
> 00.1 hdma+, host#=1, fw=4.04.00 [IP] [84XX]
> Apr 8 15:27:14 node1 kernel: Vendor: DGC Model: RAID
> 5 Rev: 0326
> Apr 8 15:27:14 node1 kernel: Type: Direct-
> Access ANSI SCSI revision: 04
> Apr 8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: scsi(1:0:0:0):
> Enabled tagged queuing, queue depth 32.
> Apr 8 15:27:14 node1 kernel: SCSI device sdc: 560557312 512-byte hdwr
> sectors (287005 MB)
> Apr 8 15:27:14 node1 kernel: sdc: test WP failed, assume Write
> Enabled
> Apr 8 15:27:15 node1 kernel: sdc: asking for cache data failed
> Apr 8 15:27:15 node1 kernel: sdc: assuming drive cache: write through
> Apr 8 15:27:15 node1 kernel: SCSI device sdc: 560557312 512-byte hdwr
> sectors (287005 MB)
> Apr 8 15:27:15 node1 kernel: sdc: test WP failed, assume Write
> Enabled
> Apr 8 15:27:15 node1 kernel: sdc: asking for cache data failed
> Apr 8 15:27:15 node1 kernel: sdc: assuming drive cache: write through
> Apr 8 15:27:15 node1 kernel: sdc:<6>sd 1:0:0:0: Device not ready:
> <6>: Current: sense key: Not Ready
> Apr 8 15:27:15 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:15 node1 kernel:
> Apr 8 15:27:15 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:15 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:15 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:15 node1 kernel:
> Apr 8 15:27:15 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:15 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:15 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:15 node1 kernel:
> Apr 8 15:27:15 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:15 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:15 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:15 node1 kernel:
> Apr 8 15:27:15 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:15 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:15 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:15 node1 kernel:
> Apr 8 15:27:15 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:15 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:15 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:16 node1 kernel:
> Apr 8 15:27:16 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:16 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:16 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:16 node1 kernel:
> Apr 8 15:27:16 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:16 node1 kernel: Dev sdc: unable to read RDB block 0
> Apr 8 15:27:16 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:16 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:16 node1 kernel:
> Apr 8 15:27:16 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:16 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:16 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:16 node1 kernel:
> Apr 8 15:27:16 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:16 node1 kernel: unable to read partition table
> Apr 8 15:27:16 node1 kernel: sd 1:0:0:0: Attached scsi disk sdc
> Apr 8 15:27:16 node1 kernel: Vendor: DGC Model: RAID
> 5 Rev: 0326
> Apr 8 15:27:16 node1 kernel: Type: Direct-
> Access ANSI SCSI revision: 04
> Apr 8 15:27:16 node1 kernel: qla2xxx 0000:0c:00.1: scsi(1:0:1:0):
> Enabled tagged queuing, queue depth 32.
> Apr 8 15:27:16 node1 kernel: SCSI device sdd: 560557312 512-byte hdwr
> sectors (287005 MB)
> Apr 8 15:27:16 node1 kernel: sdd: Write Protect is off
> Apr 8 15:27:16 node1 kernel: SCSI device sdd: drive cache: write
> through
> Apr 8 15:27:16 node1 kernel: SCSI device sdd: 560557312 512-byte hdwr
> sectors (287005 MB)
> Apr 8 15:27:16 node1 kernel: sdd: Write Protect is off
> Apr 8 15:27:17 node1 kernel: SCSI device sdd: drive cache: write
> through
> Apr 8 15:27:17 node1 kernel: sdd: sdd1
> Apr 8 15:27:17 node1 kernel: sd 1:0:1:0: Attached scsi disk sdd
> Apr 8 15:27:17 node1 kernel: GSI 18 sharing vector 0x4A and IRQ 18
> Apr 8 15:27:17 node1 kernel: ACPI: PCI Interrupt 0000:00:1d.7[A] ->
> GSI 21 (level, low) -> IRQ 74
> Apr 8 15:27:17 node1 kernel: ehci_hcd 0000:00:1d.7: EHCI Host
> Controller
> Apr 8 15:27:17 node1 kernel: ehci_hcd 0000:00:1d.7: new USB bus
> registered, assigned bus number 1
> Apr 8 15:27:17 node1 kernel: ehci_hcd 0000:00:1d.7: debug port 1
> Apr 8 15:27:17 node1 kernel: ehci_hcd 0000:00:1d.7: irq 74, io mem
> 0xfc900000
> Apr 8 15:27:17 node1 kernel: ehci_hcd 0000:00:1d.7: USB 2.0 started,
> EHCI 1.00, driver 10 Dec 2004
> Apr 8 15:27:17 node1 kernel: usb usb1: configuration #1 chosen from 1
> choice
> Apr 8 15:27:17 node1 kernel: hub 1-0:1.0: USB hub found
> Apr 8 15:27:17 node1 kernel: hub 1-0:1.0: 8 ports detected
> Apr 8 15:27:17 node1 kernel: USB Universal Host Controller Interface
> driver v3.0
> Apr 8 15:27:17 node1 kernel: ACPI: PCI Interrupt 0000:00:1d.0[A] ->
> GSI 21 (level, low) -> IRQ 74
> Apr 8 15:27:17 node1 kernel: uhci_hcd 0000:00:1d.0: UHCI Host
> Controller
> Apr 8 15:27:17 node1 kernel: uhci_hcd 0000:00:1d.0: new USB bus
> registered, assigned bus number 2
> Apr 8 15:27:17 node1 kernel: uhci_hcd 0000:00:1d.0: irq 74, io base
> 0x0000ace0
> Apr 8 15:27:17 node1 kernel: usb usb2: configuration #1 chosen from 1
> choice
> Apr 8 15:27:17 node1 kernel: hub 2-0:1.0: USB hub found
> Apr 8 15:27:17 node1 kernel: hub 2-0:1.0: 2 ports detected
> Apr 8 15:27:17 node1 kernel: GSI 19 sharing vector 0x52 and IRQ 19
> Apr 8 15:27:17 node1 kernel: ACPI: PCI Interrupt 0000:00:1d.1[B] ->
> GSI 20 (level, low) -> IRQ 82
> Apr 8 15:27:17 node1 kernel: uhci_hcd 0000:00:1d.1: UHCI Host
> Controller
> Apr 8 15:27:17 node1 kernel: uhci_hcd 0000:00:1d.1: new USB bus
> registered, assigned bus number 3
> Apr 8 15:27:17 node1 kernel: uhci_hcd 0000:00:1d.1: irq 82, io base
> 0x0000acc0
> Apr 8 15:27:18 node1 kernel: usb usb3: configuration #1 chosen from 1
> choice
> Apr 8 15:27:18 node1 kernel: hub 3-0:1.0: USB hub found
> Apr 8 15:27:18 node1 kernel: hub 3-0:1.0: 2 ports detected
> Apr 8 15:27:18 node1 kernel: ACPI: PCI Interrupt 0000:00:1d.2[C] ->
> GSI 21 (level, low) -> IRQ 74
> Apr 8 15:27:18 node1 kernel: uhci_hcd 0000:00:1d.2: UHCI Host
> Controller
> Apr 8 15:27:18 node1 kernel: uhci_hcd 0000:00:1d.2: new USB bus
> registered, assigned bus number 4
> Apr 8 15:27:18 node1 kernel: uhci_hcd 0000:00:1d.2: irq 74, io base
> 0x0000aca0
> Apr 8 15:27:18 node1 kernel: usb usb4: configuration #1 chosen from 1
> choice
> Apr 8 15:27:18 node1 kernel: hub 4-0:1.0: USB hub found
> Apr 8 15:27:18 node1 kernel: hub 4-0:1.0: 2 ports detected
> Apr 8 15:27:18 node1 kernel: usb 1-1: new high speed USB device using
> ehci_hcd and address 2
> Apr 8 15:27:18 node1 kernel: ACPI: PCI Interrupt 0000:00:1d.3[D] ->
> GSI 20 (level, low) -> IRQ 82
> Apr 8 15:27:18 node1 kernel: uhci_hcd 0000:00:1d.3: UHCI Host
> Controller
> Apr 8 15:27:18 node1 kernel: uhci_hcd 0000:00:1d.3: new USB bus
> registered, assigned bus number 5
> Apr 8 15:27:18 node1 kernel: uhci_hcd 0000:00:1d.3: irq 82, io base
> 0x0000ac80
> Apr 8 15:27:18 node1 kernel: usb usb5: configuration #1 chosen from 1
> choice
> Apr 8 15:27:18 node1 kernel: hub 5-0:1.0: USB hub found
> Apr 8 15:27:18 node1 kernel: hub 5-0:1.0: 2 ports detected
> Apr 8 15:27:18 node1 kernel: usb 1-1: configuration #1 chosen from 1
> choice
> Apr 8 15:27:18 node1 kernel: hub 1-1:1.0: USB hub found
> Apr 8 15:27:18 node1 kernel: hub 1-1:1.0: 2 ports detected
> Apr 8 15:27:18 node1 kernel: megasas: 00.00.03.15-RH1 Wed Nov. 21
> 10:29:45 PST 2007
> Apr 8 15:27:18 node1 kernel: megasas: 0x1000:0x0060:0x1028:0x1f0c:
> bus 1:slot 0:func 0
> Apr 8 15:27:18 node1 kernel: ACPI: PCI Interrupt 0000:01:00.0[A] ->
> GSI 16 (level, low) -> IRQ 169
> Apr 8 15:27:18 node1 kernel: megasas: FW now in Ready state
> Apr 8 15:27:18 node1 kernel: scsi2 : LSI SAS based MegaRAID driver
> Apr 8 15:27:18 node1 kernel: Vendor: FUJITSU Model:
> MBC2073RC Rev: D506
> Apr 8 15:27:19 node1 kernel: Type: Direct-
> Access ANSI SCSI revision: 05
> Apr 8 15:27:19 node1 kernel: Vendor: FUJITSU Model:
> MBC2073RC Rev: D506
> Apr 8 15:27:19 node1 kernel: Type: Direct-
> Access ANSI SCSI revision: 05
> Apr 8 15:27:19 node1 kernel: Vendor: DP Model:
> BACKPLANE Rev: 1.05
> Apr 8 15:27:19 node1 kernel: Type:
> Enclosure ANSI SCSI revision: 05
> Apr 8 15:27:19 node1 kernel: Vendor: DELL Model: PERC 6/
> i Rev: 1.11
> Apr 8 15:27:19 node1 kernel: Type: Direct-
> Access ANSI SCSI revision: 05
> Apr 8 15:27:19 node1 kernel: SCSI device sde: 142082048 512-byte hdwr
> sectors (72746 MB)
> Apr 8 15:27:19 node1 kernel: sde: Write Protect is off
> Apr 8 15:27:19 node1 kernel: SCSI device sde: drive cache: write back
> Apr 8 15:27:19 node1 kernel: SCSI device sde: 142082048 512-byte hdwr
> sectors (72746 MB)
> Apr 8 15:27:19 node1 kernel: sde: Write Protect is off
> Apr 8 15:27:19 node1 kernel: SCSI device sde: drive cache: write back
> Apr 8 15:27:19 node1 kernel: sde: sde1 sde2 sde3 sde4 < sde5 sde6
> sde7 sde8 >
> Apr 8 15:27:19 node1 kernel: sd 2:2:0:0: Attached scsi disk sde
> Apr 8 15:27:19 node1 kernel: Initializing USB Mass Storage driver...
> Apr 8 15:27:19 node1 kernel: usb 1-5: new high speed USB device using
> ehci_hcd and address 3
> Apr 8 15:27:19 node1 kernel: usb 1-5: configuration #1 chosen from 1
> choice
> Apr 8 15:27:19 node1 kernel: hub 1-5:1.0: USB hub found
> Apr 8 15:27:19 node1 kernel: hub 1-5:1.0: 4 ports detected
> Apr 8 15:27:19 node1 kernel: usb 1-1.1: new full speed USB device
> using ehci_hcd and address 4
> Apr 8 15:27:19 node1 kernel: usb 1-1.1: configuration #1 chosen from
> 1 choice
> Apr 8 15:27:19 node1 kernel: input: Dell DRAC5 as /class/input/input0
> Apr 8 15:27:19 node1 kernel: input: USB HID v1.10 Keyboard [Dell
> DRAC5] on usb-0000:00:1d.7-1.1
> Apr 8 15:27:19 node1 kernel: input: Dell DRAC5 as /class/input/input1
> Apr 8 15:27:19 node1 kernel: input: USB HID v1.10 Mouse [Dell DRAC5]
> on usb-0000:00:1d.7-1.1
> Apr 8 15:27:20 node1 kernel: usb 1-1.2: new high speed USB device
> using ehci_hcd and address 5
> Apr 8 15:27:20 node1 kernel: usb 1-1.2: configuration #1 chosen from
> 1 choice
> Apr 8 15:27:20 node1 kernel: scsi3 : SCSI emulation for USB Mass
> Storage devices
> Apr 8 15:27:20 node1 kernel: scsi4 : SCSI emulation for USB Mass
> Storage devices
> Apr 8 15:27:20 node1 kernel: usbcore: registered new driver usb-
> storage
> Apr 8 15:27:20 node1 kernel: USB Mass Storage support registered.
> Apr 8 15:27:20 node1 kernel: Vendor: Dell Model: Virtual
> CDROM Rev: 123
> Apr 8 15:27:20 node1 kernel: Type: CD-
> ROM ANSI SCSI revision: 00
> Apr 8 15:27:20 node1 kernel: Vendor: Dell Model: Virtual
> Floppy Rev: 123
> Apr 8 15:27:20 node1 kernel: Type: Direct-
> Access ANSI SCSI revision: 00
> Apr 8 15:27:20 node1 kernel: sd 4:0:0:0: Attached scsi removable disk
> sdf
> Apr 8 15:27:20 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:20 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:20 node1 kernel:
> Apr 8 15:27:20 node1 kernel: end_request: I/O error, dev sdc, sector
> 560557184
> Apr 8 15:27:20 node1 kernel: printk: 9 messages suppressed.
> Apr 8 15:27:20 node1 kernel: Buffer I/O error on device sdc, logical
> block 70069648
> Apr 8 15:27:20 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:20 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:20 node1 kernel:
> Apr 8 15:27:20 node1 kernel: end_request: I/O error, dev sdc, sector
> 560557184
> Apr 8 15:27:20 node1 kernel: Buffer I/O error on device sdc, logical
> block 70069648
> Apr 8 15:27:20 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:20 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:20 node1 kernel:
> Apr 8 15:27:21 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:21 node1 kernel: Buffer I/O error on device sdc, logical
> block 0
> Apr 8 15:27:21 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:21 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:21 node1 kernel:
> Apr 8 15:27:21 node1 kernel: end_request: I/O error, dev sdc, sector
> 8
> Apr 8 15:27:21 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:21 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:21 node1 kernel:
> Apr 8 15:27:21 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:21 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:21 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:21 node1 kernel:
> Apr 8 15:27:21 node1 kernel: end_request: I/O error, dev sda, sector
> 560557184
> Apr 8 15:27:21 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:21 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:21 node1 kernel:
> Apr 8 15:27:21 node1 kernel: end_request: I/O error, dev sda, sector
> 560557184
> Apr 8 15:27:21 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:21 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:21 node1 kernel:
> Apr 8 15:27:21 node1 kernel: end_request: I/O error, dev sda, sector
> 0
> Apr 8 15:27:21 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:21 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:21 node1 kernel:
> Apr 8 15:27:21 node1 kernel: end_request: I/O error, dev sda, sector
> 8
> Apr 8 15:27:21 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:21 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:22 node1 kernel:
> Apr 8 15:27:22 node1 kernel: end_request: I/O error, dev sda, sector
> 0
> Apr 8 15:27:22 node1 kernel: kjournald starting. Commit interval 5
> seconds
> Apr 8 15:27:22 node1 kernel: EXT3-fs: mounted filesystem with ordered
> data mode.
> Apr 8 15:27:22 node1 kernel: SELinux: Disabled at runtime.
> Apr 8 15:27:22 node1 kernel: e1000e: Intel(R) PRO/1000 Network Driver
> - 0.2.0
> Apr 8 15:27:22 node1 kernel: e1000e: Copyright (c) 1999-2007 Intel
> Corporation.
> Apr 8 15:27:22 node1 kernel: ACPI: PCI Interrupt 0000:0a:00.0[A] ->
> GSI 16 (level, low) -> IRQ 169
> Apr 8 15:27:22 node1 kernel: sd 0:0:0:0: Attached scsi generic sg0
> type 0
> Apr 8 15:27:22 node1 kernel: sd 0:0:1:0: Attached scsi generic sg1
> type 0
> Apr 8 15:27:22 node1 kernel: sd 1:0:0:0: Attached scsi generic sg2
> type 0
> Apr 8 15:27:22 node1 kernel: sd 1:0:1:0: Attached scsi generic sg3
> type 0
> Apr 8 15:27:22 node1 kernel: scsi 2:0:32:0: Attached scsi generic sg4
> type 13
> Apr 8 15:27:22 node1 kernel: sd 2:2:0:0: Attached scsi generic sg5
> type 0
> Apr 8 15:27:22 node1 kernel: scsi 3:0:0:0: Attached scsi generic sg6
> type 5
> Apr 8 15:27:22 node1 kernel: sd 4:0:0:0: Attached scsi generic sg7
> type 0
> Apr 8 15:27:22 node1 kernel: input: PC Speaker as /class/input/input2
> Apr 8 15:27:22 node1 kernel: EDAC MC: Ver: 2.0.1 May 23 2008
> Apr 8 15:27:22 node1 kernel: 0000:00:04.0: eth0: (PCI Express:2.5GB/
> s:Width x4) 00:15:17:7d:cc:32
> Apr 8 15:27:22 node1 kernel: 0000:00:04.0: eth0: Intel(R) PRO/1000
> Network Connection
> Apr 8 15:27:22 node1 kernel: 0000:00:04.0: eth0: MAC: 0, PHY: 4, PBA
> No: c57721-005
> Apr 8 15:27:22 node1 kernel: ACPI: PCI Interrupt 0000:0a:00.1[B] ->
> GSI 17 (level, low) -> IRQ 66
> Apr 8 15:27:22 node1 kernel: intel_rng: FWH not detected
> Apr 8 15:27:22 node1 kernel: hda: ATAPI 24X DVD-ROM drive, 198kB
> Cache, UDMA(33)
> Apr 8 15:27:22 node1 kernel: Uniform CD-ROM driver Revision: 3.20
> Apr 8 15:27:22 node1 kernel: 0000:00:04.0: eth1: (PCI Express:2.5GB/
> s:Width x4) 00:15:17:7d:cc:33
> Apr 8 15:27:23 node1 kernel: 0000:00:04.0: eth1: Intel(R) PRO/1000
> Network Connection
> Apr 8 15:27:23 node1 kernel: 0000:00:04.0: eth1: MAC: 0, PHY: 4, PBA
> No: c57721-005
> Apr 8 15:27:23 node1 kernel: shpchp: Standard Hot Plug PCI Controller
> Driver version: 0.4
> Apr 8 15:27:23 node1 kernel: EDAC MC0: Giving out device to
> i5000_edac.c I5000: DEV 0000:00:10.0
> Apr 8 15:27:23 node1 kernel: Broadcom NetXtreme II Gigabit Ethernet
> Driver bnx2 v1.6.9 (December 8, 2007)
> Apr 8 15:27:23 node1 kernel: ACPI: PCI Interrupt 0000:03:00.0[A] ->
> GSI 16 (level, low) -> IRQ 169
> Apr 8 15:27:23 node1 kernel: eth2: Broadcom NetXtreme II BCM5708
> 1000Base-T (B2) PCI-X 64-bit 133MHz found at mem f8000000, IRQ 169,
> node addr 001ec9b285f5
> Apr 8 15:27:23 node1 kernel: ACPI: PCI Interrupt 0000:07:00.0[A] ->
> GSI 16 (level, low) -> IRQ 169
> Apr 8 15:27:23 node1 kernel: eth3: Broadcom NetXtreme II BCM5708
> 1000Base-T (B2) PCI-X 64-bit 133MHz found at mem f4000000, IRQ 169,
> node addr 001ec9b285f7
> Apr 8 15:27:23 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:23 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:23 node1 kernel:
> Apr 8 15:27:23 node1 kernel: end_request: I/O error, dev sdc, sector
> 560557184
> Apr 8 15:27:23 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:23 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:23 node1 kernel:
> Apr 8 15:27:23 node1 kernel: end_request: I/O error, dev sdc, sector
> 560557184
> Apr 8 15:27:23 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:23 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:23 node1 kernel:
> Apr 8 15:27:23 node1 kernel: end_request: I/O error, dev sdc, sector
> 560557304
> Apr 8 15:27:23 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:23 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:23 node1 kernel:
> Apr 8 15:27:23 node1 kernel: end_request: I/O error, dev sdc, sector
> 560557304
> Apr 8 15:27:23 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:23 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:23 node1 kernel:
> Apr 8 15:27:24 node1 kernel: end_request: I/O error, dev sdc, sector
> 560557304
> Apr 8 15:27:24 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:24 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:24 node1 kernel:
> Apr 8 15:27:24 node1 kernel: end_request: I/O error, dev sdc, sector
> 560557304
> Apr 8 15:27:24 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:24 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:24 node1 kernel:
> Apr 8 15:27:24 node1 kernel: end_request: I/O error, dev sdc, sector
> 560557304
> Apr 8 15:27:24 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:24 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:24 node1 kernel:
> Apr 8 15:27:24 node1 kernel: end_request: I/O error, dev sdc, sector
> 560557304
> Apr 8 15:27:24 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:24 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:24 node1 kernel:
> Apr 8 15:27:24 node1 kernel: end_request: I/O error, dev sdc, sector
> 560557248
> Apr 8 15:27:24 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:24 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:24 node1 kernel:
> Apr 8 15:27:24 node1 kernel: end_request: I/O error, dev sdc, sector
> 560557296
> Apr 8 15:27:24 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:24 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:24 node1 kernel:
> Apr 8 15:27:24 node1 kernel: end_request: I/O error, dev sdc, sector
> 560557304
> Apr 8 15:27:24 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:24 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:24 node1 kernel:
> Apr 8 15:27:25 node1 kernel: end_request: I/O error, dev sdc, sector
> 560557304
> Apr 8 15:27:25 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:25 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:25 node1 kernel:
> Apr 8 15:27:25 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:25 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:25 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:25 node1 kernel:
> Apr 8 15:27:25 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:25 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:25 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:25 node1 kernel:
> Apr 8 15:27:25 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:25 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:25 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:25 node1 kernel:
> Apr 8 15:27:25 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:25 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:25 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:25 node1 kernel:
> Apr 8 15:27:25 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:25 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:25 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:25 node1 kernel:
> Apr 8 15:27:25 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:25 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:25 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:26 node1 kernel:
> Apr 8 15:27:26 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:26 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:26 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:26 node1 kernel:
> Apr 8 15:27:26 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:26 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:26 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:26 node1 kernel:
> Apr 8 15:27:26 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:26 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:26 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:26 node1 kernel:
> Apr 8 15:27:26 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:26 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:26 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:26 node1 kernel:
> Apr 8 15:27:26 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:26 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:26 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:26 node1 kernel:
> Apr 8 15:27:26 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:26 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:26 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:26 node1 kernel:
> Apr 8 15:27:26 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:26 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:26 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:27 node1 kernel:
> Apr 8 15:27:27 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:27 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:27 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:27 node1 kernel:
> Apr 8 15:27:27 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:27 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:27 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:27 node1 kernel:
> Apr 8 15:27:27 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:27 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:27 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:27 node1 kernel:
> Apr 8 15:27:27 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:27 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:27 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:27 node1 kernel:
> Apr 8 15:27:27 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:27 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:27 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:27 node1 kernel:
> Apr 8 15:27:27 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:27 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:27 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:27 node1 kernel:
> Apr 8 15:27:27 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:27 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:27 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:28 node1 kernel:
> Apr 8 15:27:28 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:28 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:28 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:28 node1 kernel:
> Apr 8 15:27:28 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:28 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:28 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:28 node1 kernel:
> Apr 8 15:27:28 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:28 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:28 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:28 node1 kernel:
> Apr 8 15:27:28 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:28 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:28 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:28 node1 kernel:
> Apr 8 15:27:28 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:28 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:28 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:28 node1 kernel:
> Apr 8 15:27:28 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:28 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:28 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:28 node1 kernel:
> Apr 8 15:27:28 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:28 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:28 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:29 node1 kernel:
> Apr 8 15:27:29 node1 kernel: end_request: I/O error, dev sdc, sector
> 0
> Apr 8 15:27:29 node1 kernel: sr0: scsi-1 drive
> Apr 8 15:27:29 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:29 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:29 node1 kernel:
> Apr 8 15:27:29 node1 kernel: end_request: I/O error, dev sda, sector
> 560557184
> Apr 8 15:27:29 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
> Current: sense key: Not Ready
> Apr 8 15:27:29 node1 kernel: Add. Sense: Logical unit not ready,
> manual intervention required
> Apr 8 15:27:29 node1 kernel:

are you using a cross-over cable or plugged into a switch - (Oracle recommended)?

Also how is your OCR/VOTING devices configured. When one system can't see the other - either through the interconnect or via OCR/Voting - you get the reboot loop. Received on Mon Apr 13 2009 - 17:15:49 CDT

Original text of this message