So here is the setup. I've got an old Oracle X3-2L server with a legitimate LSI 9702-8i SAS card configured in IT mode. 2 1TB drives are used for boot and root partition. These drives are mirrored under ZFS. The remaining 12 3TB drives are just data drives, they don't contain any OS files on them. The system has been a solid performer on the rack for about 3 years. 2 days ago we had a power outage (system is on a UPS) so I gracefully shut the system down, and disconnected the power. Power comes back on the next morning and I boot the system up. Once FreeBSD starts loading I get a lot of chatter on the terminal like:
It never gets past this point, I'm unable to login. I let it run like this all day, hoping it would sort itself out, but it ended up doing an infinite loop of "Root mount waiting for: CAM" messages. I then proceeded to perform the following operations:
* Attempted to boot into single user mode and safe mode, same result
* Disconnected and reseated all of the disk drives and rebooted, same result
* Booted into the LSI configuration utility and ran a full scan of both mirrored boot drives. No bad blocks were found on either disk.
* Disconnected the 12 data drives and rebooted, same result
* Opened up the case, removed and reseated the LSI SAS card, expander card, and all SAS related cabling. Removed the CMOS battery for 1 minute. Rebooted, fixed the CMOS settings, same result
* Replaced the LSI SAS card with an identical card from a different operational system in the rack, rebooted, same result
* Replaced the SAS expander card with an identical card from another working system in the rack, rebooted, same result
* Removed all disk drives from the system, plugged in a fresh FreeBSD 14.2 installer USB stick, booted from the stick, same result
* Disconnected the 3 back planes for the 12 data drives from the SAS expander, rebooted, same result
* Removed the LSI SAS card from the system entirely, plugged in a fresh FreeBSD 14.2 installer USB stick, booted form the stick same result
At this point, I'm at a loss. Since the USB stick sees the same problem, I'm thinking I've got a hardware problem somewhere, but I've replaced or disconnected about everything I can think of. I'm not sure what else to try. Is there anything on the FreeBSD side I can try to get this thing to boot?
Code:
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
(probe105:mpt1:0:1:0): INQUIRY, CDB: 12 00 00 00 24 00
(probe105:mpt1:0:1:0): CAM status: CCB request terminated by the host
(probe105:mpt1:0:1:0): Retrying command, 3 more tries remain
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
mpt1: SAS discovery error: Port: 0x01 Status: 0x00004002
mpt1: SAS discovery error: Port: 0x02 Status: 0x00004002
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
mpt1: SAS discovery error: Port: 0x03 Status: 0x00004002
Root mount waiting for: CAM
Root mount waiting for: CAMIt never gets past this point, I'm unable to login. I let it run like this all day, hoping it would sort itself out, but it ended up doing an infinite loop of "Root mount waiting for: CAM" messages. I then proceeded to perform the following operations:
* Attempted to boot into single user mode and safe mode, same result
* Disconnected and reseated all of the disk drives and rebooted, same result
* Booted into the LSI configuration utility and ran a full scan of both mirrored boot drives. No bad blocks were found on either disk.
* Disconnected the 12 data drives and rebooted, same result
* Opened up the case, removed and reseated the LSI SAS card, expander card, and all SAS related cabling. Removed the CMOS battery for 1 minute. Rebooted, fixed the CMOS settings, same result
* Replaced the LSI SAS card with an identical card from a different operational system in the rack, rebooted, same result
* Replaced the SAS expander card with an identical card from another working system in the rack, rebooted, same result
* Removed all disk drives from the system, plugged in a fresh FreeBSD 14.2 installer USB stick, booted from the stick, same result
* Disconnected the 3 back planes for the 12 data drives from the SAS expander, rebooted, same result
* Removed the LSI SAS card from the system entirely, plugged in a fresh FreeBSD 14.2 installer USB stick, booted form the stick same result
At this point, I'm at a loss. Since the USB stick sees the same problem, I'm thinking I've got a hardware problem somewhere, but I've replaced or disconnected about everything I can think of. I'm not sure what else to try. Is there anything on the FreeBSD side I can try to get this thing to boot?