I'm running a Freebsd 11.1-RELEASE-p9 NAS with ZFS pool
Yesterday I upgraded the iLO (HP name for IPMI) firmware, which in turn included updates for some additional firmware in the system.
After a reboot, I was no longer able to access the pool, although all of the four drives were still assigned to the same device names, e.g.
Here's what I got from
I immediately suspected that the new firmware is causing the integrated RAID controller work in a different way, so I went ahead and reset BIOS to system defaults (probably not the smartest idea to introduce more changes at this point, but I did it anyway...).
After BIOS reset, my pool still can't be imported and
*
*
*
*
So, what options do I have here? Do I understand it correctly that this is a drive metadata (or whatever is the correct term) issue - ZFS doesn't recognise what the storage controller is presenting.
Right now I'm planning to try the following two things:
1. Re-check my BIOS settings to make sure everything is sane there and RAID is disabled and get the controller work in simplest HBA mode if I can - basically try to get the same configuration as I had before applying the firmware update & performing a BIOS reset, aka "last known good configuration"
2. Try importing the pool on different physical machine - need to figure out where to find one first
Do you think this is worth while?
Thanks for reading and I'd appreciate any additional suggestions you folks might have.
----
Update: I don't have a ZFS cache file, neither
I also tried
sat comprised of 2 two-way mirrors. The hardware is HP Microserver Gen 8. I have SATA controller set to AHCI mode in BIOS. mirror-0 disks are ada[13]. mirror-1 disks are ada[02].Yesterday I upgraded the iLO (HP name for IPMI) firmware, which in turn included updates for some additional firmware in the system.
After a reboot, I was no longer able to access the pool, although all of the four drives were still assigned to the same device names, e.g.
/dev/ada1 was still /dev/ada1 as far as I could tell.Here's what I got from
zpool status (sorry for the truncated output, don't have the complete message any longer):
Code:
NAME STATE READ WRITE CKSUM
sat FAULTED 0 0 0
mirror-0 ONLINE 0 0 0
1151882951 UNAVAIL 0 0 0 was /dev/ada1
8929664670538268915 UNAVAIL 0 0 0 was /dev/ada3
mirror-1 ONLINE 0 0 0
10322645952576320949 UNAVAIL 0 0 0 was /dev/ada0
18320716168250509702 UNAVAIL 0 0 0 was /dev/ada2I immediately suspected that the new firmware is causing the integrated RAID controller work in a different way, so I went ahead and reset BIOS to system defaults (probably not the smartest idea to introduce more changes at this point, but I did it anyway...).
After BIOS reset, my pool still can't be imported and
zpool import -f reports corrupted data:
Code:
sudo zpool import -f
pool: sat
id: 1167020886
state: FAULTED
status: One or more devices contains corrupted data.
action: The pool cannot be imported due to damaged devices or data.
comment: inherit
The pool may be active on another system, but can be imported using
the '-f' flag.
see: http://illumos.org/msg/ZFS-8000-5E
config:
sat FAULTED corrupted data
mirror-0 ONLINE
1151882951 UNAVAIL corrupted data
8929664670538268915 UNAVAIL corrupted data
mirror-1 ONLINE
10322645952576320949 UNAVAIL corrupted data
18320716168250509702 UNAVAIL corrupted data zdb -l output for all 4 devices attached here:*
ada0 - http://ix.io/17U1*
ada1 - http://ix.io/17U2*
ada2 - http://ix.io/17U3*
ada3 - http://ix.io/17U4So, what options do I have here? Do I understand it correctly that this is a drive metadata (or whatever is the correct term) issue - ZFS doesn't recognise what the storage controller is presenting.
Right now I'm planning to try the following two things:
1. Re-check my BIOS settings to make sure everything is sane there and RAID is disabled and get the controller work in simplest HBA mode if I can - basically try to get the same configuration as I had before applying the firmware update & performing a BIOS reset, aka "last known good configuration"
2. Try importing the pool on different physical machine - need to figure out where to find one first
Do you think this is worth while?Thanks for reading and I'd appreciate any additional suggestions you folks might have.
----
Update: I don't have a ZFS cache file, neither
/etc/zfs/zpool.cache nor /boot/zfs/zpool.cache exist.I also tried
-F option to zpool import, but it doesn't help:
Code:
sudo zpool import -nF
pool: sat
id: 1167020886
state: FAULTED
status: One or more devices contains corrupted data.
action: The pool cannot be imported due to damaged devices or data.
comment: inherit
The pool may be active on another system, but can be imported using
the '-f' flag.
see: http://illumos.org/msg/ZFS-8000-5E
config:
sat FAULTED corrupted data
mirror-0 ONLINE
1151882951 UNAVAIL corrupted data
8929664670538268915 UNAVAIL corrupted data
mirror-1 ONLINE
10322645952576320949 UNAVAIL corrupted data
18320716168250509702 UNAVAIL corrupted data
