Here's a fun problem. Second time I've had this happen in the past month or so.
On an RHEL 5 system, I have a 300GB SATA drive (/dev/sdl) with an ext3 filesystem on it sitting in a Promise JBOD. It was mounted as /export/d6 and shared via NFS.
/etc/fstab entry was pretty vanilla:
/dev/sdl1 /export/d6 defaults 1 0
At some point over the weekend, the disk failed. The SCSI subsystem marked the device as dead. /var/log/messages shows:
Mar 7 09:24:50 fileserver kernel: scsi 2:0:9:0: rejecting I/O to dead device Mar 7 09:24:50 fileserver kernel: EXT3-fs error (device sdl1): ext3_get_inode_loc: unable to read inode block - inode=819201, block=1638402 Mar 7 09:24:50 fileserver kernel: scsi 2:0:9:0: rejecting I/O to dead device Mar 7 09:24:50 fileserver kernel: EXT3-fs error (device sdl1): ext3_get_inode_loc: unable to read inode block - inode=819201, block=1638402
There are no remote mounts of the resource. I can't umount the mount point, the system still has it in use by the filesystem.
If I can't get this fixed while the system is up, the kernel will eventually panic and restart on its own. I'd like to avoid that if possible. Otherwise, I'll have to schedule a reboot.
Any ideas?
Thanks in advance.
[link] [comments]