The Rebuild
I rebuilt Fuzzserv over the past week and a half, and I’ve had the 10TB RAID6 array resynching for about 40 hours before restoring any data to it (call me cautious.) I came home today and noticed that my filesystem was full. A quick du showed /var/log/{messages,syslog,kern.log} to be the culprits. The rr2680 driver had flooded Syslog with these messages:
Feb 15 21:53:46 fuzzserv kernel: [200245.998943] rr2680:Request(ffff8801355d2bf8) 2a-0-c5-70 fd-80-0-0 || 18-0-0-0 0-0-0-0 to device S2/0 failed as status 6 Feb 15 21:53:46 fuzzserv kernel: [200245.998950] rr2680:Request(ffff8801355d2ca0) 2a-0-c5-70 fc-30-0-0 || 10-0-0-0 0-0-0-0 to device S2/0 failed as status 6 Feb 15 21:53:46 fuzzserv kernel: [200245.998956] rr2680:Request(ffff8801355d50b8) 2a-0-c5-70 fd-98-0-0 || 18-0-0-0 0-0-0-0 to device S2/0 failed as status 6 Feb 15 21:53:46 fuzzserv kernel: [200245.998963] rr2680:Request(ffff8801355d3528) 2a-0-c5-70 f7-18-0-0 || 80-0-0-0 0-0-0-0 to device S2/0 failed as status 6 Feb 15 21:53:46 fuzzserv kernel: [200245.998970] rr2680:Request(ffff8801355d7e00) 2a-0-c5-70 fd-b0-0-0 || 18-0-0-0 0-0-0-0 to device S2/0 failed as status 6 Feb 15 21:53:46 fuzzserv kernel: [200245.998976] rr2680:Request(ffff8801355d9e28) 2a-0-c5-70 fc-40-0-0 || 18-0-0-0 0-0-0-0 to device S2/0 failed as status 6 Feb 15 21:53:46 fuzzserv kernel: [200245.998983] rr2680:Request(ffff8801355d9798) 2a-0-c5-70 fd-c8-0-0 || 10-0-0-0 0-0-0-0 to device S2/0 failed as status 6 Feb 15 21:53:46 fuzzserv kernel: [200245.998989] rr2680:Request(ffff8801355d8538) 2a-0-c5-70 fb-10-0-0 || 18-0-0-0 0-0-0-0 to device S2/0 failed as status 6 Feb 15 21:53:46 fuzzserv kernel: [200245.998995] rr2680:Request(ffff8801355d2fe8) 2a-0-c5-70 fd-d8-0-0 || 18-0-0-0 0-0-0-0 to device S2/0 failed as status 6 |
Interesting. I turned Syslog off for the time being, and moved /var/log/syslog to a separate drive for later perusal.