{"id":2704,"date":"2016-12-11T09:43:53","date_gmt":"2016-12-11T08:43:53","guid":{"rendered":"http:\/\/olivier.hoarau.org\/?p=2704"},"modified":"2016-12-11T09:44:53","modified_gmt":"2016-12-11T08:44:53","slug":"monitoring-hardware-dun-systeme-raid","status":"publish","type":"post","link":"https:\/\/olivier.hoarau.org\/?p=2704","title":{"rendered":"Monitoring hardware d’un syst\u00e8me RAID"},"content":{"rendered":"

je poss\u00e8de comme serveur perso d’un Dell Poweredge T310<\/a> dans lequel les disques SATA sont branch\u00e9s \u00e0 une carte syst\u00e8me PERC 6\/i qui me permet de faire du RAID mat\u00e9riel qui est bien plus performant que le RAID logiciel. Pour monitorer du raid logiciel sous linux c’est assez simple on dispose de la commande mdadm<\/strong>. Il existe pas mal de bonnes pages sur le net qui explique comment faire, dont celle-ci<\/a> (en fran\u00e7ais) et celle-l\u00e0<\/a> (en anglais).<\/p>\n

Par contre quand il s’agit de monitorer une carte propri\u00e9taire, \u00e7a devient plus compliqu\u00e9, mais heureusement que broadcom le fabricant de la carte met \u00e0 disposition un outil sous linux qu’on peut r\u00e9cup\u00e8rer par ici<\/a>. Quand on d\u00e9sarchive Linux_MegaCLI-8-07-07.zip<\/strong> on obtient le package rpm MegaCli-8.07.07-1.noarch.rpm<\/strong> qu’on installera simplement avec urpmi<\/strong>. Cela va cr\u00e9er un r\u00e9pertoire avec un exe et biblioth\u00e8que sous \/opt\/MegaRAID\/MegaCli<\/strong>. Ce n’est pas le meilleur endroit, j’ai donc cr\u00e9\u00e9 le lien suivant pour l’ex\u00e9cutable :<\/p>\n

\n

ln -s \/opt\/MegaRAID\/MegaCli\/MegaClii64 \/usr\/bin<\/p>\n<\/blockquote>\n

maintenant pour avoir un max d’info sur son syst\u00e8me RAID on tapera<\/p>\n

\n

MegaCli64 -AdpAllInfo -aAll<\/p>\n<\/blockquote>\n

la commande est tr\u00e8s bavarde, voil\u00e0 quelques extraits choisis:<\/p>\n

Adapter #0<\/p>\n

==============================================================================
\nVersions
\n================
\nProduct Name : PERC 6\/i Adapter
\nSerial No : 1122334455667788
\nFW Package Build: 6.3.0-0001<\/p>\n

 <\/p><\/blockquote>\n

<\/p>\n

(…)<\/p>\n

Image Versions in Flash:
\n================
\nFW Version : 1.22.12-0952
\nBIOS Version : 2.04.00
\nWebBIOS Version : 1.1-46-e_15-Rel
\nCtrl-R Version : 1.02-015B
\nPreboot CLI Version: 01.00-023:#%00006
\nBoot Block Version : 1.00.00.01-0011<\/p><\/blockquote>\n

(…)<\/p>\n

Settings
\n================
\nCurrent Time : 16:35:45 12\/4, 2016
\nPredictive Fail Poll Interval : 10800sec
\nInterrupt Throttle Active Count : 16
\nInterrupt Throttle Completion : 50us
\nRebuild Rate : 30%
\nPR Rate : 30%
\nBGI Rate : 30%
\nCheck Consistency Rate : 30%
\nReconstruction Rate : 30%
\nCache Flush Interval : 4s
\nMax Drives to Spinup at One Time : 2
\nDelay Among Spinup Groups : 12s
\nPhysical Drive Coercion Mode : 128MB
\nCluster Mode : Disabled
\nAlarm : Disabled
\nAuto Rebuild : Enabled
\nBattery Warning : Enabled
\nEcc Bucket Size : 15
\nEcc Bucket Leak Rate : 1440 Minutes
\nRestore HotSpare on Insertion : Disabled
\nExpose Enclosure Devices : Disabled
\nMaintain PD Fail History : Disabled
\nHost Request Reordering : Enabled
\nAuto Detect BackPlane Enabled : SGPIO\/i2c SEP
\nLoad Balance Mode : Auto
\nUse FDE Only : No
\nSecurity Key Assigned : No
\nSecurity Key Failed : No
\nSecurity Key Not Backedup : No
\nDefault LD PowerSave Policy : Controller Defined
\nMaximum number of direct attached drives to spin up in 1 min : 0
\nAuto Enhanced Import : No
\nAny Offline VD Cache Preserved : No
\nAllow Boot with Preserved Cache : No
\nDisable Online Controller Reset : No
\nPFK in NVRAM : No
\nUse disk activity for locate : No
\nPOST delay : 90 seconds
\nBIOS Error Handling : Stop On Errors
\nCurrent Boot Mode :Normal
\nCapabilities
\n================
\nRAID Level Supported : RAID0, RAID1, RAID5, RAID6, RAID00, RAID10, RAID50, RAID60, PRL 11, PRL 11 with spanning, SRL 3 supported, PRL11-RLQ0 DDF layout with no span, PRL11-RLQ0
\nDDF layout with span
\nSupported Drives : SAS, SATA<\/p>\n

Allowed Mixing:<\/p>\n

Mix in Enclosure Allowed<\/p><\/blockquote>\n

(…)<\/p>\n

Device Present
\n================
\nVirtual Drives : 2
\nDegraded : 0
\nOffline : 0
\nPhysical Devices : 6
\nDisks : 6
\nCritical Disks : 0
\nFailed Disks : 0<\/p><\/blockquote>\n

Maintenant pour avoir des info sur les disques du RAID, on tapera<\/p>\n

MegaCli64 -PDlist -aALL<\/p><\/blockquote>\n

voil\u00e0 le r\u00e9sultat, pour le premier disque physique du premier disque virtuel constitu\u00e9 de deux disques SAS de 146Go mont\u00e9s en RAID 1 (mirroring)<\/p>\n

Enclosure Device ID: N\/A
\nSlot Number: 0
\nDrive’s position: DiskGroup: 1, Span: 0, Arm: 0
\nEnclosure position: N\/A
\nDevice Id: 0
\nWWN:
\nSequence Number: 2
\nMedia Error Count: 0
\nOther Error Count: 0
\nPredictive Failure Count: 0
\nLast Predictive Failure Event Seq Number: 0
\nPD Type: SAS<\/p>\n

Raw Size: 136.732 GB [0x11177328 Sectors]
\nNon Coerced Size: 136.232 GB [0x11077328 Sectors]
\nCoerced Size: 136.125 GB [0x11040000 Sectors]
\nSector Size: 0
\nFirmware state: Online, Spun Up
\nDevice Firmware Level: D306
\nShield Counter: 0
\nSuccessful diagnostics completion on : N\/A
\nSAS Address(0): 0x500000e1175a6dc2
\nSAS Address(1): 0x0
\nConnected Port Number: 0(path0)
\nInquiry Data: FUJITSU MBA3147RC D306BJA3PB20MLWR
\nFDE Capable: Not Capable
\nFDE Enable: Disable
\nSecured: Unsecured
\nLocked: Unlocked
\nNeeds EKM Attention: No
\nForeign State: None
\nDevice Speed: Unknown
\nLink Speed: Unknown
\nMedia Type: Hard Disk Device
\nDrive Temperature :38C (100.40 F)
\nPI Eligibility: No
\nDrive is formatted for PI information: No
\nPI: No PI
\nPort-0 :
\nPort status: Active
\nPort’s Linkspeed: Unknown
\nPort-1 :
\nPort status: Active
\nPort’s Linkspeed: Unknown
\nDrive has flagged a S.M.A.R.T alert : No<\/p><\/blockquote>\n

plus loin au slot 4 on voit le premier disque SATA de To de mon disque virtuel de 5,5To constitu\u00e9 de 4 disques SATA de 2To chacun mont\u00e9s en RAID 5<\/p>\n

Enclosure Device ID: N\/A
\nSlot Number: 4
\nDrive’s position: DiskGroup: 0, Span: 0, Arm: 0
\nEnclosure position: N\/A
\nDevice Id: 4
\nWWN:
\nSequence Number: 2
\nMedia Error Count: 0
\nOther Error Count: 0
\nPredictive Failure Count: 0
\nLast Predictive Failure Event Seq Number: 0
\nPD Type: SATA<\/p>\n

Raw Size: 1.819 TB [0xe8e088b0 Sectors]
\nNon Coerced Size: 1.818 TB [0xe8d088b0 Sectors]
\nCoerced Size: 1.818 TB [0xe8d00000 Sectors]
\nSector Size: 0
\nFirmware state: Online, Spun Up
\nDevice Firmware Level: CC25
\nShield Counter: 0
\nSuccessful diagnostics completion on : N\/A
\nSAS Address(0): 0x1221000004000000
\nConnected Port Number: 4(path0)
\nInquiry Data: Z4Z2CWV3ST2000DM001-1ER164 CC25
\nFDE Capable: Not Capable
\nFDE Enable: Disable
\nSecured: Unsecured
\nLocked: Unlocked
\nNeeds EKM Attention: No
\nForeign State: None
\nDevice Speed: Unknown
\nLink Speed: Unknown
\nMedia Type: Hard Disk Device
\nDrive Temperature : N\/A
\nPI Eligibility: No
\nDrive is formatted for PI information: No
\nPI: No PI
\nPort-0 :
\nPort status: Active
\nPort’s Linkspeed: Unknown
\nDrive has flagged a S.M.A.R.T alert : No<\/p><\/blockquote>\n

de mani\u00e8re plus pr\u00e9cise en tapant<\/p>\n

MegaCli64 -LDInfo -L0 -a0<\/p><\/blockquote>\n

avec les options -L<\/strong> le num\u00e9ro du premier disque virtuel (en commen\u00e7ant par 0) et -a<\/strong> de l’adaptateur (carte RAID, en commen\u00e7ant par 0), on obtient des infos sur mon premier disque virtuel RAID d’une taille de 146Go en RAID 1 mirroring constitu\u00e9 de deux disques.<\/p>\n

Adapter 0 — Virtual Drive Information:
\nVirtual Drive: 0 (Target Id: 0)
\nName :sys
\nRAID Level : Primary-1, Secondary-0, RAID Level Qualifier-0
\nSize : 136.125 GB
\nSector Size : 512
\nMirror Data : 136.125 GB
\nState : Optimal
\nStrip Size : 64 KB
\nNumber Of Drives : 2
\nSpan Depth : 1
\nDefault Cache Policy: WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU
\nCurrent Cache Policy: WriteThrough, ReadAheadNone, Direct, No Write Cache if Bad BBU
\nDefault Access Policy: Read\/Write
\nCurrent Access Policy: Read\/Write
\nDisk Cache Policy : Disk’s Default
\nEncryption Type : None
\nIs VD Cached: No<\/p><\/blockquote>\n

et avec la commande suivante, j’obtiens la m\u00eame chose avec mon second disque disque virtuel<\/p>\n

MegaCli64 -LDInfo -L1 -a0<\/p><\/blockquote>\n

r\u00e9sultat<\/p>\n

Adapter 0 — Virtual Drive Information:
\nVirtual Drive: 1 (Target Id: 1)
\nName :vd-data
\nRAID Level : Primary-5, Secondary-0, RAID Level Qualifier-3
\nSize : 5.456 TB
\nSector Size : 512
\nParity Size : 1.818 TB
\nState : Optimal
\nStrip Size : 64 KB
\nNumber Of Drives : 4
\nSpan Depth : 1
\nDefault Cache Policy: WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU
\nCurrent Cache Policy: WriteThrough, ReadAheadNone, Direct, No Write Cache if Bad BBU
\nDefault Access Policy: Read\/Write
\nCurrent Access Policy: Read\/Write
\nDisk Cache Policy : Disk’s Default
\nEncryption Type : None
\nIs VD Cached: No<\/p><\/blockquote>\n

Pour lister les disques physiques on tapera<\/p>\n

\n

MegaCli64 -pdlist -a0<\/p>\n<\/blockquote>\n

voil\u00e0 un lien<\/a> qui donne quelques infos compl\u00e9mentaires sur MegaCli64<\/strong> notamment des commandes d’administration du syst\u00e8me RAID. A voir \u00e9galement par l\u00e0<\/a>.<\/p>\n

Maintenant si les disques sont compatibles S.M.A.R.T<\/a> il existe le package smartmontools<\/strong> qui offre des outils suppl\u00e9mentaires de monitoring.<\/p>\n

En tapant:<\/p>\n

smartctl -a -d megaraid,0 \/dev\/sda<\/p><\/blockquote>\n

je vois les infos sur le disque 0 (slot 0) de mon disque virtuel identifi\u00e9 par le fichier sp\u00e9cial \/dev\/sda<\/strong><\/p>\n

smartctl 6.3 2014-07-26 r3976 [x86_64-linux-3.19.8-server-3.mga5] (local build)
\nCopyright (C) 2002-14, Bruce Allen, Christian Franke, www.smartmontools.org<\/p>\n

=== START OF INFORMATION SECTION ===
\nVendor: FUJITSU
\nProduct: MBA3147RC
\nRevision: D306
\nUser Capacity: 146 815 733 760 bytes [146 GB]
\nLogical block size: 512 bytes
\nRotation Rate: 15000 rpm
\nLogical Unit id: 0x500000e1175a6dc0
\nSerial number: BJA3PB20MLWR
\nDevice type: disk
\nTransport protocol: SAS (SPL-3)
\nLocal Time is: Sun Dec 4 17:27:51 2016 CET
\nSMART support is: Available – device has SMART capability.
\nSMART support is: Enabled
\nTemperature Warning: Disabled or Not Supported<\/p>\n

=== START OF READ SMART DATA SECTION ===
\nSMART Health Status: OK<\/p>\n

Current Drive Temperature: 39 C
\nDrive Trip Temperature: 65 C<\/p>\n

Manufactured in week 07 of year 2011
\nSpecified cycle count over device lifetime: 50000
\nAccumulated start-stop cycles: 71
\nElements in grown defect list: 0<\/p>\n

Error counter log:
\nErrors Corrected by Total Correction Gigabytes Total
\nECC rereads\/ errors algorithm processed uncorrected
\nfast | delayed rewrites corrected invocations [10^9 bytes] errors
\nread: 0 215 215 215 308 79119,575 0
\nwrite: 0 3 3 3 6 16411,955 0
\nverify: 0 0 0 0 0 1,472 0<\/p>\n

Non-medium error count: 59<\/p>\n

SMART Self-test log
\nNum Test Status segment LifeTime LBA_first_err [SK ASC ASQ]
\nDescription number (hours)
\n# 1 Background long Completed – 1 – [- – -]
\n# 2 Background short Completed – 1 – [- – -]<\/p>\n

Long (extended) Self Test duration: 1456 seconds [24,3 minutes]<\/p><\/blockquote>\n

et en tapant<\/p>\n

smartctl -d megaraid,5 -a \/dev\/sdb<\/p><\/blockquote>\n

je vois le disque 5 du disque virtuel de 5,5To identifi\u00e9 par le fichier sp\u00e9cial \/dev\/db<\/strong><\/p>\n

smartctl 6.3 2014-07-26 r3976 [x86_64-linux-3.19.8-server-3.mga5] (local build)
\nCopyright (C) 2002-14, Bruce Allen, Christian Franke, www.smartmontools.org<\/p>\n

\/dev\/sdb [megaraid_disk_05] [SAT]: Device open changed type from ‘megaraid,5’ to ‘sat+megaraid,5’
\n=== START OF INFORMATION SECTION ===
\nModel Family: Seagate Barracuda 7200.14 (AF)
\nDevice Model: ST2000DM001-1ER164
\nSerial Number: Z4Z2W969
\nLU WWN Device Id: 5 000c50 07b6ff45e
\nFirmware Version: CC26
\nUser Capacity: 2 000 398 934 016 bytes [2,00 TB]
\nSector Sizes: 512 bytes logical, 4096 bytes physical
\nRotation Rate: 7200 rpm
\nForm Factor: 3.5 inches
\nDevice is: In smartctl database [for details use: -P show]
\nATA Version is: ACS-2, ACS-3 T13\/2161-D revision 3b
\nSATA Version is: SATA 3.1, 6.0 Gb\/s (current: 3.0 Gb\/s)
\nLocal Time is: Sun Dec 4 18:13:50 2016 CET
\nSMART support is: Available – device has SMART capability.
\nSMART support is: Enabled<\/p><\/blockquote>\n

Maintenant libre \u00e0 vous de cr\u00e9er des scripts auto pour monitorer votre syst\u00e8me \u00e0 partir de cette base l\u00e0, on pourra a minima commencer par la commande<\/p>\n

MegaCli64 -FwTermLog -Dsply \u2013aALL > \/var\/log\/megasas.log<\/p><\/blockquote>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

je poss\u00e8de comme serveur perso d’un Dell Poweredge T310 dans lequel les disques SATA sont branch\u00e9s \u00e0 une carte syst\u00e8me PERC 6\/i qui me permet de faire du RAID mat\u00e9riel qui est bien plus performant que le RAID logiciel. Pour monitorer du raid logiciel sous linux c’est assez simple on dispose de la commande mdadm. … Continuer la lecture de Monitoring hardware d’un syst\u00e8me RAID<\/span> →<\/span><\/a><\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ngg_post_thumbnail":0,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":true,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false,"_share_on_mastodon":"0"},"categories":[5],"tags":[],"class_list":["post-2704","post","type-post","status-publish","format-standard","hentry","category-logiciels-libres"],"share_on_mastodon":{"url":"","error":""},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/peOjJ-HC","jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/olivier.hoarau.org\/index.php?rest_route=\/wp\/v2\/posts\/2704","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/olivier.hoarau.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/olivier.hoarau.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/olivier.hoarau.org\/index.php?rest_route=\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/olivier.hoarau.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2704"}],"version-history":[{"count":2,"href":"https:\/\/olivier.hoarau.org\/index.php?rest_route=\/wp\/v2\/posts\/2704\/revisions"}],"predecessor-version":[{"id":2706,"href":"https:\/\/olivier.hoarau.org\/index.php?rest_route=\/wp\/v2\/posts\/2704\/revisions\/2706"}],"wp:attachment":[{"href":"https:\/\/olivier.hoarau.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2704"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/olivier.hoarau.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2704"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/olivier.hoarau.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2704"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}