唔經唔覺用了MegaRAID 十多年了
近日整理一下已離線的SERVER,把拆下來的RAID 卡影一張大合照。

由左至右分別是
MegaRAID SCSI 320
DELL PERC 5/i
DELL PERC 6/i
DELL PERC 5/E
DELL PERC 6/E
DELL H710P (自己的SPARE STOCK)
而缺少了的分別是
Mylex AcceleRAID 352
DELL SAS6i/R (有好幾部1U SERVER 用過)
DELL PERC H700 (家裹的SERVER使用中)
DELL PERC H710 (公司的DESKTOP使用中)
DELL PERC 4/dc (以前應該有一張在PowerEdge 6850內)
DELL PERC H710P/M(BLADE SERVER版本)
DELL PERC H700/M(BLADE SERVER版本)
還記得當年因為SQL SERVER 慢, 所以轉用RAID。當時(2003年左右)買了一張Mylex AcceleRAID 352,後來再UPGRADE SERVER,因為當時Mylex 已被LSI 收購所以買了MegaRAID SCSI 320。
除了中間幾年用了INTEL ONBOARD RAID / ZERO CHANNEL RAID以外, 到後來轉用DELL SERVER開始也變成只用MegaRAID了。
終於等到 H700 所需的Sff-8087
寫住Home server 的上半Part先
Hardware
- MB- MSI Z68A-G45 B3
- CPU – Intel i7-2600
- Memory – 4GB DDR3 1333 x 4
- HBA – Dell PERC H700 512MB with BBU
- Disk – 2TB SATA HDD x5 (3 Brand 4 Models, RAID 5, 2 Logical Disk)
- NIC – Broadcom NetXtreme II 5709 Dual Port GbE, onboard Realtek 8111D
- Power – Antek 380W Power Supply
Software
- Host – vmware ESXi 5
- guest – pfSense 2.0
- guest – Server 2008R2 as NAS

Side view, overcrowded

MSI Z680A-G45 (B3), HK$9xx have VT-d

Dell PERC H700

ESXi installed on 2GB USB Flash, in picture also have H700 battery backup unit.

Front view – the FAN controller lower the HDD Case fan noise

Installed LSI CIM Provider, can view card status

VT-d enabled in BIOS, can mark device for vmdirectpath I/O
由於PERC 5/i 在VT-d 環境下出現Data Loss Link 所以由Dell order 了張新RAID 卡。可惜淘宝 order 的兩條 SFF-8087 to SATA cable 還未到手,這個週末未能上機。

因為PERC5i 對應 VT-d 有問題,要轉用別一張RAID卡了 (已order Dell H700) 。
在換卡之前,對現有的DELL PERC做了些功課
以下是DELL PERC 對應 LSI OEM/型號
DELL PERC |
Chip |
Related LSI RAID/HBA |
PERC5/i, PERC5/e, PERC5/i Integrated Internal |
Intel IOP333 I/O Processor +
LSISAS1068 |
MegaRAID SAS 8408E/8480E |
PERC 6/I |
LSISAS1078 RAID on Chip (ROC) |
MegaRAID SAS 8888ELP |
SAS6/ir |
LSISAS1068E |
LSI SAS 1068E |
SAS5i & SAS5E |
LSISAS1068 |
LSI SAS 1068 |
PERC H200 |
LSISAS2008 |
LSI SAS 9211-8i |
PERC H700/800 |
LSISAS2108 RAID-on-Chip (ROC) |
MegaRAID SAS 9260-8i/MegaRAID SAS 9260DE-8i |
PERC H710P |
LSISAS2208(ROC) |
MegaRAID SAS 9265-8i |
LSIASA1068 http://www.lsi.com/…/LSISAS1068.aspx
LSIASA1068E http://www.lsi.com/…/LSISAS1068E.aspx
LSIASA2008 http://www.lsi.com/…/LSISAS2008.aspx
LSISAS2308 http://www.lsi.com/…/SAS2308 product brief.pdf
MegaRAID SAS 8408E http://www.lsi.com/…/MR_SAS_8408E_PB-Final.pdf
MegaRAID SAS 8888ELP http://www.lsi.com/…/MegaRAIDSAS8888ELP.aspx
MegaRAID SAS 9260-8i http://www.lsi.com/…/MegaRAIDSAS9260-8i.aspx
MegaRAID SAS 9265-8i MegaRAID SAS 9265-8i
找了很久也未能在LSI的網頁找到LSISAS2108的專頁。連LSISAS2208也找不到。似所有RAID5、RAID6 的ROC資料也收起了。
以下是相關RAID Controller 的比較 (LSISAS2208 還未有Dell model)
RAID Controller |
SAS |
Interface |
ROC PowerPC |
Memory
|
RAID |
LSISAS1068 |
3Gbps |
PCI-X 133MHz 64bit |
|
|
|
LSISAS1078(ROC) |
3Gbps |
x8 PCI-E 1.0a |
500MHz |
667MHz DDR2 |
0, 1, 5, 6, 10, 50, 60 |
LSISAS1068E |
3Gbps |
x8 PCI-E 1.0a |
|
|
0, 1E |
LSISAS2008 |
6Gbps |
x8 PCI-E 2.0 |
533MHz |
|
0, 1E, 10 |
LSISAS2108(ROC) |
6Gbps |
x8 PCI-E 2.0 |
800MHz |
800MHz DDR2 |
0, 1, 5, 6, 10, 50, 60 |
LSISAS2208(ROC) |
6Gbps |
x8 PCI-E 3.0 |
DualCore 800MHz |
1333MHz DDR3 |
0, 1, 5, 6, 10, 50, 60 |
LSISAS2308 |
6Gbps |
x8 PCI-E 3.0 |
800MHz |
|
0, 1E, 10 |
上前有部DELLBlade Server壞HDD,因為有pro support,有兩個(外包)DELL Engine上來幫手REBUILD >_<“。
我問佢地如何在ESXi 下知道RAID CARD 的status。佢地就打了好幾個電話,過了半個鐘後同我講返 『現時沒有方法』…
其實在佢地上來之前,我已用MegaCLI for vmware 睇完.
在ESXi 4下裝MegaCLI好簡單,只在到LSI個WEB 下載,並且抄到ESXi 入面。再入SSH chmod 返個檔案 executable 就可以用。
但到了ESXi 5 就出事了。有個檔案不見了。
./libstorelib.so: cannot open shared object file: No such file or directory
ERROR:Could not detect controller.
Failed to get ControllerId List.
Failed to get CpController object.
找了一會也找不到libstorelib.so。最後把心一橫,由ESXi 4.1內抄過來,可以正常執行了。


LINK
MegaCLI version 8.02.16
Equallogic 在星期一發放了SAN-HQ 2.2 Early Production Access,但因Support site在星期二出現問題而未能下載。
今日終於Update了新版.
這個版本加入了以下功能:
- 95th Percentile Reporting
- Support for Multiple Server Connections
- Live View (can monitor member/volume in 3 sec interval)
- Support for PS Series V5.1 Firmware features, including:
- Audit logging
- Data Center Bridging (DCB) configuration information
- Additional Data Reports
- Group Diagnostics Report
- Alerts Report
- RAID Evaluator
- Across-Group Summaries
- Event Communication Infrastructure Upgrade
- Support for the Dell EqualLogic FS7500
- Usability enhancements
- New alerts: drive firmware out-of-date notification and disk protocol mismatch.
- Improved volume type indicator.
- Temperature display settings.
- Increase syslog file size for event messages and its log directory path verification.
- SAN HeadQuarters Client startup verification dialogs, including firewall detection,
- server logs detection, and server update detection.
- Configure parameters used by the SANHQ Server
Live View

RAID Evaluator

可以用來計算在修在不同RAID TYPE 下的效能
不是淘返來的 Broadcom 5709 Dual port GbE, 有iSCSI offload, 行PCI-E x8


本來要10GbE CX4 接口, 但後來order了10GbE Stacking.
幸運的是Stacking與否只差一粒100ohm電阻.
這張是除去電阻後



當日都幾旺場。先是Datacenter個門口裝修, 再有鄰居裝FIREWALL (4隻2U Juniper SSG520), 再加埋我地成車電腦.