정보와 지식의 올바른 공유 - http://infoages.com

Gen10 시스템의 Smart Array SR HBA fw가 1.98/1.99/2.62 인 경우, 신규 생성된 Logical Drive의 Surface Scan 중 inconsistent parity 오류가 발생할 수 있다.

Array 구성에 따라, 유효 데이터가 inconsistent stripe에 위치하는 경우, 수정 불가한 오류(URE) 및 Disk 장애를 유발할 수 있고, 고객 데이터의 문제(data integrity issues)를 일으킬 수 있어 조치가 필요하다.

SA HBA fw를 2.65로 업데이트 하여 사용하면 됨

VMware ESXi

Linux (x64)

Windows (x64)

증상 검토 관련 정보:
1. Windows 환경의 경우 Event ID 24677이 관찰될 수 있다.
(Linux는 오류를 기록하지 않아 발견하기 어렵다)
e.g.) Windows Event log
------------------------------------------------------
Message Id: 24677
Severity: Informational
Log message: Surface analysis has repaired an inconsistent stripe on logical drive connected to array controller .
------------------------------------------------------

2. SSA를 통해, 특정 LD의 Parity 상태 정보를 검토할 수 있다.
GUI> Controller Devices > Logical Devices > Logical Drive x from Array Y > Parity Initialization Status : Initialization Failed

CLI> 아래 명령 수행 후, Parity Initialization Status를 검토.
1) controller all show
2) controller slot=x logicaldrive all show
3) controller slot=x logicaldrive y show

증상을 경험 중인 fw 사용 중 불가피한 경우, Workaround로는 "offline Parity Initialization"을 이용한다. (Parity 초기화 완료 후 볼륨 사용)

관련 정보는 아래 문서를 참조할 수 있음
Bulletin: HPE Smart Array SR Gen10 Controllers - FIRMWARE UPDATE REQUIRED to Prevent Potential Data Inconsistency on Select RAID Configurations Created with Smart Array Gen10 Firmware Version 1.98 through 2.62
https://support.hpe.com/hpesc/public/docDisplay?docId=emr_na-a00097210en_us

e-fuse Reset of Synergy

Reset HPOVEnclosureDevice
https://github.com/HewlettPackard/POSH-HPOneView/wiki/Reset-HPOVEnclosureDevice

To do.
1. HPE Oneview Powershell library 설치
a. Powershell 6.x 설치
https://github.com/PowerShell/PowerShell/releases
https://github.com/PowerShell/PowerShell/releases/download/v6.2.4/PowerShell-6.2.4-win-x64.msi

b. POSH 모듈 설치
Note: 5.0 설치를 위해서는 Intenet이 가능해야 함
PS> Install-Module HPOneView.500 -verbose

c. POSH 모듈 로드
PS> Import-Module HPOneView.500 -verbose

cf.
https://github.com/HewlettPackard/POSH-HPOneView/releases/download/v4.20.2290.1501/HPE.OneView.4.20.PowerShell.Library.exe

2. Connect/Login to Oneview
PS 420> Connect-HPOVMgmt -Hostname <%Oneview_IP_Address or Hostname%> -UserName Administrator -Password <% Password %> -verbose
PS 420> Connect-HPOVMgmt -Hostname 192.168.0.1 -UserName 'Administrator' -Password 'Password' -verbose
PS 500> Connect-HPOVMgmt -appliance CO1-SY12K.lab.net -UserName Administrator -Password Password

cf. Check Proxy
PS> Get-ItemProperty -Path 'HKCU:\Software\Microsoft\Windows\CurrentVersion\Internet Settings' | Select-Object ProxyServer, ProxyEnable

cf. IE Proxy set import for POSH
CMD> netsh winhttp import proxy source=ie
CMD> netsh winhttp set proxy "192.168.0.1:8080"

3. 장치 정보 확인
PS> Get-HPOVServer
PS> Get-HPOVEnclosure
PS> Get-HPOVInterconnect
PS> Get-HPOVInterconnect -Name "Frame 1, Interconnect 3"

4. Frame 변수지정 (e-fuse reset 대상 모듈이 장착된 Frame 정보)
PS> $Enclosure = Get-HPOVEnclosure -Name "Frame_Name" -ErrorAction Stop

5. efuse Reset
PS> Reset-HPOVEnclosureDevice -Enclosure $Enclosure -Component Device -DeviceID 1 -Efuse

cf.
Device bay 초기화
PS> Reset-HPOVEnclosureDevice -Enclosure $Enclosure -Component Device -DeviceID 9 -Efuse

ICM 초기화
PS> Reset-HPOVEnclosureDevice -Enclosure $Enclosure -Component ICM -DeviceID 3 -Efuse

-Component
-- Device : Compute
-- FLM : FLM
-- ICM : Interconnect Module
-- Appliance : Composer or ImageStreamer

==============================================================
PowerShell 6.2.4
Copyright (c) Microsoft Corporation. All rights reserved.

https://aka.ms/pscore6-docs
Type 'help' to get help.

PS > Install-Module HPOneView.500

Untrusted repository
You are installing the modules from an untrusted repository. If you trust this repository, change its InstallationPolicy value by running
the Set-PSRepository cmdlet. Are you sure you want to install the modules from 'PSGallery'?
[Y] Yes [A] Yes to All [N] No [L] No to All [S] Suspend [?] Help (default is "N"): Y

PS > Import-Module HPOneView.500

PS > Connect-HPOVMgmt -appliance CO1-SY12K.lab.net -UserName Administrator -Password Password@123
WARNING: Parameter 'UserName' is obsolete.
WARNING: Parameter 'Password' is obsolete.

ConnectionID Name UserName AuthLoginDomain Default
------------ ---- -------- --------------- -------
1 CO1-SY12K.lab.net Administrator LOCAL True

PS > Get-HPOVEnclosure

Name Model State Serial Number Rack Enclosure Group Populated Bays
---- ----- ----- ------------- ---- --------------- --------------
FrameName SY12000 Configured FrameName EG_Test 4/12

PS > Get-HPOVServer

Name ServerName Status Power Serial Number Model ROM iLO Server Profile
---- ---------- ------ ----- ------------- ----- --- --- -------
FrameName, bay 1 localhost.lab.net OK Off CN_SN1 SY 480 Gen10 I42 v2.14 (09/05/2019) iLO5 1.46 sp_lossBootVol_Legacy
FrameName, bay 2 localhost.lab.net OK On CN_SN2 SY 480 Gen10 I42 v2.14 (09/05/2019) iLO5 1.46 Profile_Bay2
FrameName, bay 3 localhost.lab.net OK On CN_SN3 SY 480 Gen10 I42 v2.14 (09/05/2019) iLO5 1.46 Profile_Bay3
FrameName, bay 5 localhost.lab.net OK On SG_SN4 SY 480 Gen10 I42 v2.14 (09/05/2019) iLO5 1.46 Profile_Bay5

PS > Get-HPOVInterconnect -Name "FrameName, Interconnect 2"

Type: Interconnect

Name Status LogicalInterconnect State Power SerialNumber Firmware Model
---- ------ ------------------- ----- ----- ------------ -------- -----
FrameName, interconnect 2 OK N/A (Unmanaged) Monitored On IC_SN1 8.0.2c Brocade 16Gb/24 FC Switch Module Pwr Pk for Sy.

PS > Get-HPOVInterconnect -Name "FrameName, Interconnect 3"

Type: Interconnect

Name Status LogicalInterconnect State Power SerialNumber Firmware Model
---- ------ ------------------- ----- ----- ------------ -------- -----
FrameName, interconnect 3 OK LE_TEST-LIG_TEST_1 Configured On IC_SN3 1.5.0.1004 Virtual Connect SE 40Gb F8 Module for Syner.

PS > Get-HPOVInterconnect -Name "FrameName, Interconnect 6"

Type: Interconnect

Name Status LogicalInterconnect State Power SerialNumber Firmware Model
---- ------ ------------------- ----- ----- ------------ -------- -----
FrameName, interconnect 6 OK LE_TEST-LIG_TEST_1 Configured On IC_SN6 1.5.0.1004 Virtual Connect SE 40Gb F8 Module for Syner.

PS > $Enclosure = Get-HPOVEnclosure -Name "FrameName" -ErrorAction Stop

PS > Reset-HPOVEnclosureDevice -Enclosure $Enclosure -Component ICM -DeviceID 6 -Efuse

Confirm
Are you sure you want to perform this action?
Performing the operation "Reset power for device" on target "ICM 6 within SGH913YCJB".
[Y] Yes [A] Yes to All [N] No [L] No to All [S] Suspend [?] Help (default is "Y"): Y

Appliance Name Owner Created Duration TaskState PercentComplet
e
--------- ---- ----- ------- -------- --------- --------------
CO1-SY12K.lab.net E-fuse interconnect bay 6 Administrator 2/8/2020 8:12:38 AM 00:00:01 Completed 100

PS > Get-HPOVInterconnect -Name "FrameName, Interconnect 6"

Type: Interconnect

Name Status LogicalInterconnect State Power SerialNumber Firmware Model
---- ------ ------------------- ----- ----- ------------ -------- -----
FrameName, interconnect 6 Warning LE_TEST-LIG_TEST_1 Maintenance Off IC_SN6 1.5.0.1004 Virtual Connect SE 40Gb F8 Module for Syn.

PS > Reset-HPOVEnclosureDevice -Enclosure $Enclosure -Component ICM -DeviceID 6 -Efuse

if occur below error
-----------------------------------------------------------------------------------
Confirm
Are you sure you want to perform this action?
Performing the operation "Reset power for device" on target "ICM 6 within FrameName".
[Y] Yes [A] Yes to All [N] No [L] No to All [S] Suspend [?] Help (default is "Y"): Y
Reset-HPOVEnclosureDevice : [Send-HPOVRequest]: The requested action cannot be performed because the resource has changed which indicates th
at it was recently modified by another operation. Restart this operation to ensure the current version of the resource is being used.
At line:1 char:1
+ Reset-HPOVEnclosureDevice -Enclosure $Enclosure -Component ICM -Devic ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : InvalidOperation: (Send-HPOVRequest:String) [Reset-HPOVEnclosureDevice], InvalidOperationException
+ FullyQualifiedErrorId : PRECONDITION_FAILED,Reset-HPOVEnclosureDevice

>> Restart PS console and reconnect to Oneview session
-----------------------------------------------------------------------------------

-------------------------------------------------------------------
Windows PowerShell
v5.1: https://docs.microsoft.com/ko-kr/powershell/scripting/install/installing-windows-powershell?view=powershell-7

v6.2.4 : https://github.com/PowerShell/PowerShell/releases/download/v6.2.4/PowerShell-6.2.4-win-x64.msi

if PSOH install failed:
Windows C Runtime: https://www.microsoft.com/en-us/download/details.aspx?id=50410
https://aka.ms/pscore6-prereq

.net framework 4.6.2: https://dotnet.microsoft.com/download/dotnet-framework/net462
.net framework 4.7.2: https://dotnet.microsoft.com/download/dotnet-framework/net472
.net framework 4.8: https://dotnet.microsoft.com/download/dotnet-framework/net48

if .net install failed with 0x800713ec:
[1130:104C][2020-02-08T12:11:19]e000: Error 0x800713ec: Process returned error: 0x13ec
[1130:104C][2020-02-08T12:11:19]e000: Error 0x800713ec: Failed to execute EXE package.
[1290:13BC][2020-02-08T12:11:19]e000: Error 0x800713ec: Failed to configure per-machine EXE package.

install Windows hotfix
KB2919355 : https://www.microsoft.com/ko-KR/download/details.aspx?id=42334
Install order: clearcompressionflag.exe, KB2919355, KB2932046, KB2959977, KB2937592, KB2938439, KB2934018.
-------------------------------------------------------------------

1. Check Powershell version
PS> Get-Host | Select-Object Version
PS> $PSversiontable
PSVersion 6.2.4

2. Install / uninstall
PS> Install-Module HPOneView.500
PS> Install-Module -Name HPOneView.500 -RequiredVersion 5.0.2226.2609 <<< Install Specific Version
PS> Uninstall-Module HPOneView.500

cf. parameter:
-Force << execute by force
-verbose << observe detail progress

계속하려면 NuGet 공급자가 필요합니다.
'Install-PackageProvider -Name NuGet -MinimumVersion 2.8.5.201 -Force'
지금 PowerShellGet에서 NuGet 공급자를 설치하고 가져오시겠습니까?
[Y] 예(Y) [N] 아니요(N) [S] 일시 중단(S) [?] 도움말 (기본값은 "Y"): Y

신뢰할 수 없는 리포지토리
신뢰할 수 없는 리포지토리에서 모듈을 설치하는 중입니다. 이 리포지토리를 신뢰하는 경우 Set-PSRepository cmdlet을
실행하여 InstallationPolicy 값을 변경하십시오. 'PSGallery'에서 모듈을 설치하시겠습니까?
[Y] 예(Y) [A] 모두 예(A) [N] 아니요(N) [L] 모두 아니요(L) [S] 일시 중단(S) [?] 도움말 (기본값은 "N"): Y

자세한 정보 표시: 'HPOneView.500' 모듈의 'HPOneView.500.psd1' 파일에서 유효한 Authenticode 서명을 찾았습니다.
자세한 정보 표시: 'HPOneView.500' 모듈이 'C:\Program Files\WindowsPowerShell\Modules\HPOneView.500\5.0.2226.2609'
경로에 설치되었습니다.

3. loading module
PS> Import-Module HPOneView.500
PS> Import-Module "C:\Program Files\WindowsPowerShell\Modules\HPOneView.500\5.0.2295.3359\HPOneView.500.psd1"

if occur
-----------------------------------------------------
+ Import-Module HPOneView.500
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : 보안 오류: (:) [Import-Module], PSSecurityException
+ FullyQualifiedErrorId : UnauthorizedAccess,Microsoft.PowerShell.Commands.ImportModuleCommand

PS> Set-ExecutionPolicy RemoteSigned -Scope process
-----------------------------------------------------

if occur below error:
-----------------------------------------------------
Import-Module : The version of the Common Language Runtime (CLR) on this computer is '4.0.30319.34209'. The module
'C:\Program Files\WindowsPowerShell\Modules\HPOneView.500\5.0.2295.3359\HPOneView.500.psd1' requires a minimum CLR
version of '4.0.30319.42000' to run. Verify that you are running the minimum required version of CLR, and then try

+ Import-Module HPOneView.500
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : ResourceUnavailable: (Import-Module HPOneView.500:String) [Import-Module], InvalidOperat
ionException
+ FullyQualifiedErrorId : UnableToLoadModuleMissingDependancy,Microsoft.PowerShell.Commands.ImportModuleCommand

>> CLR version 4.0.30319.42000 supports .NET Framework versions starting with .NET Framework 4.6.

check .net framework version.
CMD> dir %WINDIR%\Microsoft.Net\Framework\v* /O:-N /B

Checking the .Net Framework version using PowerShell
(Get-ItemProperty ‘HKLM:\SOFTWARE\Microsoft\NET Framework Setup\NDP\v4\Full’ -Name Release).Release
-----------------------------------------------------

증상
Apollo 4510 Gen10 Chassis의 사용자 가이드를 참조할 경우, FAN의 Numbering은 #1-#5 입니다.

그런데, 장애 시, IML 상에 다른 FAN 번호가 명시될 수 있습니다.
e.g.) Fan Failure (Fan 7, Location System)

원인
Apollo 4510 Gen10 Chassis에 사용되는 FAN이 Dual rotor로 인해 발생됨

환경
· Apollo 4510 Gen10 Chassis
- XL450 Gen10

솔루션
아래 FAN Numbering 참조

증상
Apollo a6000 Chassis의 사용자 가이드를 참조할 경우, FAN의 Numbering은 #1-#5 임.

장애 시, IML 상에 다른 FAN 번호가 표시 될 수 있음.
e.g.) Fan Failure (Fan 8, Location System)

원인
Apollo a6000 Chassis에 사용되는 FAN이 Dual rotor로 인해 발생됨

환경
· Apollo a6000 Chassis

솔루션
아래 FAN Numbering 참조