How build HA with 2 node iSCSI using targetcli

Tags:
Fedora
Gluster
VMware
VMware ESXi
VMware HA
In a team with a friend, we have created a small lab to understand how VMware multipath works. We have created 2 nodes, which remain aligned with GlusterFS via 10GB LAN. Subsequently, from each of these 2 nodes we export the volumes with the targetcli service, on iSCSI. In VMware ESXi 5.5 we see the 2 devices and we can mount the volume. So far so good.
The problem If node 11 fails, ESXi continues to see the volume, correct behavior for an HA service If node 12 fails, ESXi no longer sees the volume. We have tried in many ways without being able to solve the problem.
Can you give a solution? here follow configuration Any help will be very very appreciated :-)  CONFIGURATION TARGETCLI Node11 o- / .................................................................................... [...] o- backstores .........................................................................[...] | o- block ............................................................. [Storage Objects: 0] | o- fileio ............................................................ [Storage Objects: 3] | | o- disk1 ................... [/tmp/fusebrick1/disk1.img (1000.0GiB) write-back activated] | | | o- alua .............................................................. [ALUA Groups: 1] | | |   o- default_tg_pt_gp .................................. [ALUA state: Active/optimized] | | o- disk2 .................... [/tmp/fusebrick2/disk2.img (850.0GiB) write-back activated] | | | o- alua .............................................................. [ALUA Groups: 1] | | |   o- default_tg_pt_gp .................................. [ALUA state: Active/optimized] | | o- disk3 .................... [/tmp/fusebrick3/disk3.img (850.0GiB) write-back activated] | |   o- alua .............................................................. [ALUA Groups: 1] | |     o- default_tg_pt_gp .................................. [ALUA state: Active/optimized] | o- pscsi ............................................................. [Storage Objects: 0] | o- ramdisk ........................................................... [Storage Objects: 0] | o- user:glfs ......................................................... [Storage Objects: 0] | o- user:qcow ......................................................... [Storage Objects: 0] o- iscsi ....................................................................... [Targets: 3] | o- iqn.2018-05.com.cybertrade:fusegsas1 ......................................... [TPGs: 2] | | o- tpg1 ............................................................. [gen-acls, no-auth] | | | o- acls ..................................................................... [ACLs: 0] | | | o- luns ..................................................................... [LUNs: 1] | | | | o- lun0 ............... [fileio/disk1 (/tmp/fusebrick1/disk1.img) (default_tg_pt_gp)] | | | o- portals ............................................................... [Portals: 1] | | |   o- 192.168.13.11:3260 .......................................................... [OK] | | o- tpg2 ...................................................................... [disabled] | |   o- acls ..................................................................... [ACLs: 0] | |   o- luns ..................................................................... [LUNs: 1] | |   | o- lun0 ............... [fileio/disk1 (/tmp/fusebrick1/disk1.img) (default_tg_pt_gp)] | |   o- portals ............................................................... [Portals: 1] | |     o- 192.168.13.12:3260 .......................................................... [OK] | o- iqn.2018-05.com.cybertrade:fusegssd2 ......................................... [TPGs: 1] | | o- tpg1 ...................................................................... [disabled] | |   o- acls ..................................................................... [ACLs: 0] | |   o- luns ..................................................................... [LUNs: 1] | |   | o- lun0 ............... [fileio/disk2 (/tmp/fusebrick2/disk2.img) (default_tg_pt_gp)] | |   o- portals ............................................................... [Portals: 1] | |     o- 192.168.13.11:3260 .......................................................... [OK] | o- iqn.2018-05.com.cybertrade:fusegssd3 ......................................... [TPGs: 1] |   o- tpg1 ...................................................................... [disabled] |     o- acls ..................................................................... [ACLs: 0] |     o- luns ..................................................................... [LUNs: 1] |     | o- lun0 ............... [fileio/disk3 (/tmp/fusebrick3/disk3.img) (default_tg_pt_gp)] |     o- portals ............................................................... [Portals: 1] |       o- 192.168.13.11:3260 .......................................................... [OK] o- loopback .................................................................... [Targets: 0] o- vhost ....................................................................... [Targets: 0]   How ESXi see iSCSI
~ # esxcli iscsi adapter target list Adapter  Target                                Alias  Discovery Method  Last Error -------  ------------------------------------  ----- ----------------  ---------- vmhba37  iqn.2018-05.com.cybertrade:fusegsas1 SENDTARGETS       No Error~ # esxcli storage nmp device list |grep -A 10 LIO-ORG Device Display Name: LIO-ORG iSCSI Disk (naa.600140567cfc1b1871643eeaa3ffde3c) Storage Array Type: VMW_SATP_ALUA Storage Array Type Device Config: {implicit_support=on;explicit_support=on; explicit_allow=on;alua_followover=on; action_OnRetryErrors=off; {TPG_id=0,TPG_state=AO}} Path Selection Policy: VMW_PSP_MRU Path Selection Policy Device Config: Current Path=vmhba37:C3:T0:L0 Path Selection Policy Device Custom Config: Working Paths: vmhba37:C3:T0:L0 Is Local SAS Device: false Is USB: false Is Boot USB Device: false -- Device Display Name: LIO-ORG iSCSI Disk (naa.6001405806da4c8980e435abc4a35a4d) Storage Array Type: VMW_SATP_ALUA Storage Array Type Device Config: {implicit_support=on;explicit_support=on; explicit_allow=on;alua_followover=on; action_OnRetryErrors=off; {TPG_id=0,TPG_state=AO}} Path Selection Policy: VMW_PSP_MRU Path Selection Policy Device Config: Current Path=vmhba37:C1:T0:L0 Path Selection Policy Device Custom Config: Working Paths: vmhba37:C1:T0:L0 Is Local SAS Device: false Is USB: false Is Boot USB Device: false ~ # esxcli iscsi session list vmhba37,iqn.2018-05.com.cybertrade:fusegsas1,00023d000001 Adapter: vmhba37 Target: iqn.2018-05.com.cybertrade:fusegsas1 ISID: 00023d000001 TargetPortalGroupTag: 1 AuthenticationMethod: none DataPduInOrder: true DataSequenceInOrder: true DefaultTime2Retain: 0 DefaultTime2Wait: 2 ErrorRecoveryLevel: 0 FirstBurstLength: 65536 ImmediateData: true InitialR2T: true MaxBurstLength: 262144 MaxConnections: 1 MaxOutstandingR2T: 1 TSIH: 11 vmhba37,iqn.2018-05.com.cybertrade:fusegsas1,00023d000002 Adapter: vmhba37 Target: iqn.2018-05.com.cybertrade:fusegsas1 ISID: 00023d000002 TargetPortalGroupTag: 1 AuthenticationMethod: none DataPduInOrder: true DataSequenceInOrder: true DefaultTime2Retain: 0 DefaultTime2Wait: 2 ErrorRecoveryLevel: 0 FirstBurstLength: 65536 ImmediateData: true InitialR2T: true MaxBurstLength: 262144 MaxConnections: 1 MaxOutstandingR2T: 1 TSIH: 12 vmhba37,iqn.2018-05.com.cybertrade:fusegsas1,00023d000003 Adapter: vmhba37 Target: iqn.2018-05.com.cybertrade:fusegsas1 ISID: 00023d000003 TargetPortalGroupTag: 2 AuthenticationMethod: none DataPduInOrder: true DataSequenceInOrder: true DefaultTime2Retain: 0 DefaultTime2Wait: 2 ErrorRecoveryLevel: 0 FirstBurstLength: 65536 ImmediateData: true InitialR2T: true MaxBurstLength: 262144 MaxConnections: 1 MaxOutstandingR2T: 1 TSIH: 10 vmhba37,iqn.2018-05.com.cybertrade:fusegsas1,00023d000004 Adapter: vmhba37 Target: iqn.2018-05.com.cybertrade:fusegsas1 ISID: 00023d000004 TargetPortalGroupTag: 2 AuthenticationMethod: none DataPduInOrder: true DataSequenceInOrder: true DefaultTime2Retain: 0 DefaultTime2Wait: 2 ErrorRecoveryLevel: 0 FirstBurstLength: 65536 ImmediateData: true InitialR2T: true MaxBurstLength: 262144 MaxConnections: 1 MaxOutstandingR2T: 1 TSIH: 9   ~ # esxcli iscsi networkportal list vmhba37 Adapter: vmhba37 Vmknic: vmk3 MAC Address: a0:36:9f:26:a8:48 MAC Address Valid: true IPv4: 192.168.13.218 IPv4 Subnet Mask: 255.255.255.0 IPv6: MTU: 1500 Vlan Supported: true Vlan ID: 0 Reserved Ports: 63488~65536 TOE: false TSO: true TCP Checksum: false Link Up: true Current Speed: 10000 Rx Packets: 448221 Tx Packets: 84994 NIC Driver: ixgbe NIC Driver Version: 3.21.4.3iov NIC Firmware Version: 0x80000369 Compliant Status: compliant NonCompliant Message: NonCompliant Remedy: Vswitch: vSwitch1 PortGroup: VMkernel-iSCSI01 VswitchUuid: PortGroupKey: PortKey: Duplex: Path Status: active vmhba37 Adapter: vmhba37 Vmknic: vmk4 MAC Address: a0:36:9f:26:a8:4a MAC Address Valid: true IPv4: 192.168.13.228 IPv4 Subnet Mask: 255.255.255.0 IPv6: MTU: 1500 Vlan Supported: true Vlan ID: 0 Reserved Ports: 63488~65536 TOE: false TSO: true TCP Checksum: false Link Up: true Current Speed: 10000 Rx Packets: 233889 Tx Packets: 62412 NIC Driver: ixgbe NIC Driver Version: 3.21.4.3iov NIC Firmware Version: 0x80000369 Compliant Status: compliant NonCompliant Message: NonCompliant Remedy: Vswitch: vSwitch1 PortGroup: VMkernel-iSCSI02 VswitchUuid: PortGroupKey: PortKey: Duplex: Path Status: active


Software/Hardware used:
evaluate Multipath iSCSI Vmware with lab build with 3 HP 380 G6
0

Answer Wiki

Thanks. We'll let you know when a new response is added.
Send me notifications when members answer or reply to this question.

Discuss This Question:  

 
There was an error processing your information. Please try again later.
Thanks. We'll let you know when a new response is added.
Send me notifications when members answer or reply to this question.

Forgot Password

No problem! Submit your e-mail address below. We'll send you an e-mail containing your password.

Your password has been sent to:

To follow this tag...

There was an error processing your information. Please try again later.

Thanks! We'll email you when relevant content is added and updated.

Following

Share this item with your network: