Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LUN discovery problem on 16/32Gb cards on linux client #128

Open
lignumqt opened this issue Feb 7, 2023 · 8 comments
Open

LUN discovery problem on 16/32Gb cards on linux client #128

lignumqt opened this issue Feb 7, 2023 · 8 comments

Comments

@lignumqt
Copy link

lignumqt commented Feb 7, 2023 •
edited
Loading

Hi!

Ubuntu 18.04/20.04
Kernel 4.19.107/5.15
Scst 3.4.0/3.6.0/3.7.0

I have two cards in the system(let's call it client), one 8Gb works in target mode, the second 16/32Gb works in initiator mode

81:00.0 Fibre Channel: QLogic Corp. ISP2722-based 16/32Gb Fibre Channel to PCIe Adapter (rev 01)
81:00.1 Fibre Channel: QLogic Corp. ISP2722-based 16/32Gb Fibre Channel to PCIe Adapter (rev 01)
83:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)
83:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)

I connect LUN from storage and it shows up right after rescan on this client. if I do a client reboot, then after it loads the LUN appears after about 4-5 minutes. I want to note that I tried to build the Linux kernel with the default QLA driver, without scst, and this was not observed there, after the client loads, the LUN is immediately visible. We tried to use 8Gb cards as initiator and it worked well, the problem described as with 16/32 did not observed. I also tried to add a parameter, ql2xnvmeenable=0, it did not help

If you need anything else tell me.

driver loaded with parameters:

options qla2xxx qlini_mode="exclusive"
options qla2xxx ql2xasynctmfenable=1

logs without debug mode(scst 3.4.0):

2023-02-07 15:21:18.843 0 4 localhost kernel:[   53.627055] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 10.01.00.19-k.
2023-02-07 15:21:18.843 0 4 localhost kernel:[   53.627291] qla2xxx [0000:81:00.0]-011c: : MSI-X vector count: 16.
2023-02-07 15:21:18.843 0 4 localhost kernel:[   53.627293] qla2xxx [0000:81:00.0]-001d: : Found an ISP2261 irq 34 iobase 0x00000000d99aafa2.
2023-02-07 15:21:18.843 0 4 localhost kernel:[   53.703416] qla2xxx [0000:81:00.0]-0075:15: ZIO mode 6 enabled; timer delay (200 us).
2023-02-07 15:21:18.843 0 4 localhost kernel:[   53.703540] qla2xxx [0000:81:00.0]-ffff:15: FC4 priority set to NVMe
2023-02-07 15:21:18.843 0 4 localhost kernel:[   55.736523] qla2xxx [0000:81:00.0]-d302:15: qla2x00_get_fw_version: FC-NVMe is Enabled (0x785a)
2023-02-07 15:21:18.843 0 6 localhost kernel:[   56.037416] scsi host15: qla2xxx
2023-02-07 15:21:18.843 0 4 localhost kernel:[   56.038741] qla2xxx [0000:81:00.0]-00fb:15: QLogic SN1100Q - HPE SN1100Q 16Gb 2p FC HBA.
2023-02-07 15:21:18.843 0 4 localhost kernel:[   56.039434] qla2xxx [0000:81:00.0]-00fc:15: ISP2261: PCIe (8.0GT/s x8) @ 0000:81:00.0 hdma+ host#=15 fw=9.03.00 (d0d5).
2023-02-07 15:21:18.843 0 4 localhost kernel:[   56.040446] qla2xxx [0000:81:00.1]-011c: : MSI-X vector count: 16.
2023-02-07 15:21:18.843 0 4 localhost kernel:[   56.041123] qla2xxx [0000:81:00.1]-001d: : Found an ISP2261 irq 362 iobase 0x00000000693e9a30.
2023-02-07 15:21:18.843 0 4 localhost kernel:[   56.106531] qla2xxx [0000:81:00.1]-0075:16: ZIO mode 6 enabled; timer delay (200 us).
2023-02-07 15:21:18.843 0 4 localhost kernel:[   56.107473] qla2xxx [0000:81:00.1]-ffff:16: FC4 priority set to NVMe
2023-02-07 15:21:18.843 0 4 localhost kernel:[   57.314101] qla2xxx [0000:81:00.0]-500a:15: LOOP UP detected (8 Gbps).
2023-02-07 15:21:18.843 0 4 localhost kernel:[   57.575811] qla2xxx [0000:81:00.0]-ffff:15: register_localport: host-traddr=nn-0x51402ec014829b91:pn-0x51402ec014829b90 on portID:10300
2023-02-07 15:21:18.843 0 3 localhost kernel:[   57.577194] qla2xxx [0000:81:00.0]-ffff:15: register_localport failed: ret=ffffffea
2023-02-07 15:21:18.843 0 4 localhost kernel:[   58.049870] qla2xxx [0000:81:00.1]-d302:16: qla2x00_get_fw_version: FC-NVMe is Enabled (0x785a)
2023-02-07 15:21:18.843 0 6 localhost kernel:[   58.351212] scsi host16: qla2xxx
2023-02-07 15:21:18.843 0 4 localhost kernel:[   58.353096] qla2xxx [0000:81:00.1]-00fb:16: QLogic SN1100Q - HPE SN1100Q 16Gb 2p FC HBA.
2023-02-07 15:21:18.843 0 4 localhost kernel:[   58.353896] qla2xxx [0000:81:00.1]-00fc:16: ISP2261: PCIe (8.0GT/s x8) @ 0000:81:00.1 hdma+ host#=16 fw=9.03.00 (d0d5).
2023-02-07 15:21:18.843 0 4 localhost kernel:[   58.354876] qla2xxx [0000:83:00.0]-001d: : Found an ISP2532 irq 379 iobase 0x00000000dee644fd.
2023-02-07 15:21:18.843 0 6 localhost kernel:[   58.923417] scsi host17: qla2xxx
2023-02-07 15:21:18.843 0 4 localhost kernel:[   58.925071] qla2xxx [0000:83:00.0]-00fb:17: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA.
2023-02-07 15:21:18.843 0 4 localhost kernel:[   58.925845] qla2xxx [0000:83:00.0]-00fc:17: ISP2532: PCIe (5.0GT/s x8) @ 0000:83:00.0 hdma+ host#=17 fw=8.08.207 (90d5).
2023-02-07 15:21:18.843 0 4 localhost kernel:[   58.926778] qla2xxx [0000:83:00.1]-001d: : Found an ISP2532 irq 382 iobase 0x00000000f5eaf38d.
2023-02-07 15:21:18.843 0 4 localhost kernel:[   59.489965] qla2xxx [0000:81:00.1]-500a:16: LOOP UP detected (8 Gbps).
2023-02-07 15:21:18.843 0 6 localhost kernel:[   59.490076] scsi host18: qla2xxx
2023-02-07 15:21:18.843 0 4 localhost kernel:[   59.492416] qla2xxx [0000:83:00.1]-00fb:18: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA.
2023-02-07 15:21:18.843 0 4 localhost kernel:[   59.493202] qla2xxx [0000:83:00.1]-00fc:18: ISP2532: PCIe (5.0GT/s x8) @ 0000:83:00.1 hdma+ host#=18 fw=8.08.207 (90d5).
2023-02-07 15:21:18.843 0 4 localhost kernel:[   59.869337] qla2xxx [0000:81:00.1]-ffff:16: register_localport: host-traddr=nn-0x51402ec014829b93:pn-0x51402ec014829b92 on portID:10f00
2023-02-07 15:21:18.843 0 3 localhost kernel:[   59.869339] qla2xxx [0000:81:00.1]-ffff:16: register_localport failed: ret=ffffffea
2023-02-07 15:21:20.857 0 6 localhost kernel:[   69.580744] [2928]: scst: Target template qla2x00t registered successfully
2023-02-07 15:21:20.857 0 6 localhost kernel:[   69.581167] [2928]: scst: Target 51:40:2e:c0:14:82:9b:90 for template qla2x00t registered successfully
2023-02-07 15:21:20.857 0 6 localhost kernel:[   69.581562] [2928]: scst: Target 51:40:2e:c0:14:82:9b:92 for template qla2x00t registered successfully
2023-02-07 15:21:20.857 0 6 localhost kernel:[   69.581960] [2928]: scst: Target 21:00:00:24:ff:92:e9:0e for template qla2x00t registered successfully
2023-02-07 15:21:20.857 0 6 localhost kernel:[   69.582352] [2928]: scst: Target 21:00:00:24:ff:92:e9:0f for template qla2x00t registered successfully
2023-02-07 15:21:31.511 0 4 localhost kernel:[   80.234282] qla2xxx [0000:83:00.0]-8038:17: Cable is unplugged...
2023-02-07 15:21:32.124 0 4 localhost kernel:[   80.847627] qla2xxx [0000:83:00.1]-8038:18: Cable is unplugged...
2023-02-07 15:22:13.537 0 4 localhost kernel:[  122.259853] qla2xxx [0000:81:00.0]-801c:15: Abort command issued nexus=15:0:0 -- 2003.
2023-02-07 15:22:13.554 0 4 localhost kernel:[  122.276555] qla2xxx [0000:81:00.0]-8009:15: DEVICE RESET ISSUED nexus=15:0:0 cmd=0000000018211d65.
2023-02-07 15:22:13.554 0 4 localhost kernel:[  122.276852] qla2xxx [0000:81:00.0]-800e:15: DEVICE RESET SUCCEEDED nexus:15:0:0 cmd=0000000018211d65.
2023-02-07 15:22:20.364 0 4 localhost kernel:[  129.086513] qla2xxx [0000:81:00.1]-801c:16: Abort command issued nexus=16:0:0 -- 2003.
2023-02-07 15:22:20.381 0 4 localhost kernel:[  129.103185] qla2xxx [0000:81:00.1]-8009:16: DEVICE RESET ISSUED nexus=16:0:0 cmd=000000002e5c68c5.
2023-02-07 15:22:20.381 0 4 localhost kernel:[  129.103503] qla2xxx [0000:81:00.1]-800e:16: DEVICE RESET SUCCEEDED nexus:16:0:0 cmd=000000002e5c68c5.
2023-02-07 15:22:56.204 0 4 localhost kernel:[  164.926515] qla2xxx [0000:81:00.0]-801c:15: Abort command issued nexus=15:0:0 -- 2003.
2023-02-07 15:22:56.204 0 4 localhost kernel:[  164.926525] qla2xxx [0000:81:00.0]-8009:15: DEVICE RESET ISSUED nexus=15:0:0 cmd=0000000018211d65.
2023-02-07 15:22:56.204 0 4 localhost kernel:[  164.926768] qla2xxx [0000:81:00.0]-800e:15: DEVICE RESET SUCCEEDED nexus:15:0:0 cmd=0000000018211d65.
2023-02-07 15:22:56.204 0 4 localhost kernel:[  164.926776] qla2xxx [0000:81:00.0]-8009:15: TARGET RESET ISSUED nexus=15:0:0 cmd=0000000018211d65.
2023-02-07 15:22:56.204 0 4 localhost kernel:[  164.926996] qla2xxx [0000:81:00.0]-800e:15: TARGET RESET SUCCEEDED nexus:15:0:0 cmd=0000000018211d65.
2023-02-07 15:23:03.031 0 4 localhost kernel:[  171.753176] qla2xxx [0000:81:00.1]-801c:16: Abort command issued nexus=16:0:0 -- 2003.
2023-02-07 15:23:03.031 0 4 localhost kernel:[  171.753186] qla2xxx [0000:81:00.1]-8009:16: DEVICE RESET ISSUED nexus=16:0:0 cmd=000000002e5c68c5.
2023-02-07 15:23:03.031 0 4 localhost kernel:[  171.753425] qla2xxx [0000:81:00.1]-800e:16: DEVICE RESET SUCCEEDED nexus:16:0:0 cmd=000000002e5c68c5.
2023-02-07 15:23:03.031 0 4 localhost kernel:[  171.753431] qla2xxx [0000:81:00.1]-8009:16: TARGET RESET ISSUED nexus=16:0:0 cmd=000000002e5c68c5.
2023-02-07 15:23:03.031 0 4 localhost kernel:[  171.753562] qla2xxx [0000:81:00.1]-800e:16: TARGET RESET SUCCEEDED nexus:16:0:0 cmd=000000002e5c68c5.
2023-02-07 15:23:38.871 0 4 localhost kernel:[  207.593194] qla2xxx [0000:81:00.0]-801c:15: Abort command issued nexus=15:0:0 -- 2003.
2023-02-07 15:23:38.871 0 4 localhost kernel:[  207.593204] qla2xxx [0000:81:00.0]-8009:15: DEVICE RESET ISSUED nexus=15:0:0 cmd=0000000018211d65.
2023-02-07 15:23:38.871 0 4 localhost kernel:[  207.593485] qla2xxx [0000:81:00.0]-800e:15: DEVICE RESET SUCCEEDED nexus:15:0:0 cmd=0000000018211d65.
2023-02-07 15:23:38.871 0 4 localhost kernel:[  207.593491] qla2xxx [0000:81:00.0]-8012:15: BUS RESET ISSUED nexus=15:0:0.
2023-02-07 15:23:38.871 0 3 localhost kernel:[  207.594966] qla2xxx [0000:81:00.0]-802b:15: BUS RESET SUCCEEDED nexus=15:0:0.
2023-02-07 15:23:39.331 0 4 localhost kernel:[  208.055068] qla2xxx [0000:81:00.0]-ffff:15: register_localport: host-traddr=nn-0x51402ec014829b91:pn-0x51402ec014829b90 on portID:10300
2023-02-07 15:23:39.331 0 3 localhost kernel:[  208.055072] qla2xxx [0000:81:00.0]-ffff:15: register_localport failed: ret=ffffffea
2023-02-07 15:23:45.697 0 4 localhost kernel:[  214.419835] qla2xxx [0000:81:00.1]-801c:16: Abort command issued nexus=16:0:0 -- 2003.
2023-02-07 15:23:45.697 0 4 localhost kernel:[  214.419846] qla2xxx [0000:81:00.1]-8009:16: DEVICE RESET ISSUED nexus=16:0:0 cmd=000000002e5c68c5.
2023-02-07 15:23:45.697 0 4 localhost kernel:[  214.420161] qla2xxx [0000:81:00.1]-800e:16: DEVICE RESET SUCCEEDED nexus:16:0:0 cmd=000000002e5c68c5.
2023-02-07 15:23:45.697 0 4 localhost kernel:[  214.420169] qla2xxx [0000:81:00.1]-8012:16: BUS RESET ISSUED nexus=16:0:0.
2023-02-07 15:23:45.697 0 3 localhost kernel:[  214.421837] qla2xxx [0000:81:00.1]-802b:16: BUS RESET SUCCEEDED nexus=16:0:0.
2023-02-07 15:23:46.711 0 4 localhost kernel:[  215.434698] qla2xxx [0000:81:00.1]-ffff:16: register_localport: host-traddr=nn-0x51402ec014829b93:pn-0x51402ec014829b92 on portID:10f00
2023-02-07 15:23:46.711 0 3 localhost kernel:[  215.434702] qla2xxx [0000:81:00.1]-ffff:16: register_localport failed: ret=ffffffea
2023-02-07 15:24:31.777 0 4 localhost kernel:[  260.499815] qla2xxx [0000:81:00.0]-801c:15: Abort command issued nexus=15:0:0 -- 2003.
2023-02-07 15:24:31.777 0 4 localhost kernel:[  260.499834] qla2xxx [0000:81:00.0]-8009:15: DEVICE RESET ISSUED nexus=15:0:0 cmd=0000000018211d65.
2023-02-07 15:24:31.777 0 4 localhost kernel:[  260.500025] qla2xxx [0000:81:00.0]-800e:15: DEVICE RESET SUCCEEDED nexus:15:0:0 cmd=0000000018211d65.
2023-02-07 15:24:31.777 0 4 localhost kernel:[  260.500030] qla2xxx [0000:81:00.0]-8018:15: ADAPTER RESET ISSUED nexus=15:0:0.
2023-02-07 15:24:31.777 0 4 localhost kernel:[  260.500051] qla2xxx [0000:81:00.0]-00af:15: Performing ISP error recovery - ha=00000000f4d3175e.
2023-02-07 15:24:31.814 0 4 localhost kernel:[  260.536467] qla2xxx [0000:81:00.0]-0075:15: ZIO mode 6 enabled; timer delay (200 us).
2023-02-07 15:24:31.814 0 4 localhost kernel:[  260.536471] qla2xxx [0000:81:00.0]-ffff:15: FC4 priority set to NVMe
2023-02-07 15:24:33.784 0 4 localhost kernel:[  262.506506] qla2xxx [0000:81:00.0]-d302:15: qla2x00_get_fw_version: FC-NVMe is Enabled (0x785a)
2023-02-07 15:24:35.554 0 4 localhost kernel:[  264.276463] qla2xxx [0000:81:00.0]-500a:15: LOOP UP detected (8 Gbps).
2023-02-07 15:24:35.637 0 4 localhost kernel:[  264.359813] qla2xxx [0000:81:00.0]-8017:15: ADAPTER RESET SUCCEEDED nexus=15:0:0.
2023-02-07 15:24:36.077 0 4 localhost kernel:[  264.802396] qla2xxx [0000:81:00.0]-ffff:15: register_localport: host-traddr=nn-0x51402ec014829b91:pn-0x51402ec014829b90 on portID:10300
2023-02-07 15:24:36.077 0 3 localhost kernel:[  264.802400] qla2xxx [0000:81:00.0]-ffff:15: register_localport failed: ret=ffffffea
2023-02-07 15:24:38.604 0 4 localhost kernel:[  267.326471] qla2xxx [0000:81:00.1]-801c:16: Abort command issued nexus=16:0:0 -- 2003.
2023-02-07 15:24:38.604 0 4 localhost kernel:[  267.326480] qla2xxx [0000:81:00.1]-8009:16: DEVICE RESET ISSUED nexus=16:0:0 cmd=000000002e5c68c5.
2023-02-07 15:24:38.604 0 4 localhost kernel:[  267.326707] qla2xxx [0000:81:00.1]-800e:16: DEVICE RESET SUCCEEDED nexus:16:0:0 cmd=000000002e5c68c5.
2023-02-07 15:24:38.604 0 4 localhost kernel:[  267.326711] qla2xxx [0000:81:00.1]-8018:16: ADAPTER RESET ISSUED nexus=16:0:0.
2023-02-07 15:24:38.604 0 4 localhost kernel:[  267.326727] qla2xxx [0000:81:00.1]-00af:16: Performing ISP error recovery - ha=00000000fb84c555.
2023-02-07 15:24:38.644 0 4 localhost kernel:[  267.366471] qla2xxx [0000:81:00.1]-0075:16: ZIO mode 6 enabled; timer delay (200 us).
2023-02-07 15:24:38.644 0 4 localhost kernel:[  267.366474] qla2xxx [0000:81:00.1]-ffff:16: FC4 priority set to NVMe
2023-02-07 15:24:40.637 0 4 localhost kernel:[  269.359944] qla2xxx [0000:81:00.1]-d302:16: qla2x00_get_fw_version: FC-NVMe is Enabled (0x785a)
2023-02-07 15:24:42.407 0 4 localhost kernel:[  271.129845] qla2xxx [0000:81:00.1]-500a:16: LOOP UP detected (8 Gbps).
2023-02-07 15:24:42.474 0 4 localhost kernel:[  271.196648] qla2xxx [0000:81:00.1]-8017:16: ADAPTER RESET SUCCEEDED nexus=16:0:0.
2023-02-07 15:24:43.441 0 4 localhost kernel:[  272.165698] qla2xxx [0000:81:00.1]-ffff:16: register_localport: host-traddr=nn-0x51402ec014829b93:pn-0x51402ec014829b92 on portID:10f00
2023-02-07 15:24:43.441 0 3 localhost kernel:[  272.165702] qla2xxx [0000:81:00.1]-ffff:16: register_localport failed: ret=ffffffea
2023-02-07 15:36:37.877 0 4 localhost kernel:[  986.601011] qla2xxx [0000:81:00.1]-ffff:16: register_localport: host-traddr=nn-0x51402ec014829b93:pn-0x51402ec014829b92 on portID:10f00
2023-02-07 15:36:37.877 0 3 localhost kernel:[  986.601016] qla2xxx [0000:81:00.1]-ffff:16: register_localport failed: ret=ffffffea
2023-02-07 15:36:43.087 0 4 localhost kernel:[  991.811009] qla2xxx [0000:81:00.0]-ffff:15: register_localport: host-traddr=nn-0x51402ec014829b91:pn-0x51402ec014829b90 on portID:10300
2023-02-07 15:36:43.087 0 3 localhost kernel:[  991.811014] qla2xxx [0000:81:00.0]-ffff:15: register_localport failed: ret=ffffffea
2023-02-07 15:36:43.887 0 4 localhost kernel:[  992.610909] qla2xxx [0000:81:00.0]-ffff:15: register_localport: host-traddr=nn-0x51402ec014829b91:pn-0x51402ec014829b90 on portID:10300
2023-02-07 15:36:43.887 0 3 localhost kernel:[  992.610913] qla2xxx [0000:81:00.0]-ffff:15: register_localport failed: ret=ffffffea
@lnocturno
Copy link
Contributor

Hi,

Could you try options qla2xxx qlini_mode="disabled"?

Thanks,
Gleb

@lignumqt
Copy link
Author

Hi,

Could you try options qla2xxx qlini_mode="disabled"?

Thanks, Gleb

Hi Gleb, thanks for the answer, but it didn't help.

The paths did not appear even 10 minutes after the reboot. Moreover, the state of the links was not defined as Online.
I now have all ports configured as an initiator, but the bottom two(it's 16/32Gb cards) should be online (when loading a module into an qlini_mode="exclusive", the state of the links becomes online as it should)

cat /sys/kernel/scst_tgt/targets/qla2x00t/*/enabled
0
0
0
0

this is link state with qlini_mode="exclusive":

cat /sys/kernel/scst_tgt/targets/qla*/*/host/device/fc_host/*/port_state
Linkdown
Linkdown
Online
Online

this is link state with qlini_mode="disabled":

cat /sys/kernel/scst_tgt/targets/qla*/*/host/device/fc_host/*/port_state
Linkdown
Linkdown
Linkdown
Linkdown

log with qlini_mode="disabled":

2023-02-13 11:26:55.105 0 4 localhost kernel:[   52.523126] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 10.01.00.19-k.
2023-02-13 11:26:55.105 0 4 localhost kernel:[   52.523416] qla2xxx [0000:81:00.0]-011c: : MSI-X vector count: 16.
2023-02-13 11:26:55.105 0 4 localhost kernel:[   52.523418] qla2xxx [0000:81:00.0]-001d: : Found an ISP2261 irq 34 iobase 0x0000000045767be7.
2023-02-13 11:26:55.105 0 4 localhost kernel:[   52.589987] qla2xxx [0000:81:00.0]-0075:15: ZIO mode 6 enabled; timer delay (200 us).
2023-02-13 11:26:55.105 0 4 localhost kernel:[   52.953423] qla2xxx [0000:81:00.0]-ffff:15: FC4 priority set to NVMe
2023-02-13 11:26:55.105 0 4 localhost kernel:[   54.960066] qla2xxx [0000:81:00.0]-d302:15: qla2x00_get_fw_version: FC-NVMe is Enabled (0x785a)
2023-02-13 11:26:55.105 0 6 localhost kernel:[   55.027959] scsi host15: qla2xxx
2023-02-13 11:26:55.105 0 4 localhost kernel:[   55.029419] qla2xxx [0000:81:00.0]-00fb:15: QLogic SN1100Q - HPE SN1100Q 16Gb 2p FC HBA.
2023-02-13 11:26:55.105 0 4 localhost kernel:[   55.030104] qla2xxx [0000:81:00.0]-00fc:15: ISP2261: PCIe (8.0GT/s x8) @ 0000:81:00.0 hdma+ host#=15 fw=9.03.00 (d0d5).
2023-02-13 11:26:55.105 0 4 localhost kernel:[   55.031373] qla2xxx [0000:81:00.1]-011c: : MSI-X vector count: 16.
2023-02-13 11:26:55.105 0 4 localhost kernel:[   55.032094] qla2xxx [0000:81:00.1]-001d: : Found an ISP2261 irq 362 iobase 0x0000000098a615c6.
2023-02-13 11:26:55.105 0 4 localhost kernel:[   55.100019] qla2xxx [0000:81:00.1]-0075:16: ZIO mode 6 enabled; timer delay (200 us).
2023-02-13 11:26:55.105 0 4 localhost kernel:[   55.100688] qla2xxx [0000:81:00.1]-ffff:16: FC4 priority set to NVMe
2023-02-13 11:26:55.105 0 4 localhost kernel:[   57.063367] qla2xxx [0000:81:00.1]-d302:16: qla2x00_get_fw_version: FC-NVMe is Enabled (0x785a)
2023-02-13 11:26:55.105 0 6 localhost kernel:[   57.131307] scsi host16: qla2xxx
2023-02-13 11:26:55.105 0 4 localhost kernel:[   57.132931] qla2xxx [0000:81:00.1]-00fb:16: QLogic SN1100Q - HPE SN1100Q 16Gb 2p FC HBA.
2023-02-13 11:26:55.105 0 4 localhost kernel:[   57.133688] qla2xxx [0000:81:00.1]-00fc:16: ISP2261: PCIe (8.0GT/s x8) @ 0000:81:00.1 hdma+ host#=16 fw=9.03.00 (d0d5).
2023-02-13 11:26:55.105 0 4 localhost kernel:[   57.134731] qla2xxx [0000:83:00.0]-001d: : Found an ISP2532 irq 379 iobase 0x00000000992ed89a.
2023-02-13 11:26:55.105 0 6 localhost kernel:[   57.690274] scsi host17: qla2xxx
2023-02-13 11:26:55.105 0 4 localhost kernel:[   57.692064] qla2xxx [0000:83:00.0]-00fb:17: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA.
2023-02-13 11:26:55.105 0 4 localhost kernel:[   57.692799] qla2xxx [0000:83:00.0]-00fc:17: ISP2532: PCIe (5.0GT/s x8) @ 0000:83:00.0 hdma+ host#=17 fw=8.08.207 (90d5).
2023-02-13 11:26:55.105 0 4 localhost kernel:[   57.693731] qla2xxx [0000:83:00.1]-001d: : Found an ISP2532 irq 382 iobase 0x00000000b4f2c25e.
2023-02-13 11:26:55.105 0 6 localhost kernel:[   58.223559] scsi host18: qla2xxx
2023-02-13 11:26:55.105 0 4 localhost kernel:[   58.225388] qla2xxx [0000:83:00.1]-00fb:18: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA.
2023-02-13 11:26:55.105 0 4 localhost kernel:[   58.226133] qla2xxx [0000:83:00.1]-00fc:18: ISP2532: PCIe (5.0GT/s x8) @ 0000:83:00.1 hdma+ host#=18 fw=8.08.207 (90d5).
2023-02-13 11:26:56.754 0 6 localhost kernel:[   65.536176] [2834]: scst: Target template qla2x00t registered successfully
2023-02-13 11:26:56.754 0 6 localhost kernel:[   65.536620] [2834]: scst: Target 51:40:2e:c0:14:82:9b:90 for template qla2x00t registered successfully
2023-02-13 11:26:56.757 0 6 localhost kernel:[   65.537046] [2834]: scst: Target 51:40:2e:c0:14:82:9b:92 for template qla2x00t registered successfully
2023-02-13 11:26:56.757 0 6 localhost kernel:[   65.537469] [2834]: scst: Target 21:00:00:24:ff:92:e9:0e for template qla2x00t registered successfully
2023-02-13 11:26:56.757 0 6 localhost kernel:[   65.537891] [2834]: scst: Target 21:00:00:24:ff:92:e9:0f for template qla2x00t registered successfully

@lignumqt
Copy link
Author

@lnocturno is there anything interesting in the logs? maybe i can try something else?

@lnocturno
Copy link
Contributor

Sorry for the long response.

is there anything interesting in the logs? maybe i can try something else?

You can try the master branch with the latest qla2x00t-32gbit driver.

You can also try qlini_mode="dual" so you can configure one adapter in initiator mode and the other in target mode.

Use mode "dual" if you need your QLA adapters to work in both initiator and target modes at the same time. In this mode, each qlogic host has individual qlini_mode, ql2xexchoffld, ql2xiniexchg attributes that can be changed dynamically.
For example, you can change qlini_mode to "disabled" for specific qlogic host:
echo "disabled" > /sys/devices/pci0000:80/0000:80:02.0/0000:81:00.0/host1/scsi_host/host1/qlini_mode

@lignumqt
Copy link
Author

lignumqt commented Apr 13, 2023 •
edited
Loading

Sorry for the long response.

is there anything interesting in the logs? maybe i can try something else?

You can try the master branch with the latest qla2x00t-32gbit driver.

You can also try qlini_mode="dual" so you can configure one adapter in initiator mode and the other in target mode.

Use mode "dual" if you need your QLA adapters to work in both initiator and target modes at the same time. In this mode, each qlogic host has individual qlini_mode, ql2xexchoffld, ql2xiniexchg attributes that can be changed dynamically.
For example, you can change qlini_mode to "disabled" for specific qlogic host:
echo "disabled" > /sys/devices/pci0000:80/0000:80:02.0/0000:81:00.0/host1/scsi_host/host1/qlini_mode
  1. I tried to use the master branch, unfortunately it does not work, a kernel crust is issued and the driver is not loaded
  2. I tried your second suggestion, and it works using enabled, more precisely, it does not matter if the qlini_mode parameter is used when loading the module, or for a specific port, the problem that arose does not appear, all paths from the LUN appear immediately as with 8Gb cards .

BUT, is it a bug or not, what works in the enabled mode but does not work in other modes? and will there be any problems when using this mode?

@jwx11
Copy link

jwx11 commented Oct 25, 2023 •
edited
Loading

Sorry for the long response.

is there anything interesting in the logs? maybe i can try something else?

You can try the master branch with the latest qla2x00t-32gbit driver.
You can also try qlini_mode="dual" so you can configure one adapter in initiator mode and the other in target mode.

Use mode "dual" if you need your QLA adapters to work in both initiator and target modes at the same time. In this mode, each qlogic host has individual qlini_mode, ql2xexchoffld, ql2xiniexchg attributes that can be changed dynamically.
For example, you can change qlini_mode to "disabled" for specific qlogic host:
echo "disabled" > /sys/devices/pci0000:80/0000:80:02.0/0000:81:00.0/host1/scsi_host/host1/qlini_mode
  1. I tried to use the master branch, unfortunately it does not work, a kernel crust is issued and the driver is not loaded
  2. I tried your second suggestion, and it works using enabled, more precisely, it does not matter if the qlini_mode parameter is used when loading the module, or for a specific port, the problem that arose does not appear, all paths from the LUN appear immediately as with 8Gb cards .

BUT, is it a bug or not, what works in the enabled mode but does not work in other modes? and will there be any problems when using this mode?

I got the same issue with QLE2742, QLA2772 too. no problem for "enabled" mode but wait for few minutes for the LUNs to show up once uing "exclusive" or "dual" mode.
I tested with master branch (3.8.0-pre) and 3.7.x, same issue.

@jwx11
Copy link

jwx11 commented Oct 26, 2023 •
edited
Loading

Test using master branch, on Rocky Linux 8.8 (kernel 4.18.0-477.27.1.el8_8.x86_64)
commit 4c0fb04 (HEAD -> master, origin/qla2x00t-32gbit, origin/master, origin/HEAD)
Date: Fri Sep 22 16:31:45 2023 +0300

logs when using "dual" mode (similar for exclusive)
qla2xxx_dual.log

@jwx11
Copy link

jwx11 commented Oct 26, 2023

more detail logs for "enabled" and "exclusive" mode (ql2xextended_error_logging=0x5e408000)

qla2xxx_enabled_verbose2.log

qla2xxx_exclusive_verbose2.log

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@jwx11 @lnocturno @lignumqt