[solved] Second Modem via USB 3.0 does not work

ROUTER Topics that are general or unclassified in nature, or does not belong elsewhere
Forum rules
Please assure there is not an existing forum and topic related to your post
Post Reply
maethu
Posts: 7
Joined: Thu Aug 19, 2021 7:38 am
Has thanked: 1 time
Been thanked: 2 times

[solved] Second Modem via USB 3.0 does not work

Post by maethu »

[UPDATE] -> See my on answer at the bottom for the solution :D



Hi

Setup
So I basically have a similar setup as described here
Main difference is that I have a Sierra Wireless EM7565 CAT-12 LTE-A Pro Modem installed in the Adapter Enclosure

I have two external antennas, both are working and have signal. I tested this with my MOFI4500 SIM8.

In both modems I installed a AT&T prepaid SIM, activated with the correct IMEI.

I flashed the NEXR5GO router with the latest firmware form WiFiX: openwrt-WiFiX-NEXR5GO-18067-GO2021-03-09

What works.
If I do not attach the second modem, the router boots up and after a couple minutes I have internet and it works!
boot_only_internal_modem_works.png
I have two connection profiles, one for each modem (basically the APN for AT&T):
connection_profiles.png

Problem
If I start the router with both modems, both modem do not get properly recognised.
At least the UI has issues to display any information

Modem 1:
modem_one_with_both.png
Modem 2:
boot_both_modems_modem2_which_is_internal.png
And weirdly now modem 2 is the previous modem 1 (See modem ID)

If I unplug and plugin the USB cable, something shows up on the sys log:
log_after_plugin_modem.log
IMHO interesting part from the log

Code: Select all

Sat Aug 28 20:54:49 2021 user.notice sms process: Reread SMS Messages on Modem 1
Sat Aug 28 20:55:40 2021 kern.info kernel: [  190.112253] usb 1-1.2: new high-speed USB device number 5 using ehci-platform
Sat Aug 28 20:55:40 2021 kern.warn kernel: [  190.263092] usb 1-1.2: config 1 has an invalid interface number: 8 but max is 3
Sat Aug 28 20:55:40 2021 kern.warn kernel: [  190.270805] usb 1-1.2: config 1 has no interface number 1
Sat Aug 28 20:55:40 2021 kern.info kernel: [  190.292717] qcserial 1-1.2:1.0: Qualcomm USB modem converter detected
Sat Aug 28 20:55:40 2021 kern.info kernel: [  190.299867] usb 1-1.2: Qualcomm USB modem converter now attached to ttyUSB4
Sat Aug 28 20:55:40 2021 kern.info kernel: [  190.327671] qcserial 1-1.2:1.2: Qualcomm USB modem converter detected
Sat Aug 28 20:55:40 2021 kern.info kernel: [  190.335133] usb 1-1.2: Qualcomm USB modem converter now attached to ttyUSB5
Sat Aug 28 20:55:40 2021 kern.info kernel: [  190.362529] qcserial 1-1.2:1.3: Qualcomm USB modem converter detected
Sat Aug 28 20:55:40 2021 kern.info kernel: [  190.369861] usb 1-1.2: Qualcomm USB modem converter now attached to ttyUSB6
Sat Aug 28 20:55:40 2021 kern.info kernel: [  190.404079] qmi_wwan 1-1.2:1.8: cdc-wdm1: USB WDM device
Sat Aug 28 20:55:40 2021 kern.info kernel: [  190.410925] qmi_wwan 1-1.2:1.8 wwan1: register 'qmi_wwan' at usb-ehci-platform-1.2, WWAN/QMI device, 3a:e2:5f:b3:27:40
Sat Aug 28 20:55:41 2021 user.notice Log Print : Driver Name : 1 qcserial
Sat Aug 28 20:55:41 2021 user.notice Log Print : Driver Name : 2 qcserial
Sat Aug 28 20:55:41 2021 user.notice Log Print : Driver Name : 3 qcserial
Sat Aug 28 20:55:41 2021 user.notice Log Print : Driver Name : 4 qmi_wwan
Sat Aug 28 20:55:41 2021 user.notice usb-modeswitch: Add : 1-1.2: Manufacturer=Sierra_Wireless,_Incorporated Product=Sierra_Wireless_EM7565_Qualcomm®_Snapdragon™_X16_LTE-A Serial=UF94928902011546 1199 9091
Sat Aug 28 20:55:41 2021 user.notice usb-modeswitch: *****************************************************************
Sat Aug 28 20:55:41 2021 user.notice usb-modeswitch: *
Sat Aug 28 20:55:41 2021 user.notice usb-modeswitch: * Start of Modem Detection and Connection Information
Sat Aug 28 20:55:41 2021 user.notice usb-modeswitch: *
Sat Aug 28 20:55:41 2021 user.notice usb-modeswitch: * Product=Sierra_Wireless_EM7565_Qualcomm®_Snapdragon™_X16_LTE-A 1199 9091
Sat Aug 28 20:55:41 2021 user.notice usb-modeswitch: *
Sat Aug 28 20:55:41 2021 user.notice usb-modeswitch: *****************************************************************
Sat Aug 28 20:55:41 2021 user.notice usb-modeswitch: Found Modem at 1-1.2 in Cfg#= 1 from 1 available
Sat Aug 28 20:55:41 2021 user.notice usb-modeswitch: *****************************************************************
Sat Aug 28 20:55:41 2021 user.notice usb-modeswitch: *
Sat Aug 28 20:55:41 2021 user.notice usb-modeswitch: * Device at 1-1.2 does not have a switch data file
Sat Aug 28 20:55:41 2021 user.notice usb-modeswitch: *
Sat Aug 28 20:55:41 2021 user.notice usb-modeswitch: *****************************************************************
Sat Aug 28 20:55:51 2021 user.notice usb-modeswitch: *****************************************************************
Sat Aug 28 20:55:51 2021 user.notice usb-modeswitch: *
Sat Aug 28 20:55:51 2021 user.notice usb-modeswitch: * Modem at 1-1.2 switched to : 1199:9091
Sat Aug 28 20:55:51 2021 user.notice usb-modeswitch: *
Sat Aug 28 20:55:51 2021 user.notice usb-modeswitch: *****************************************************************
Sat Aug 28 20:55:51 2021 user.notice Log Print : Driver Name : 1 qcserial
Sat Aug 28 20:55:51 2021 user.notice Log Print : Driver Name : 2 qcserial
Sat Aug 28 20:55:51 2021 user.notice Log Print : Driver Name : 3 qcserial
Sat Aug 28 20:55:51 2021 user.notice Log Print : Driver Name : 4 qmi_wwan
Sat Aug 28 20:55:51 2021 user.notice usb-modeswitch: *****************************************************************
Sat Aug 28 20:55:51 2021 user.notice usb-modeswitch: *
Sat Aug 28 20:55:51 2021 user.notice usb-modeswitch: * ProtoFind returns : 2
Sat Aug 28 20:55:51 2021 user.notice usb-modeswitch: *
Sat Aug 28 20:55:51 2021 user.notice usb-modeswitch: *****************************************************************
Sat Aug 28 20:55:51 2021 user.notice usb-modeswitch: Found Modem 2
Sat Aug 28 20:55:52 2021 user.notice usb-modeswitch: Connecting a QMI Modem
Sat Aug 28 20:55:52 2021 user.notice Create Connection: Start QMI Connection
Sat Aug 28 20:55:57 2021 user.notice Create Connection: QMI Comm Port : /dev/ttyUSB9
Sat Aug 28 20:56:00 2021 user.notice Create Connection: WDA-GET-DATA-FORMAT is "raw-ip"
Sat Aug 28 20:56:00 2021 user.notice Band Mask :
Sat Aug 28 20:56:00 2021 user.notice Band Mask : Sierra Response : Can't open device /dev/ttyUSB9.
Sat Aug 28 20:56:00 2021 user.notice Band Mask :
Sat Aug 28 20:56:00 2021 user.notice Band Mask :
Sat Aug 28 20:56:00 2021 user.notice Band Mask : LTE Band Mask :
Sat Aug 28 20:56:00 2021 user.notice Band Mask :
Sat Aug 28 20:56:03 2021 user.notice Get Profile: Modem 2 is Can't open device /dev/ttyUS Can't open device /dev/ttyUS
Sat Aug 28 20:56:03 2021 user.notice Get Profile: Default Profile Used
Sat Aug 28 20:56:04 2021 user.notice Create Connection: Profile for Modem 2 sets interface to WAN2
Sat Aug 28 20:56:04 2021 user.notice Create Connection: Modem 2 is using WAN2
Sat Aug 28 20:56:04 2021 user.notice Create Connection: Using Provider assigned DNS
Sat Aug 28 20:56:04 2021 user.notice Create Connection: Pincode in script
Sat Aug 28 20:56:04 2021 user.notice Create Connection: Attempting to Connect Modem 2
Sat Aug 28 20:56:14 2021 user.notice sms process: SMS Supported
Sat Aug 28 20:56:15 2021 daemon.err uhttpd[1710]: luci: accepted login on / for root from 192.168.1.124
Sat Aug 28 20:56:18 2021 user.notice sms process: Reread SMS Messages on Modem 2
Sat Aug 28 20:56:20 2021 user.notice QMI Connect: WDA-GET-DATA-FORMAT is "raw-ip"
Sat Aug 28 20:56:21 2021 user.notice QMI Connect: Waiting for network registration
Sat Aug 28 20:56:22 2021 user.notice QMI Connect: Starting network broadband
Sat Aug 28 20:56:22 2021 user.notice QMI Connect: Connection returned : -1147472032
Sat Aug 28 20:56:22 2021 user.notice QMI Connect: Status is "connected"
Sat Aug 28 20:56:22 2021 user.notice QMI Connect: GET-CURRENT-SETTINGS is {"pdp-type":"ipv4-or-ipv6","ip-family":"ipv4","mtu":1358,"ipv4":{"ip":"10.103.40.84","dns1":"172.26.38.1","gateway":"10.103.40.85","subnet":"255.255.255.248"},"ipv6":{},"domain-names":{}}
Sat Aug 28 20:56:23 2021 user.notice QMI Connect: IPv6 Connection returned : -1151659344
Sat Aug 28 20:56:23 2021 user.notice QMI Connect: Handle raw-ip
Sat Aug 28 20:56:24 2021 daemon.notice netifd: Network device 'wwan1' link is up
Sat Aug 28 20:56:24 2021 daemon.notice netifd: Interface 'wan2' has link connectivity
Sat Aug 28 20:56:24 2021 daemon.notice netifd: Interface 'wan2' is enabled
Sat Aug 28 20:56:24 2021 daemon.notice netifd: Interface 'wan2' is setting up now
Sat Aug 28 20:56:25 2021 daemon.notice netifd: Interface 'wan2' is now down
Sat Aug 28 20:56:25 2021 daemon.notice netifd: Interface 'wan2' is disabled
Sat Aug 28 20:56:25 2021 daemon.notice netifd: Interface 'wan2' is enabled
Sat Aug 28 20:56:25 2021 daemon.notice netifd: Interface 'wan2' is setting up now
Sat Aug 28 20:56:25 2021 daemon.notice netifd: wan2 (8077): udhcpc: started, v1.28.4
Sat Aug 28 20:56:26 2021 daemon.notice netifd: wan2 (8077): udhcpc: sending discover
Sat Aug 28 20:56:26 2021 daemon.notice netifd: wan2 (8077): udhcpc: sending select for 10.103.40.84
Sat Aug 28 20:56:26 2021 daemon.notice netifd: wan2 (8077): udhcpc: lease of 10.103.40.84 obtained, lease time 7200
Sat Aug 28 20:56:26 2021 daemon.notice netifd: Interface 'wan2' is now up
Sat Aug 28 20:56:26 2021 daemon.info dnsmasq[3372]: reading /tmp/resolv.conf.auto
Sat Aug 28 20:56:26 2021 daemon.info dnsmasq[3372]: using local addresses only for domain test
Sat Aug 28 20:56:26 2021 daemon.info dnsmasq[3372]: using local addresses only for domain onion
Sat Aug 28 20:56:26 2021 daemon.info dnsmasq[3372]: using local addresses only for domain localhost
Sat Aug 28 20:56:26 2021 daemon.info dnsmasq[3372]: using local addresses only for domain local
Sat Aug 28 20:56:26 2021 daemon.info dnsmasq[3372]: using local addresses only for domain invalid
Sat Aug 28 20:56:26 2021 daemon.info dnsmasq[3372]: using local addresses only for domain bind
Sat Aug 28 20:56:26 2021 daemon.info dnsmasq[3372]: using local addresses only for domain lan
Sat Aug 28 20:56:26 2021 daemon.info dnsmasq[3372]: using nameserver 172.26.38.1#53
Sat Aug 28 20:56:26 2021 daemon.info dnsmasq[3372]: using nameserver fc00:a:a::300#53
Sat Aug 28 20:56:26 2021 daemon.info dnsmasq[3372]: using nameserver 172.26.38.1#53
Sat Aug 28 20:56:26 2021 user.notice URL-DEBUG: hotplug (iface): action='ifup' interface='wan2'
Sat Aug 28 20:56:27 2021 user.notice mwan3[8105]: Using firewall mask 0x3F00
Sat Aug 28 20:56:27 2021 user.notice mwan3[8105]: Max interface count is 60
Sat Aug 28 20:56:30 2021 user.notice firewall: Reloading firewall due to ifup of wan2 (wwan1)
Sat Aug 28 20:56:45 2021 user.notice Create Connection: Connected
Sat Aug 28 20:56:45 2021 user.notice Connection Monitor: Start Connection Monitor for Modem 2
Sat Aug 28 20:56:46 2021 user.notice Create Connection: Set TimeZone
Sat Aug 28 20:56:50 2021 user.notice Sierra Data: Can't open device /dev/ttyUSB9.
Sat Aug 28 20:56:56 2021 user.notice Sierra Data: Can't open device /dev/ttyUSB9.
Sat Aug 28 20:57:07 2021 user.notice Sierra Data: Can't open device /dev/ttyUSB9.
Sat Aug 28 20:57:12 2021 user.notice port change: dwn

With the two modem ids I added first one and the both modems to the "Custom modem port database". But no luck.
modem_ports.png

What can I do to troubleshoot this issue?
Thank you very much in advance!
You do not have the required permissions to view the files attached to this post.
Top
maethu
Posts: 7
Joined: Thu Aug 19, 2021 7:38 am
Has thanked: 1 time
Been thanked: 2 times

Re: Second Modem via USB 3.0 does not work

Post by maethu »

Thanks to the forum, I learned a few things:
- A reboot without doing a power cycle is not really a reboot - always unplug the modem for shutting down for some time.
- AT!RESET Is not enough sometimes - a reboot, resp. unplug/plug in is required
- EM7565 - needs different default settings
- The UI under "Modem -> Network Status -> Modem 1 | Modem 2" struggles at times.
- Sometimes the Modem via USB gets connected before the internal mode, which kinda screws things up. Another reboot usually helps


With those things considered I approached a fresh installation and was able to get it up and running.

Steps required for me to get my setup up and running:
1. I run the steps under https://github.com/danielewood/sierra-w ... asic-setup for the EM7565 Modem -> Shut down -> Wait 10s -> Reboot

This put the modem into MBIM mode instead of QMI

2. Connection profile for AT&T: Modem -> Connection profile -> APN needs to be "broadband"

3. Manually change the WAN2 interface from DHCP to MBIM protocol and select the second modem device `/dev/cdc/wdm1`

4. Shut down -> Wait 10s -> Reboot


This way I got both modems to connect and both are working


I also enabled the load balancing, resp failover. This was basically the original goal with the 2 modem setup.
Since AT&T disconnects randomly like 2-3 times a day. I wanted 2 modems up and running.

Important in this case is, that you do not have disabled the connection monitoring under Modem -> Connection profiles.
It looks to me that the connection monitoring under Network -> load balancing -> wan1 | wan2 is sufficient.

When I had both enabled the modem ended up in an endless reconnection loop.



So I'm happy to say, as of right now my setup seems to work!
Mostly thanks to all the info in this forum! Thanks really appreciate it!


DISCLAIMER:
I can't tell if all the steps are really necessary or not. But in my case it led to the right result :-)
Top
User avatar
Didneywhorl
Posts: 3646
Joined: Fri Mar 23, 2018 5:37 pm
Location: USA
Has thanked: 1370 times
Been thanked: 764 times
Contact:
Contact Didneywhorl

Re: [solved] Second Modem via USB 3.0 does not work

Post by Didneywhorl »

Good deal!

I think your main issue was that you had two modems in different protocol modes. The router cannot load both MBIM and QMI drivers for the USB bus. It has to have all modems in the same mode.


Now to add a 3rd! :)
Top
maethu
Posts: 7
Joined: Thu Aug 19, 2021 7:38 am
Has thanked: 1 time
Been thanked: 2 times

Re: [solved] Second Modem via USB 3.0 does not work

Post by maethu »

Didneywhorl wrote: Thu Sep 02, 2021 7:20 pm Good deal!

I think your main issue was that you had two modems in different protocol modes. The router cannot load both MBIM and QMI drivers for the USB bus. It has to have all modems in the same mode.


Now to add a 3rd! :)
Oh good to know that have to be all using the same protocol!! Thanks!

Well two are enough so far ;-)
Top
Post Reply

Return to “General and Unclassified”