ECM and X86 - Multiple Routers, Load Balanced Proxmox
Posted: Thu Oct 24, 2024 12:36 pm
Not posted for a while as my internet appeared to be OK, but we know OK its "As good as it can be!"
Having happened across a few HP T620's within a bigbox store (got them for $10 each including the power supply and RAM), I started to wonder if my setup of 1x RBM33g as master, 1x RBM33g as a slave 1x RBM11g as a slave was working for me. I've always had randomness in regards to disconnection even after upgrading to RM520n-gl's for everything and just accepted this as part of running a 5g modem.
With the HP620 it gave me USB3.0, which I've found out the RBM's run their MPCIE slots on USB2.0.
Having tried this a few different ways I've settled on the following setup:
- Proxmox as a base OS
- Modem's in ECM running their own control panel (https://github.com/natecarlson/quectel- ... tion-notes)
- An OpenWRT LXC with the modems running in ECM mode and passed through
- Openwrt running Mwan3
What I've been hugely surprised at is the huge amount of overhead I appear to have gotten rid of, previously I'd be floundering at about 120mbps up and 25-35mbps down for the connections. They are now flying at 220mbps+ down and 60mbps+ up.
Mwan3 is working way better than it ever did with R00ter and I'm not missing the ups and downs of QMI/MBIM.
Along the way its been a challenge with needing to write some custom scripts to get the modems to re-attach if they disconnect and then figuring out the reason they disconnect is because of power (usb3.0 is max 900ma), "Powered" USB hubs don't give more power than this and therefore getting a powered hub with 2.4amp powered ports and using y splitters has been my goto.
Has anyone done anything similar? or got any other solution I should look at?
Running Proxmox and having the ECM's working properly is a really nice thing, it allows me to 1 not have a router sitting there needing 0.2% of a CPU and 256mb ram and doing nothing else.
When I started I thought I was going to have a way more complicated setup, but this looks like its actually going to be much nicer looking and I now my aim is to start working on "Power Cut" mode to make sure I can power down everything apart from the essentials so my battery backup is able to last.
Having happened across a few HP T620's within a bigbox store (got them for $10 each including the power supply and RAM), I started to wonder if my setup of 1x RBM33g as master, 1x RBM33g as a slave 1x RBM11g as a slave was working for me. I've always had randomness in regards to disconnection even after upgrading to RM520n-gl's for everything and just accepted this as part of running a 5g modem.
With the HP620 it gave me USB3.0, which I've found out the RBM's run their MPCIE slots on USB2.0.
Having tried this a few different ways I've settled on the following setup:
- Proxmox as a base OS
- Modem's in ECM running their own control panel (https://github.com/natecarlson/quectel- ... tion-notes)
- An OpenWRT LXC with the modems running in ECM mode and passed through
- Openwrt running Mwan3
What I've been hugely surprised at is the huge amount of overhead I appear to have gotten rid of, previously I'd be floundering at about 120mbps up and 25-35mbps down for the connections. They are now flying at 220mbps+ down and 60mbps+ up.
Mwan3 is working way better than it ever did with R00ter and I'm not missing the ups and downs of QMI/MBIM.
Along the way its been a challenge with needing to write some custom scripts to get the modems to re-attach if they disconnect and then figuring out the reason they disconnect is because of power (usb3.0 is max 900ma), "Powered" USB hubs don't give more power than this and therefore getting a powered hub with 2.4amp powered ports and using y splitters has been my goto.
Has anyone done anything similar? or got any other solution I should look at?
Running Proxmox and having the ECM's working properly is a really nice thing, it allows me to 1 not have a router sitting there needing 0.2% of a CPU and 256mb ram and doing nothing else.
When I started I thought I was going to have a way more complicated setup, but this looks like its actually going to be much nicer looking and I now my aim is to start working on "Power Cut" mode to make sure I can power down everything apart from the essentials so my battery backup is able to last.