I wouldn’t worry about it in the near term. The longterm concern would be security updates for drivers, but if you’re waiting for them to find an OEM and design a phone, you will be waiting for years best case.
Also, how many in the wild exploits specifically attack hardware drivers on specific models? Seems like a bad effort per user tradeoff unless you’re a state actor doing a targeted attack, in which case they’ll just get in through your cell modem directly off the cell network anyway. If you use cell networks, every state actor willing to pay a million bucks to the Israelis can get in until your next reboot no matter what you’re using.
As someone who used to work in the spying on people on the internet game years ago, I gotta respect how clever this is. Evil, but very clever.