SoM Single power Supply for VIN and 3v3

When designing a power supply for the SoMs (M-SoM B-SoM), we must take into account both the processor power supply requirements, and the modem power supply requirements.

The M404 has the following power requirements:
Processor: 3.0-3.6v
Modem: 3.3-4.4v

For the B404X:
Processor: 3.0-3.6v
Modem: 3.3-4.3v

So it seems we could power these SoM’s with a single 3.4 - 3.5v power supply, eliminating the need for multiple regulators.
Assuming that all 3v3 peripherals are 3.5v tolerant, are there any downsides to this approach?

The recommended minimum voltage for the cellular modem (VCC) is 3.6V, which is higher than the maximum voltage of 3V3, which is why two power supply rails are required.