@sazp96, the very smart @BDub pointed out the following:
If the regulator requires low ESR, then typically you don’t want to use electrolytics… but you can get low ESR electrolytics if you need a lot of capacitance
After a little research, it turns out that there is a MAXIMUM capacitor size for USB 2.0 of 10uF. So you may want to reconsider by using a 4.7uF cap. And don’t forget to be generous with the 0.1uF caps.