Need 5v (battery) for servo

(2) Lithium Ion batteries can easily be 8.4V @ full charge.

Is Solar an option for you? Even a tiny 0.5 watt panel may be viable with such a low duty cycle.

Have you tried your servo with 4.2V ? I'm guessing it may still function but at a reduced max torque.