@krixen1 ,
You might find this thread interesting:
A few of us have been working on this solution for a while and you might be able to benefit from some of what we have learned. In particular, we both started with the LoRA Feathering in the beginning of the project and we did find that it can work.
Thanks,
Chip