distorted lora training

I trained a lora on a person but it's extremely distorted. increasing the shift and CFG helps but the person is still distorted the the point hey can be missing arms. Is this a sign of a setting I need to change or an issue that happened during training?