Hunger and Despair [KCD2]

Please please please tell me y'all are struggling with knocking the ladders off. I've been trying since Sunday to complete it and I just can't. It seems impossible. Samuel and Hans die so easily. The captain just stands there switching his weapons around. And I get overran so easily. Sometimes I can't even knock one off without getting blasted just standing there.

I'm so frustrated. I don't understand what to do. I don't wanna give up, but 4 days and countless times of trying has me at my wits end. I just wanna know if I'm alone in this.