Why is gyno surgery recovery so much more intensive than other surgeries?

6 weeks recovery seems insane to do things like exercise, I know people that have had back surgery and are back in the gym after 3 weeks.

For just grade 1 gland removal surely it wouldn't take that long to recover, right?