Wireless controller connections

So the oddest thing has started happening to me and it's made playing video games almost a chore. The wireless connection for my controllers has started to go haywire. I'll be playing a game (any game) and I'll get a notice to reconnect my controller, so I have to take the batteries out and put them back in for the controller to reconnect. But here's where it gets weird.

  1. On my Xbox One this will happen about every 10-15 minutes, then stop for an hour or two and repeat.

  2. It happens on all three of my Xbox One controllers AND my guitar hero controller on my Xbox 360

  3. I've used all sorts of batteries from rechargeable to various store brands

  4. It has never happened to my wife, and she plays about as often as I do.

It bothers me a lot, especially when playing an online only game like FO76 but was never immediately concerning until now when it just started happening on my 360 as well.

Any ideas as to what could be causing this? It's actually starting to creep me out and makes me want to stop gaming for a while.