Playing on Switch, can't use my Estus Flask even though it's set to my hotbar?

Only way I can use it is going through the menu, which is yeah not gonna work. Just makes a noise like it's an empty slot.