[Joseph Jostar]

It's meant to be a representation of the character holding back, according to its description. Lowering their stats is just a mechanical expression of that but it almost certainly isn't meant to make you actually weaker.