Jola's Curse is slowly turning you to stone.
You will be completely petrified at the 30th stack and slowly lose your Health.
This effect can be canceled using an Orb of Temptations.