You picked up the Jolly Roger. It will only be removed if you place it in the right location or if you die.