Definitely. I don't feel a need to justify it to others, but to myself. I think it's the inability to reverse the decision combined with the profound consequences; even if you think your life is worthless or full of suffering, it is the basis of everything, it's all you have. It's a lot to let go of and that's frightening. This is especially true if there is something, even if it's minuscule, that you like about yourself or being alive.
This could also come from the belief that's commonly embedded in people's heads about life having a lot of meaning and therefore something you should not consider abandoning lightly.