Yes, it is definitely terrifying to the average person, especially if you're scared of heights(I am). If you jump from high enough up, you should die. But a few of the common fears are:
1. Fear of standing on the edge, looking down at the ground, seeing your potential death.
2. Fear of regret, after you jump.
3. Fear of falling all the way down, especially head-first.
I know I'd be terrified to no end to jump, especially if it failed somehow. But if you jump head first from high enough up, it should work. It all depends on your mindset, the method that would be best for you.