That's a pity. A job, even if it's not a particularly inspiring job, gives you some stability and some contact with people. (And some money, of course.) Will they have you back? If not, can you get another job?
My feeling is that if you can get a job, and keep at it for a couple of months, you will find yourself in a very different situation than you are in now. It won't solve all your problems, but it would probably help a lot.
My advice would be to try again with a job. This time around, be a lot tougher on yourself, and don't allow yourself to give up. You will find it hard at first - it's always the first steps that are the hardest - but stick with it and it will probably get easier after a while.
I think you can probably dig yourself out of this mess if you go about it the right way. It won't be easy, especially at first, but I think you can do it.
If you do get a job, perhaps you can try asking yourself what, exactly, you are anxious about in the job? When you analyse these things logically, it often turns out that a lot of our fears are groundless, or at least that they are exaggerated and that reality is a lot less scary than we thought. I still have social anxiety, but less than I used to have. It has reduced over the years, as I have had to interact with lots of people, got used to doing it, and realised that there is very little to be anxious about.
Good luck.
