That's good! Personally I have made the decision at some point in my life to try to do this. I've had to make many sacrifices to make it work.
Is it enjoyable? Loaded question. LOL. It's incredibly enjoyable. But it's also a pain in the ass. There is good and bad in everything.
It's great but.. Quite simply don't expect to get paid for putting in long hours of work slaving over something that is most likely going to be overlooked and underappreciated. People look at the indie game scene and musicianship and probably don't respect the process much. I am sure few indie musicians are as impoverished as me but... here I am. I continue writing and it's great. Granted, I am extremely frustrated with nearly every avenue I've pursued in the indie dev scene, financially speaking, and it's been very very frustrating trying to make something of it and/or trying to make that change.
But I still do it. It's a source of amazing joy. It's remarkable in the strength of its breadth and simplicity of enjoyment that occurs when one joins a creative force beyond what that one person can achieve by themselves. Seeing a project come together is pretty orgasmic.
I spend long hours doing something that makes me feel valid as a human.. it's not something I can give up so easily because of the sense of joy and fulfillment it brings. It's hard but those long tedious hours that are spent developing for indie projects are some of the most rewarding moments I have yet experienced creatively. But it can be painful. Sometimes you won't have money. And while it brings happiness to contribute definitely don't tell that to people who are contracting you if you want to get paid. It's very easy to get taken advantage of. I have a life I want to live and lead much like you seem to be doing but always have a back up plan.
I'm not sour about my choice to do something I love but I have to work knowing that nothing is going to happen with it. Do it for the enjoyment that it brings and it will be about as rewarding as you could possible imagine.