This is simple, everyone has their opinions including me. It is up to you to weed out the biased and anti-fact ones. My example to you, many years ago and before college. I met my wife's (ex now) uncle. He was a farmer who had no true knowledge of the technology industry. He asked what I did for a living and I said "I do insulation for homes, but I am going to college." He then says to me "Oh, what are you going to school for?" where I replied "Software Engineering"... The next response will go to show you some people don't know what they are talking about. He replies to me and says "Ah, you'd make more money doing insulation."
Was that his opinion? Absolutely!
Was he right? Not in the slightest.
Good thing I didn't listen to him, cause not only did I follow my passion but I am making more then if I just settled for some insulation job somewhere and never strived to achieve more out of my existence and hated life wondering what if... Also learning how to program games isn't so niche to say you couldn't morph into a Software / Web application developer position down the road. Maybe you discover that road along the way.
I'll say this in closing, I didn't go into this field for the money. If that is the case there are far more professions out there that pay more but you may not be happy doing that for the rest of your life either. So in turn if doing insulation will make you happy the rest of your life do it, if programming does then do it!