What? No, of course not!
I knew nothing about programming before I went for my apprenticeship. I didn't understood OO Programming until my final exams with 21.
Still I am working as a professional programmer today.
I know some older guys that have learned programming when they were way over 40.
The guy that was mocking you was just full of it. And was making fun of you just to make you feel bad.
Don't listen to him. Learn programming in your own time. Take as long as you need to. You are still pretty young and way before most others.