Technically, no, you don't have to be very good at drawing to be a good 3D artist, as the process is more akin to sculpting.
However, the ability to look at the third dimensional world around you and translate that to create a believable image on a two dimensional surface (i.e. draw good) can really help out while doing 3D, from creating concept art for yourself and others, to learning about shape language, to hand painting textures, and more. Might be worth trying out on occasion, while working on 3D as your main skill set.
I started out in kindergarten, coloring outside the lines with wax crayons. I doodled in all of my notebooks throughout my school years, and received a lot of positive feedback, so I stuck with it.
I saw some real improvement when I started copying some of my favorite comic covers, found on an image repository, back when the internet was young.
Then saw another jump in skill when I started drawing things around me, and studied perspective.
There are tons of resources out there these days - from video tutorials on YouTube, Gnomon or Gumroad, to online articles, to forums with members willing to give critique, even books at the local library if you want to go old school.
It's true that you have a lot of catching up to do if you want to master the skills, but people much older than you have done exactly that, it's all about dedication.