🎉 Celebrating 25 Years of GameDev.net! 🎉

Not many can claim 25 years on the Internet! Join us in celebrating this milestone. Learn more about our history, and thank you for being a part of our community!

Learning deep learning

Started by
4 comments, last by duckiiarigato 4 years, 5 months ago

I am looking for a good tutorial or a book about deep learning. I understand that Tensorflow is all the rage these days, so I would like to learn using this framework.

I am an experienced programmer with a good knowledge of python (and all other major programming languages).

I have only read topical material about neural networks nothing really technical though. I do know the high level meanings of all the  basic terminology: Cost, Convolutional vs fully connected, adversarial, etc... Now I want to start implementing...

I really like to learn through GameDev projects, so I thought that a good excersize might be to create a turn based game AI for some minmax based game.

Checkers / Tic tac toe / Chess / . (I've programmed the "traditional" minmax versions of all of these in the past).

The output of my learning does not need to be professional, I do not expect to beat alpha-go or anything like that  ;-). I just thought of creating a nice Deep Learning based cost function.

 

I am looking for recommendations for a good course, or a good book on the subject. (I don't learn well with videos [ coursera, pluralsight, etc...])

I have ~ 1 week starting tomorrow, so I don't want to delve too deep into the linear algebra. I mostly want to get the project done.

I am well aware that a subject like deep learning is better studied over a longer period of time. However, atm, I have 1 week so I will take care to delve deeper later when I have more time.

 

Can anyone recommend a good tutorial?

 

 

 

 

My Oculus Rift Game: RaiderV

My Android VR games: Time-Rider& Dozer Driver

My browser game: Vitrage - A game of stained glass

My android games : Enemies of the Crown & Killer Bees

Advertisement

Not expert on Tensorflow, and I heard it is quite complicated to learn, and that's why they are making the 2.0 version which seems to be in RC right now.

Many start learning neural network by training a simple XOR function. I think the XOR function teaches some fundamental principles of machine learning, the "gotchas", and basic training methods. You can definitely build a simple NN code yourself with backpropagation.

For minmax games, you are applying the same concept but the input to your neural network is your board configuration and the output is how much it "likes" it, typically within the range of [0, 1.0] based on your activation function.  Then you apply the same principle in minmax trees and pick the path it favors the most based on the tree's depth.

The training for minmax games however is different than backpropagation. All machine learning requires a learning path, to know where to go. It is easy to train XOR function using backpropagation because 1 XOR 1 = 0, and we can tune the network to get as close to 0 as possible. Minmax games, not as easy, because what's the best move? Who gets to decide it is the best move?

If you have a robust preexisting AI as a benchmark that you can use to train your NN with, feel free to use it. Otherwise, you can also train with evolution. I have trained a minmax game using evolution against a random CPU (a CPU that just picks a random move), and whichever NN with the most points scored over N number of games get to "breed" with random mutation. It yields some decent results, enough to beat me.

Thanks for the advice. I am looking for a recommendation for a text based tutorial / book (not vieos) on the subject which will contain some "lab excersizes".

My Oculus Rift Game: RaiderV

My Android VR games: Time-Rider& Dozer Driver

My browser game: Vitrage - A game of stained glass

My android games : Enemies of the Crown & Killer Bees

Google offers a crash-course.
It uses videos and text (mainly video lectures) but with 20hours it should fit nicely with your 1 week time span.

This topic is closed to new replies.

Advertisement