Teeworlds Forum — Neural network genetic algorithm ddrace bot (by Paszczak)

Re: Neural network genetic algorithm ddrace bot (by Paszczak)

null@example.com (rand()) — Tue, 02 Feb 2016 10:10:18 +0000

Analytical solution may be not computable.
NN approximates a solution, expecting a global solution. Moreover, it would be fun, given a working NN for a map, to test it on another map (close enough)

Re: Neural network genetic algorithm ddrace bot (by Paszczak)

null@example.com (TeecTac) — Tue, 02 Feb 2016 07:31:02 +0000

« only a theoretical guaranteed solution » is good enough and it is computationally effective.

NN are guaranteed to give a solution for a sufficient number of training steps.
That means it could take a very long time before finding a solution to complex maps.

On the other hand, its implementation is certainly simpler !

Re: Neural network genetic algorithm ddrace bot (by Paszczak)

null@example.com (xush) — Tue, 02 Feb 2016 06:40:23 +0000

The analytical solution will only give you a theoretical guaranteed solution.
The genetic algorithm only takes that long because he is doing one simulation at a time right now, usually you would do a whole population (100 in this case) simultaneously.

Re: Neural network genetic algorithm ddrace bot (by Paszczak)

null@example.com (heinrich5991) — Tue, 02 Feb 2016 00:24:50 +0000

xush wrote:

But then there is no guaranteed solution.

As far as I understand the concepts, an analytical solution will always give you a result, and "neural networks" can take a very long time ("have no guaranteed solution").

Re: Neural network genetic algorithm ddrace bot (by Paszczak)

null@example.com (xush) — Mon, 01 Feb 2016 19:15:19 +0000

But then there is no guaranteed solution.

Re: Neural network genetic algorithm ddrace bot (by Paszczak)

null@example.com (TeecTac) — Mon, 01 Feb 2016 18:49:53 +0000

Neural networks seems like overkill to me.

Given that teeworlds physics is deterministic, there should be an analytical solution using pathfinding and newtonian physics.

Re: Neural network genetic algorithm ddrace bot (by Paszczak)

null@example.com (Henningstone) — Mon, 01 Feb 2016 17:02:42 +0000

Netherland wrote:

Very interesting, there should be some videos showing the bot in action, tried to watch the stream yesterday but nothing happened.

"Nothing happened" because he streams from his home computer, and of course it isn't running 24/7.

@Paszczak: Well, maybe record some video for youtube once with low-gen and once with high-gen?

Re: Neural network genetic algorithm ddrace bot (by Paszczak)

null@example.com (Netherland) — Mon, 01 Feb 2016 11:54:09 +0000

Very interesting, there should be some videos showing the bot in action, tried to watch the stream yesterday but nothing happened.

A.I. is cool (until it starts to develop itself).

Re: Neural network genetic algorithm ddrace bot (by Paszczak)

null@example.com (Paszczak) — Sat, 30 Jan 2016 10:02:41 +0000

@unsigned char*
of course it can, but for now I wanted to give him something easy to see how long is it going to take

Re: Neural network genetic algorithm ddrace bot (by Paszczak)

null@example.com (xush) — Sat, 30 Jan 2016 09:10:21 +0000

Hype! He is like a son for me.

Re: Neural network genetic algorithm ddrace bot (by Paszczak)

null@example.com (unsigned char*) — Sat, 30 Jan 2016 00:28:15 +0000

of course is very interesting!

P.S: I just start see this youtube channel for see an introduction to I.A. :B

Re: Neural network genetic algorithm ddrace bot (by Paszczak)

null@example.com (heinrich5991) — Sat, 30 Jan 2016 00:16:18 +0000

Looks awesome.

Re: Neural network genetic algorithm ddrace bot (by Paszczak)

null@example.com (unsigned char*) — Fri, 29 Jan 2016 23:43:54 +0000

Ufff... if works like "http://rednuht.org/genetic_cars_2/" you will need ~10 years for finish a map xDD

This "learning" can be used in other maps?

P.S: Improve it increasing population..... O_o

Neural network genetic algorithm ddrace bot (by Paszczak)

null@example.com (Henningstone) — Fri, 29 Jan 2016 20:20:01 +0000

Hey there!

I want to present you a DDRace bot, which learns to play a race map by itself, using a neural network genetic algorithm!
Important: It is entirely done by Paszczak, I only write this post for him because he asked me to. I did nothing to the bot itself.

This is still work-in-progress, but developing quite fast into a very appreciable project. He implemented a genetic algorithm into the teeworlds client, enabling it to learn how to play race on it's own.

For now, only the distance from the starting point is used to calculate the fitness, so it can only finish maps which go straight in one direction, not like Aip-Gores. If the distance from the spawn didn't increase for a defined amount of time, it will reset (kill) and go over to the next simulation. 100 simulations make one generation. After 4-5 generations, you can see a significant improvement.

The bot learns in real-time right while playing a map, so it takes quite long to gather some skill. But waiting is worth I can tell you ^-^

If you are interested in seeing the bot doing it's job, there is a twitch livestream online from time to time where you can watch it. You can also chat with the author of it using the twitch chat

WATCH IT HERE! http://www.twitch.tv/twneuronnetwork

If you are curious how it works, this video might we very interesting for you: https://www.youtube.com/watch?v=qv6UVOQ0F44. It is something similar to this bot for Super Mario.

I will keep you up-to-date about any further development, this is definitely a very interesting idea.

SOURCE CODE: https://github.com/paaszczak/teeworlds-neural-network