undefined | Better HN

Skip to content

Top Best Ask Show New Jobs

0 pointszhobbs7y ago0 comments

Technically, in Dota you only control 1 unit. That being said, I don't know if OpenAI's algorithm had 5 independent agents controlling 1 unit each, or 1 agent controlling 5 units.

0 comments

6 comments · 3 top-level

marviel7y ago· 2 in thread

I believe it's five identical agents: https://blog.openai.com/openai-five/

But because the agents were all trained together, they kind of operate as a unit.

Coordination

OpenAI Five does not contain an explicit communication channel between the heroes’ neural networks. Teamwork is controlled by a hyperparameter we dubbed “team spirit”. Team spirit ranges from 0 to 1, putting a weight on how much each of OpenAI Five’s heroes should care about its individual reward function versus the average of the team’s reward functions. We anneal its value from 0 to 1 over training.

It would be fun to see the AI players spamming the ingame chat to communicate with each other in its own language :)

A truly superb AI would guilt the support AI into buying wards by constantly whining about it in chat. It would also ping the minimap when one of its teammates makes a mistake. Finally, at the end of the match, it would pronounce "bad team" if it lost.

(I never played dota2, that's all I know about the game ;)

mooneater7y ago· 1 in thread

OpenAI Five had a separate agent per unit, no explicit coordination.

backpropaganda7y ago

This is incorrect. They shared neural net activations which is explicit communication.

In the last model they trained they shared some part of a layer for all the agents. So it was like a one agent trained with shared knowledge of the rest.

j / k navigate · click thread line to collapse