1 Hierachical Tasks Network
Hierarchical Task Networks: Starting from Task Goals
Core idea: set a plan, several completed sub-tasks.
1 HTN frame
2 HTN Task Type
1 Primitive Task atomic task
2 Composite tasks
It is very convenient to build a behavior tree of your own thinking.
3 HTN Domain
HTN: Can communicate with ordinary people, behavior tree is more troublesome than pride
4 Planning
Atomic tasks
Replan is very important.
5 summary
The Bad: Unpredictable, missions may fail.
There is competition for designers.
If the planner is too careful, there will be problems.
2 Goal oritented Action Planning
Planning:
Goal-Oriented Behavioral Planning
1 structure:
Goal: It is not displayed in htn
, but it is clearly written in GOAP.
It's a matter of planning, not planning.
2 Goal set
3 Goal selection
4 Action set
Added additional cost.
All dynamic programming problems must consider cost.
Go backwards to plan my goal state. Much like the way humans think about flashbacks.
5 planning
Plan a path, and finally clear the unstatisfied states stack.
Dynamic programming is an np problem.
According to my goal, expand into a huge graph and find a shortest path. Use the A* algorithm
6 Summary
For the first time separate goals and actions. The behavior of the AI is wonderful.
Disadvantages: the amount of calculation is large; the state expression of the game is expressed quantitatively.
3 Monte Carlo Tree Search (MCTS)
1 Monte Carlo method
2 MCTS
Abstract as a mathematical model:
3 simulations
Reverse derivation:
Iterate:
4 Selection
Develop, explore.
UCB
C----Small, just be conservative.
LCB
C的设置就是调了。
5 总结
对于复杂游戏很难定义赢还是输，不一定可以适合所有的游戏。
输出是非常明确的，MTCS是很符合的，否则不能只用MCTS。
4 deeplearning
1 Mechine learning Basic
1 监督学习
核心基础是分类器。这个需要大量的数据，
2 无监督学习
3 半监督学习
半监督学习。
4 强化学习
没有监督者，没有人告诉你是对的，还是错的，做对了有奖励，做错了有惩罚。
1 马尔可夫
Policy：黑箱，
2 machine learning in game AI
游戏的状态
时间状态的描述；
3 训练策略
用监督学习训练相对可以的网络，选择什么样的数据集去训练呢
选择比较优秀的玩家的数据。
然后强化学习：
最怕做到局部最优解，而不是全局最优解。
5 问题
目前在cpu上。
6 视频
上：
https://www.bilibili.com/video/BV1iG4y1i78Q/?spm_id_from=333.788
下：
https://www.bilibili.com/video/BV1ja411U7zK/?spm_id_from=333.788&vd_source=5c9c50b5a07b211beafdf65d7cc7f8c8