AI Tutorial - of Curriculum 3.8 - Distributed and Parallel Computing 3. federal study

Federal study

Federal study is 15 years proposed by the

1. The user has absolute control devices and their rights data.
2. Node is often cell phones, smart home, these nodes instability.
3. Communication cost is very large
4. Data is not independent frequency distribution
5. Node load imbalance

Federal Learning Difficulties:

2.3 The most important thing is to reduce the number of communications

Research direction 1: reducing the number of communications
even large computation, it is worth reducing the number of communications.
Calculations do, do less communication

Do the calculation and the case of using the free of charge

Worker

Server

Federated Averaging Algorithm with a smaller number of communications to achieve convergence