Distributed Policy Optimization: Fusion Operation and Non-smooth Term Restriction

In (4a), player i performs the fusion operation of local information, i.e., employs xi and zi to generate intermediate policy variables, even though the generated variables may violate the non-smooth term restriction. In this joint, no communication behavior is involved.