Split Attention: A Detailed Breakdown of its Implementation

The initial step involves dividing the input feature map into R cardinal groups. Subsequently, a split attention operation is applied to these groups. After the split attention operation, the features from each group are concatenated, resulting in a feature map that retains the same dimensions as the original input. Finally, this newly formed feature map is fused with the input through a neck bottle.