MAE-NAS: Evaluating Network Initialization with Entropy for Efficient NAS Search

MAE-NAS uses information theory to evaluate the initialization of a network from the perspective of entropy, without the need for any training process, thus solving the problem of the previous NAS search method requiring training before evaluation. This enables large-scale network search in a short period of time, reducing search costs while also increasing the possibility of finding potentially better network structures.