Part I: Fundamentals and Backgrounds -- Evolutionary Computation -- Deep Neural Networks -- Part II: Evolutionary Deep Neural Architecture Search for Unsupervised DNNs -- Architecture Design for Stacked AEs and DBNs -- Architecture Design for Convolutional Auto-Encoders -- Architecture Design for Variational Auto-Encoders -- Part III: Evolutionary Deep Neural Architecture Search for Supervised DNNs -- Architecture Design for Plain CNNs -- Architecture Design for RBs and DBs Based CNNs -- Architecture Design for Skip-Connection Based CNNs -- Hybrid GA and PSO for Architecture Design -- Internet Protocol Based Architecture Design -- Differential Evolution for Architecture Design -- Architecture Design for Analyzing Hyperspectral Images -- Part IV: Recent Advances in Evolutionary Deep Neural Architecture Search -- Encoding Space Based on Directed Acyclic Graphs -- End-to-End Performance Predictors -- Deep Neural Architecture Pruning -- Deep Neural Architecture Compression -- Distribution Training Framework for Architecture Design.