Academia.eduAcademia.edu

Fig. 2. Layer-wise unsupervised pre-training of hidden layers weights for the DNN depicted in Figure 1. At each step, a hidden layer is trained using the output of its predecessor hidden layer by tuning a pair of encoder and decoder functions, (f;,9;). At each step, the norm of reconstruction error, \|fi(v?-+) — gi(fi(v?—1))||2 is minimized for i = 1, 2,3.

Figure 2 Layer-wise unsupervised pre-training of hidden layers weights for the DNN depicted in Figure 1. At each step, a hidden layer is trained using the output of its predecessor hidden layer by tuning a pair of encoder and decoder functions, (f;,9;). At each step, the norm of reconstruction error, \|fi(v?-+) — gi(fi(v?—1))||2 is minimized for i = 1, 2,3.