摘要:        
目录Typical LossMSEDerivativeMSE GradientSoftmaxDerivative Typical Loss Mean Squared Error Cross Entropy Loss binary multi-class +softmax MSE loss="    阅读全文
posted @ 2020-12-11 23:02
ABDM
阅读(374)
评论(0)
推荐(0)
        
            
        
        
摘要:        
目录Activation FunctionsDerivativeSigmoid/LogisticDerivativetf.sigmoidTanhDerivativetf.tanhRectified Linear UnitDerivativetf.nn.relu Activation Function    阅读全文
posted @ 2020-12-11 23:00
ABDM
阅读(191)
评论(0)
推荐(0)
        
            
        
        
摘要:        
目录OutlineWhat's GradientWhat does it mean?How to searchFor instanceAutoGrad2nd" role="presentation">2nd2nd-order Outline What's Gradient What does it     阅读全文
posted @ 2020-12-11 22:58
ABDM
阅读(135)
评论(0)
推荐(0)
        
            
        
        
摘要:        
目录OutlineMSEEntropyCross EntropyBinary ClassificationSingle outputClassificationWhy not MSE?logits-->CrossEntropy Outline MSE Cross Entropy Loss Hinge    阅读全文
posted @ 2020-12-11 22:56
ABDM
阅读(246)
评论(0)
推荐(0)
        
            
        
        
摘要:        
目录 Outline y∈Rdy∈Rd yi∈[0,1]yi∈[0,1] yi∈[0,1],,∑ydi=0yi=1yi∈[0,1],,∑i=0ydyi=1 yi∈[−1,1]yi∈[−1,1] Outline y∈Rdy∈Rd 多分类一般为概率 yi∈[0,1],i=0,1,⋯,yd−1yi∈[0,    阅读全文
posted @ 2020-12-11 22:55
ABDM
阅读(182)
评论(0)
推荐(0)
        
            
        
        
摘要:        
目录OutlineRecapNeural NetworkHere comes Deep LearningHerosFully connected layerMulti-Layers Outline Matmul Neural Network Deep Learning Multi-Layer Rec    阅读全文
posted @ 2020-12-11 22:53
ABDM
阅读(508)
评论(0)
推荐(0)
        
            
        
        
摘要:        
目录 import tensorflow as tf from tensorflow import keras from tensorflow.keras import datasets import os # do not print irrelevant information # os.env    阅读全文
posted @ 2020-12-11 22:52
ABDM
阅读(91)
评论(0)
推荐(0)
        
            
        
        
摘要:        
目录 Outline keras.datasets MNIST CIFAR10/100 tf.data.Dataset .shuffle .map .batch .repeat() For example Outline keras.datasets tf.data.Dataset.from_ten    阅读全文
posted @ 2020-12-11 22:51
ABDM
阅读(347)
评论(0)
推荐(0)
        
            
        
        
摘要:        
目录 Outline Where where(tensor) where(cond,A,B) scatter_nd 一维 二维 meshgrid Points numpy实现 tensorflow2实现 Outline where scatter_nd meshgrid Where where(te    阅读全文
posted @ 2020-12-11 22:49
ABDM
阅读(92)
评论(0)
推荐(0)
        
            
        
        
摘要:        
目录 Outline clip_by_value relu clip_by_norm gradient clipping Outline clip_by_value relu clip_by_norm gradient clipping clip_by_value import tensorflow    阅读全文
posted @ 2020-12-11 22:47
ABDM
阅读(130)
评论(0)
推荐(0)
        

 
         浙公网安备 33010602011771号
浙公网安备 33010602011771号