Using TensorFlow backend. 2019-12-03 02:48:16.828140: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_100.dll x_train shape: (50000, 32, 32, 3) 50000 train samples 10000 test samples y_train shape: (50000, 1) 2019-12-03 02:48:20.012038: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library nvcuda.dll 2019-12-03 02:48:20.048767: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties: name: GeForce GTX 1060 major: 6 minor: 1 memoryClockRate(GHz): 1.6705 pciBusID: 0000:01:00.0 2019-12-03 02:48:20.064507: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check. 2019-12-03 02:48:20.071545: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0 2019-12-03 02:48:20.075858: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX AVX2 2019-12-03 02:48:20.094165: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties: name: GeForce GTX 1060 major: 6 minor: 1 memoryClockRate(GHz): 1.6705 pciBusID: 0000:01:00.0 2019-12-03 02:48:20.109976: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check. 2019-12-03 02:48:20.122111: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0 2019-12-03 02:48:20.822492: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1159] Device interconnect StreamExecutor with strength 1 edge matrix: 2019-12-03 02:48:20.832855: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1165] 0 2019-12-03 02:48:20.839035: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1178] 0: N 2019-12-03 02:48:20.844426: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1304] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2103 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1060, pci bus id: 0000:01:00.0, compute capability: 6.1) Learning rate: 0.001 Model: "model_1" __________________________________________________________________________________________________ Layer (type) Output Shape Param # Connected to ================================================================================================== input_1 (InputLayer) (None, 32, 32, 3) 0 __________________________________________________________________________________________________ conv2d_1 (Conv2D) (None, 32, 32, 16) 448 input_1[0][0] __________________________________________________________________________________________________ batch_normalization_1 (BatchNor (None, 32, 32, 16) 64 conv2d_1[0][0] __________________________________________________________________________________________________ activation_1 (Activation) (None, 32, 32, 16) 0 batch_normalization_1[0][0] __________________________________________________________________________________________________ conv2d_2 (Conv2D) (None, 32, 32, 16) 2320 activation_1[0][0] __________________________________________________________________________________________________ batch_normalization_2 (BatchNor (None, 32, 32, 16) 64 conv2d_2[0][0] __________________________________________________________________________________________________ activation_2 (Activation) (None, 32, 32, 16) 0 batch_normalization_2[0][0] __________________________________________________________________________________________________ conv2d_3 (Conv2D) (None, 32, 32, 16) 2320 activation_2[0][0] __________________________________________________________________________________________________ batch_normalization_3 (BatchNor (None, 32, 32, 16) 64 conv2d_3[0][0] __________________________________________________________________________________________________ add_1 (Add) (None, 32, 32, 16) 0 activation_1[0][0] batch_normalization_3[0][0] __________________________________________________________________________________________________ activation_3 (Activation) (None, 32, 32, 16) 0 add_1[0][0] __________________________________________________________________________________________________ conv2d_4 (Conv2D) (None, 32, 32, 16) 2320 activation_3[0][0] __________________________________________________________________________________________________ batch_normalization_4 (BatchNor (None, 32, 32, 16) 64 conv2d_4[0][0] __________________________________________________________________________________________________ activation_4 (Activation) (None, 32, 32, 16) 0 batch_normalization_4[0][0] __________________________________________________________________________________________________ conv2d_5 (Conv2D) (None, 32, 32, 16) 2320 activation_4[0][0] __________________________________________________________________________________________________ batch_normalization_5 (BatchNor (None, 32, 32, 16) 64 conv2d_5[0][0] __________________________________________________________________________________________________ add_2 (Add) (None, 32, 32, 16) 0 activation_3[0][0] batch_normalization_5[0][0] __________________________________________________________________________________________________ activation_5 (Activation) (None, 32, 32, 16) 0 add_2[0][0] __________________________________________________________________________________________________ conv2d_6 (Conv2D) (None, 32, 32, 16) 2320 activation_5[0][0] __________________________________________________________________________________________________ batch_normalization_6 (BatchNor (None, 32, 32, 16) 64 conv2d_6[0][0] __________________________________________________________________________________________________ activation_6 (Activation) (None, 32, 32, 16) 0 batch_normalization_6[0][0] __________________________________________________________________________________________________ conv2d_7 (Conv2D) (None, 32, 32, 16) 2320 activation_6[0][0] __________________________________________________________________________________________________ batch_normalization_7 (BatchNor (None, 32, 32, 16) 64 conv2d_7[0][0] __________________________________________________________________________________________________ add_3 (Add) (None, 32, 32, 16) 0 activation_5[0][0] batch_normalization_7[0][0] __________________________________________________________________________________________________ activation_7 (Activation) (None, 32, 32, 16) 0 add_3[0][0] __________________________________________________________________________________________________ conv2d_8 (Conv2D) (None, 16, 16, 32) 4640 activation_7[0][0] __________________________________________________________________________________________________ batch_normalization_8 (BatchNor (None, 16, 16, 32) 128 conv2d_8[0][0] __________________________________________________________________________________________________ activation_8 (Activation) (None, 16, 16, 32) 0 batch_normalization_8[0][0] __________________________________________________________________________________________________ conv2d_9 (Conv2D) (None, 16, 16, 32) 9248 activation_8[0][0] __________________________________________________________________________________________________ conv2d_10 (Conv2D) (None, 16, 16, 32) 544 activation_7[0][0] __________________________________________________________________________________________________ batch_normalization_9 (BatchNor (None, 16, 16, 32) 128 conv2d_9[0][0] __________________________________________________________________________________________________ add_4 (Add) (None, 16, 16, 32) 0 conv2d_10[0][0] batch_normalization_9[0][0] __________________________________________________________________________________________________ activation_9 (Activation) (None, 16, 16, 32) 0 add_4[0][0] __________________________________________________________________________________________________ conv2d_11 (Conv2D) (None, 16, 16, 32) 9248 activation_9[0][0] __________________________________________________________________________________________________ batch_normalization_10 (BatchNo (None, 16, 16, 32) 128 conv2d_11[0][0] __________________________________________________________________________________________________ activation_10 (Activation) (None, 16, 16, 32) 0 batch_normalization_10[0][0] __________________________________________________________________________________________________ conv2d_12 (Conv2D) (None, 16, 16, 32) 9248 activation_10[0][0] __________________________________________________________________________________________________ batch_normalization_11 (BatchNo (None, 16, 16, 32) 128 conv2d_12[0][0] __________________________________________________________________________________________________ add_5 (Add) (None, 16, 16, 32) 0 activation_9[0][0] batch_normalization_11[0][0] __________________________________________________________________________________________________ activation_11 (Activation) (None, 16, 16, 32) 0 add_5[0][0] __________________________________________________________________________________________________ conv2d_13 (Conv2D) (None, 16, 16, 32) 9248 activation_11[0][0] __________________________________________________________________________________________________ batch_normalization_12 (BatchNo (None, 16, 16, 32) 128 conv2d_13[0][0] __________________________________________________________________________________________________ activation_12 (Activation) (None, 16, 16, 32) 0 batch_normalization_12[0][0] __________________________________________________________________________________________________ conv2d_14 (Conv2D) (None, 16, 16, 32) 9248 activation_12[0][0] __________________________________________________________________________________________________ batch_normalization_13 (BatchNo (None, 16, 16, 32) 128 conv2d_14[0][0] __________________________________________________________________________________________________ add_6 (Add) (None, 16, 16, 32) 0 activation_11[0][0] batch_normalization_13[0][0] __________________________________________________________________________________________________ activation_13 (Activation) (None, 16, 16, 32) 0 add_6[0][0] __________________________________________________________________________________________________ conv2d_15 (Conv2D) (None, 8, 8, 64) 18496 activation_13[0][0] __________________________________________________________________________________________________ batch_normalization_14 (BatchNo (None, 8, 8, 64) 256 conv2d_15[0][0] __________________________________________________________________________________________________ activation_14 (Activation) (None, 8, 8, 64) 0 batch_normalization_14[0][0] __________________________________________________________________________________________________ conv2d_16 (Conv2D) (None, 8, 8, 64) 36928 activation_14[0][0] __________________________________________________________________________________________________ conv2d_17 (Conv2D) (None, 8, 8, 64) 2112 activation_13[0][0] __________________________________________________________________________________________________ batch_normalization_15 (BatchNo (None, 8, 8, 64) 256 conv2d_16[0][0] __________________________________________________________________________________________________ add_7 (Add) (None, 8, 8, 64) 0 conv2d_17[0][0] batch_normalization_15[0][0] __________________________________________________________________________________________________ activation_15 (Activation) (None, 8, 8, 64) 0 add_7[0][0] __________________________________________________________________________________________________ conv2d_18 (Conv2D) (None, 8, 8, 64) 36928 activation_15[0][0] __________________________________________________________________________________________________ batch_normalization_16 (BatchNo (None, 8, 8, 64) 256 conv2d_18[0][0] __________________________________________________________________________________________________ activation_16 (Activation) (None, 8, 8, 64) 0 batch_normalization_16[0][0] __________________________________________________________________________________________________ conv2d_19 (Conv2D) (None, 8, 8, 64) 36928 activation_16[0][0] __________________________________________________________________________________________________ batch_normalization_17 (BatchNo (None, 8, 8, 64) 256 conv2d_19[0][0] __________________________________________________________________________________________________ add_8 (Add) (None, 8, 8, 64) 0 activation_15[0][0] batch_normalization_17[0][0] __________________________________________________________________________________________________ activation_17 (Activation) (None, 8, 8, 64) 0 add_8[0][0] __________________________________________________________________________________________________ conv2d_20 (Conv2D) (None, 8, 8, 64) 36928 activation_17[0][0] __________________________________________________________________________________________________ batch_normalization_18 (BatchNo (None, 8, 8, 64) 256 conv2d_20[0][0] __________________________________________________________________________________________________ activation_18 (Activation) (None, 8, 8, 64) 0 batch_normalization_18[0][0] __________________________________________________________________________________________________ conv2d_21 (Conv2D) (None, 8, 8, 64) 36928 activation_18[0][0] __________________________________________________________________________________________________ batch_normalization_19 (BatchNo (None, 8, 8, 64) 256 conv2d_21[0][0] __________________________________________________________________________________________________ add_9 (Add) (None, 8, 8, 64) 0 activation_17[0][0] batch_normalization_19[0][0] __________________________________________________________________________________________________ activation_19 (Activation) (None, 8, 8, 64) 0 add_9[0][0] __________________________________________________________________________________________________ average_pooling2d_1 (AveragePoo (None, 1, 1, 64) 0 activation_19[0][0] __________________________________________________________________________________________________ flatten_1 (Flatten) (None, 64) 0 average_pooling2d_1[0][0] __________________________________________________________________________________________________ dense_1 (Dense) (None, 10) 650 flatten_1[0][0] ================================================================================================== Total params: 274,442 Trainable params: 273,066 Non-trainable params: 1,376 __________________________________________________________________________________________________