Keras:Unet網(wǎng)絡實現(xiàn)多類語義分割方式
更新時間：2020年06月11日 10:39:44 作者：Robin Long 2018
本文主要利用U-Net網(wǎng)絡結構實現(xiàn)了多類的語義分割，并展示了部分測試效果，希望對你有用！
1 介紹
U-Net最初是用來對醫(yī)學圖像的語義分割，后來也有人將其應用于其他領域。但大多還是用來進行二分類，即將原始圖像分成兩個灰度級或者色度，依次找到圖像中感興趣的目標部分。
本文主要利用U-Net網(wǎng)絡結構實現(xiàn)了多類的語義分割，并展示了部分測試效果，希望對你有用！
2 源代碼
（1）訓練模型
from __future__ import print_function
import os
import datetime
import numpy as np
from keras.models import Model
from keras.layers import Input, concatenate, Conv2D, MaxPooling2D, Conv2DTranspose, AveragePooling2D, Dropout, \
BatchNormalization
from keras.optimizers import Adam
from keras.layers.convolutional import UpSampling2D, Conv2D
from keras.callbacks import ModelCheckpoint
from keras import backend as K
from keras.layers.advanced_activations import LeakyReLU, ReLU
import cv2
PIXEL = 512 #set your image size
BATCH_SIZE = 5
lr = 0.001
EPOCH = 100
X_CHANNEL = 3 # training images channel
Y_CHANNEL = 1 # label iamges channel
X_NUM = 422 # your traning data number
pathX = 'I:\\Pascal VOC Dataset\\train1\\images\\' #change your file path
pathY = 'I:\\Pascal VOC Dataset\\train1\\SegmentationObject\\' #change your file path
#data processing
def generator(pathX, pathY,BATCH_SIZE):
while 1:
X_train_files = os.listdir(pathX)
Y_train_files = os.listdir(pathY)
a = (np.arange(1, X_NUM))
X = []
Y = []
for i in range(BATCH_SIZE):
index = np.random.choice(a)
# print(index)
img = cv2.imread(pathX + X_train_files[index], 1)
img = np.array(img).reshape(PIXEL, PIXEL, X_CHANNEL)
X.append(img)
img1 = cv2.imread(pathY + Y_train_files[index], 1)
img1 = np.array(img1).reshape(PIXEL, PIXEL, Y_CHANNEL)
Y.append(img1)
X = np.array(X)
Y = np.array(Y)
yield X, Y
#creat unet network
inputs = Input((PIXEL, PIXEL, 3))
conv1 = Conv2D(8, 3, activation='relu', padding='same', kernel_initializer='he_normal')(inputs)
pool1 = AveragePooling2D(pool_size=(2, 2))(conv1) # 16
conv2 = BatchNormalization(momentum=0.99)(pool1)
conv2 = Conv2D(64, 3, activation='relu', padding='same', kernel_initializer='he_normal')(conv2)
conv2 = BatchNormalization(momentum=0.99)(conv2)
conv2 = Conv2D(64, 1, activation='relu', padding='same', kernel_initializer='he_normal')(conv2)
conv2 = Dropout(0.02)(conv2)
pool2 = AveragePooling2D(pool_size=(2, 2))(conv2) # 8
conv3 = BatchNormalization(momentum=0.99)(pool2)
conv3 = Conv2D(128, 3, activation='relu', padding='same', kernel_initializer='he_normal')(conv3)
conv3 = BatchNormalization(momentum=0.99)(conv3)
conv3 = Conv2D(128, 1, activation='relu', padding='same', kernel_initializer='he_normal')(conv3)
conv3 = Dropout(0.02)(conv3)
pool3 = AveragePooling2D(pool_size=(2, 2))(conv3) # 4
conv4 = BatchNormalization(momentum=0.99)(pool3)
conv4 = Conv2D(256, 3, activation='relu', padding='same', kernel_initializer='he_normal')(conv4)
conv4 = BatchNormalization(momentum=0.99)(conv4)
conv4 = Conv2D(256, 1, activation='relu', padding='same', kernel_initializer='he_normal')(conv4)
conv4 = Dropout(0.02)(conv4)
pool4 = AveragePooling2D(pool_size=(2, 2))(conv4)
conv5 = BatchNormalization(momentum=0.99)(pool4)
conv5 = Conv2D(512, 3, activation='relu', padding='same', kernel_initializer='he_normal')(conv5)
conv5 = BatchNormalization(momentum=0.99)(conv5)
conv5 = Conv2D(512, 1, activation='relu', padding='same', kernel_initializer='he_normal')(conv5)
conv5 = Dropout(0.02)(conv5)
pool4 = AveragePooling2D(pool_size=(2, 2))(conv4)
# conv5 = Conv2D(35, 3, activation='relu', padding='same', kernel_initializer='he_normal')(conv4)
# drop4 = Dropout(0.02)(conv5)
pool4 = AveragePooling2D(pool_size=(2, 2))(pool3) # 2
pool5 = AveragePooling2D(pool_size=(2, 2))(pool4) # 1
conv6 = BatchNormalization(momentum=0.99)(pool5)
conv6 = Conv2D(256, 3, activation='relu', padding='same', kernel_initializer='he_normal')(conv6)
conv7 = Conv2D(256, 3, activation='relu', padding='same', kernel_initializer='he_normal')(conv6)
up7 = (UpSampling2D(size=(2, 2))(conv7)) # 2
conv7 = Conv2D(256, 3, activation='relu', padding='same', kernel_initializer='he_normal')(up7)
merge7 = concatenate([pool4, conv7], axis=3)
conv8 = Conv2D(128, 3, activation='relu', padding='same', kernel_initializer='he_normal')(merge7)
up8 = (UpSampling2D(size=(2, 2))(conv8)) # 4
conv8 = Conv2D(128, 3, activation='relu', padding='same', kernel_initializer='he_normal')(up8)
merge8 = concatenate([pool3, conv8], axis=3)
conv9 = Conv2D(64, 3, activation='relu', padding='same', kernel_initializer='he_normal')(merge8)
up9 = (UpSampling2D(size=(2, 2))(conv9)) # 8
conv9 = Conv2D(64, 3, activation='relu', padding='same', kernel_initializer='he_normal')(up9)
merge9 = concatenate([pool2, conv9], axis=3)
conv10 = Conv2D(32, 3, activation='relu', padding='same', kernel_initializer='he_normal')(merge9)
up10 = (UpSampling2D(size=(2, 2))(conv10)) # 16
conv10 = Conv2D(32, 3, activation='relu', padding='same', kernel_initializer='he_normal')(up10)
conv11 = Conv2D(16, 3, activation='relu', padding='same', kernel_initializer='he_normal')(conv10)
up11 = (UpSampling2D(size=(2, 2))(conv11)) # 32
conv11 = Conv2D(8, 3, activation='relu', padding='same', kernel_initializer='he_normal')(up11)
# conv12 = Conv2D(3, 1, activation='relu', padding='same', kernel_initializer='he_normal')(conv11)
conv12 = Conv2D(3, 1, activation='relu', padding='same', kernel_initializer='he_normal')(conv11)
model = Model(input=inputs, output=conv12)
print(model.summary())
model.compile(optimizer=Adam(lr=1e-3), loss='mse', metrics=['accuracy'])
history = model.fit_generator(generator(pathX, pathY,BATCH_SIZE),
steps_per_epoch=600, nb_epoch=EPOCH)
end_time = datetime.datetime.now().strftime('%Y-%m-%d %H:%M:%S')
#save your training model
model.save(r'V1_828.h5')
#save your loss data
mse = np.array((history.history['loss']))
np.save(r'V1_828.npy', mse)
（2）測試模型
from keras.models import load_model
import numpy as np
import matplotlib.pyplot as plt
import os
import cv2
model = load_model('V1_828.h5')
test_images_path = 'I:\\Pascal VOC Dataset\\test\\test_images\\'
test_gt_path = 'I:\\Pascal VOC Dataset\\test\\SegmentationObject\\'
pre_path = 'I:\\Pascal VOC Dataset\\test\\pre\\'
X = []
for info in os.listdir(test_images_path):
A = cv2.imread(test_images_path + info)
X.append(A)
# i += 1
X = np.array(X)
print(X.shape)
Y = model.predict(X)
groudtruth = []
for info in os.listdir(test_gt_path):
A = cv2.imread(test_gt_path + info)
groudtruth.append(A)
groudtruth = np.array(groudtruth)
i = 0
for info in os.listdir(test_images_path):
cv2.imwrite(pre_path + info,Y[i])
i += 1
a = range(10)
n = np.random.choice(a)
cv2.imwrite('prediction.png',Y[n])
cv2.imwrite('groudtruth.png',groudtruth[n])
fig, axs = plt.subplots(1, 3)
# cnt = 1
# for j in range(1):
axs[0].imshow(np.abs(X[n]))
axs[0].axis('off')
axs[1].imshow(np.abs(Y[n]))
axs[1].axis('off')
axs[2].imshow(np.abs(groudtruth[n]))
axs[2].axis('off')
# cnt += 1
fig.savefig("imagestest.png")
plt.close()
3 效果展示
說明：從左到右依次是預測圖像，真實圖像，標注圖像?？梢钥闯觯瑢τ诓糠謹?shù)據(jù)的分割效果還有待改進，主要原因還是數(shù)據(jù)集相對復雜，模型難于找到其中的規(guī)律。
以上這篇Keras:Unet網(wǎng)絡實現(xiàn)多類語義分割方式就是小編分享給大家的全部內(nèi)容了，希望能給大家一個參考，也希望大家多多支持腳本之家。
相關文章
使用Flink與Python進行實時數(shù)據(jù)處理的基本步驟
Apache Flink是一個流處理框架,用于實時處理和分析數(shù)據(jù)流,PyFlink是Apache Flink的Python API,它允許用戶使用Python語言來編寫Flink作業(yè),進行實時數(shù)據(jù)處理,以下是如何使用Flink與Python進行實時數(shù)據(jù)處理的基本步驟,需要的朋友可以參考下2024-09-09
Python中使用PyQt把網(wǎng)頁轉換成PDF操作代碼實例
這篇文章主要介紹了Python中使用PyQt把網(wǎng)頁轉換成PDF操作代碼實例,本文直接給出實現(xiàn)代碼,需要的朋友可以參考下2015-04-04
這篇文章主要介紹了pycharm新建Vue項目的方法步驟，文中通過示例代碼介紹的非常詳細，對大家的學習或者工作具有一定的參考學習價值，需要的朋友們下面隨著小編來一起學習學習吧2020-03-03
Python使用Bokeh實現(xiàn)交互式圖表的創(chuàng)建
Bokeh?是一個流行的?Python?數(shù)據(jù)可視化庫，可以生成高質(zhì)量的交互式圖表，這篇文章主要就介紹了Python如何使用Bokeh實現(xiàn)交互式圖表的創(chuàng)建，需要的可以參考一下2023-06-06
A/B測試，通過分析兩種不同的營銷策略，以此來選擇最佳的營銷策略，可以高效地將流量轉化為銷售額。本文主要介紹了如何通過Python實現(xiàn)一個A/B測試，感興趣的可以了解一下2023-01-01
這篇文章主要介紹了python使用7z解壓apk包的方法,涉及Python的shell命令調(diào)用技巧,非常具有實用價值,需要的朋友可以參考下2015-04-04
這篇文章主要介紹了Python編程中如何通過鼠標事件及坐標獲取窗口坐標和屏幕坐標的示例解析，有需要的朋友可以借鑒參考下，希望能夠有所幫助2021-10-10
Python中字典創(chuàng)建、遍歷、添加等實用操作技巧合集
這篇文章主要介紹了Python中字典創(chuàng)建、遍歷、添加等實用操作技巧合集,本文講解了字典中常見方法列表、創(chuàng)建字典的五種方法、字典中鍵值遍歷方法等內(nèi)容,需要的朋友可以參考下2015-06-06
pandas數(shù)據(jù)處理之繪圖的實現(xiàn)
這篇文章主要介紹了pandas數(shù)據(jù)處理之繪圖的實現(xiàn)，文中通過示例代碼介紹的非常詳細，對大家的學習或者工作具有一定的參考學習價值，需要的朋友們下面隨著小編來一起學習學習吧2020-06-06
global關鍵字用來在函數(shù)或其他局部作用域中使用全局變量， nonlocal聲明的變量不是局部變量,也不是全局變量,而是外部嵌套函數(shù)內(nèi)的變量。這篇文章主要介紹了Python中 Global和Nonlocal的用法,需要的朋友可以參考下2020-01-01