该方法相当简单。我们首先转换为 HSV 并仅获取色调通道。
image_hsv = cv2.cvtColor(image, cv2.COLOR_BGR2HSV)
h,_,_ = cv2.split(image_hsv)
接下来,我们找到主色调 - 首先使用以下方法计算每种色调的出现次数numpy.bincount (we flatten色调通道图像使其成为一维):
bins = np.bincount(h.flatten())
然后使用以下命令查找哪些是足够常见的numpy.where:
MIN_PIXEL_CNT_PCT = (1.0/20.0)
peaks = np.where(bins > (h.size * MIN_PIXEL_CNT_PCT))[0]
现在我们已经确定了所有主色调,我们可以重复处理图像以找到与每个主色调相对应的区域:
for i, peak in enumerate(peaks):
我们首先创建一个蒙版,选择该色调的所有像素(cv2.inRange,然后从输入的BGR图像中提取相应的部分(cv2.bitwise_and.
mask = cv2.inRange(h, peak, peak)
blob = cv2.bitwise_and(image, image, mask=mask)
接下来,我们找到轮廓(cv2.findContours该色调的所有连续区域,以便我们可以单独处理每个区域
_, contours, _ = cv2.findContours(mask, cv2.RETR_EXTERNAL, cv2.CHAIN_APPROX_SIMPLE)
现在,对于每个识别的连续区域
for j, contour in enumerate(contours):
我们确定边界框(cv2.boundingRect,并通过用白色填充轮廓多边形来创建与该轮廓相对应的蒙版(numpy.zeros_like and cv2.drawContours)
bbox = cv2.boundingRect(contour)
contour_mask = np.zeros_like(mask)
cv2.drawContours(contour_mask, contours, j, 255, -1)
然后我们可以额外添加与边界框对应的 ROI
region = blob.copy()[bbox[1]:bbox[1]+bbox[3],bbox[0]:bbox[0]+bbox[2]]
region_mask = contour_mask[bbox[1]:bbox[1]+bbox[3],bbox[0]:bbox[0]+bbox[2]]
region_masked = cv2.bitwise_and(region, region, mask=region_mask)
或者想象一下(cv2.rectangle边界框:
result = cv2.bitwise_and(blob, blob, mask=contour_mask)
top_left, bottom_right = (bbox[0], bbox[1]), (bbox[0]+bbox[2], bbox[1]+bbox[3])
cv2.rectangle(result, top_left, bottom_right, (255, 255, 255), 2)
或者进行任何您想要的其他处理。
完整脚本
import cv2
import numpy as np
# Minimum percentage of pixels of same hue to consider dominant colour
MIN_PIXEL_CNT_PCT = (1.0/20.0)
image = cv2.imread('colourblobs.png')
if image is None:
print("Failed to load iamge.")
exit(-1)
image_hsv = cv2.cvtColor(image, cv2.COLOR_BGR2HSV)
# We're only interested in the hue
h,_,_ = cv2.split(image_hsv)
# Let's count the number of occurrences of each hue
bins = np.bincount(h.flatten())
# And then find the dominant hues
peaks = np.where(bins > (h.size * MIN_PIXEL_CNT_PCT))[0]
# Now let's find the shape matching each dominant hue
for i, peak in enumerate(peaks):
# First we create a mask selecting all the pixels of this hue
mask = cv2.inRange(h, peak, peak)
# And use it to extract the corresponding part of the original colour image
blob = cv2.bitwise_and(image, image, mask=mask)
_, contours, _ = cv2.findContours(mask, cv2.RETR_EXTERNAL, cv2.CHAIN_APPROX_SIMPLE)
for j, contour in enumerate(contours):
bbox = cv2.boundingRect(contour)
# Create a mask for this contour
contour_mask = np.zeros_like(mask)
cv2.drawContours(contour_mask, contours, j, 255, -1)
print "Found hue %d in region %s." % (peak, bbox)
# Extract and save the area of the contour
region = blob.copy()[bbox[1]:bbox[1]+bbox[3],bbox[0]:bbox[0]+bbox[2]]
region_mask = contour_mask[bbox[1]:bbox[1]+bbox[3],bbox[0]:bbox[0]+bbox[2]]
region_masked = cv2.bitwise_and(region, region, mask=region_mask)
file_name_section = "colourblobs-%d-hue_%03d-region_%d-section.png" % (i, peak, j)
cv2.imwrite(file_name_section, region_masked)
print " * wrote '%s'" % file_name_section
# Extract the pixels belonging to this contour
result = cv2.bitwise_and(blob, blob, mask=contour_mask)
# And draw a bounding box
top_left, bottom_right = (bbox[0], bbox[1]), (bbox[0]+bbox[2], bbox[1]+bbox[3])
cv2.rectangle(result, top_left, bottom_right, (255, 255, 255), 2)
file_name_bbox = "colourblobs-%d-hue_%03d-region_%d-bbox.png" % (i, peak, j)
cv2.imwrite(file_name_bbox, result)
print " * wrote '%s'" % file_name_bbox
控制台输出
Found hue 32 in region (186, 184, 189, 122).
* wrote 'colourblobs-0-hue_032-region_0-section.png'
* wrote 'colourblobs-0-hue_032-region_0-bbox.png'
Found hue 71 in region (300, 197, 1, 1).
* wrote 'colourblobs-1-hue_071-region_0-section.png'
* wrote 'colourblobs-1-hue_071-region_0-bbox.png'
Found hue 71 in region (301, 195, 1, 1).
* wrote 'colourblobs-1-hue_071-region_1-section.png'
* wrote 'colourblobs-1-hue_071-region_1-bbox.png'
Found hue 71 in region (319, 190, 1, 1).
* wrote 'colourblobs-1-hue_071-region_2-section.png'
* wrote 'colourblobs-1-hue_071-region_2-bbox.png'
Found hue 71 in region (323, 176, 52, 14).
* wrote 'colourblobs-1-hue_071-region_3-section.png'
* wrote 'colourblobs-1-hue_071-region_3-bbox.png'
Found hue 71 in region (45, 10, 330, 381).
* wrote 'colourblobs-1-hue_071-region_4-section.png'
* wrote 'colourblobs-1-hue_071-region_4-bbox.png'
Found hue 109 in region (0, 0, 375, 500).
* wrote 'colourblobs-2-hue_109-region_0-section.png'
* wrote 'colourblobs-2-hue_109-region_0-bbox.png'
Found hue 166 in region (1, 397, 252, 103).
* wrote 'colourblobs-3-hue_166-region_0-section.png'
* wrote 'colourblobs-3-hue_166-region_0-bbox.png'
输出图像示例
黄色边界框:
黄色提取区域:
最大的绿色边界框(还有其他几个小的不相交区域):
...以及相应的提取区域: