Vectorize bitmap

Preface
Suppose we have some annotations of shape "bitmap", but want to work with vector objects. What can we do? Use DTL, of course.
The task is very common. Annotations in form of masks may be obtained from different sources, including:
manual annotation, may be with our awesome Smart Tool​
segmentation results from some appropriate neural network, e.g. UNet​
something else
But in many cases it is preferable to work with or produce result in form of vector objects. They are, after all, sligtly more... machine-friendly.
Let's start with some image. Annotate it with Smart Tool and get a single mask of class "char-bitmap".
Source image.
Source image with mask object.
Find contours
The most natural action is to find contours of mask. We can simply do it with Find Contours layer. From our single mask (shape "bitmap") it will generate some polygons -- with holes, if it's needed.
After that, we can find that resulting polygons have too many vertices. If we aren't satisfied with it, decrease number of vertices by approximating the polygons. Approx Vector layer will help us.
Here is the DTL graph:
[
  {
    "action": "data",
    "src": [
      "wai/ds"
    ],
    "dst": "$sample0",
    "settings": {
      "classes_mapping": "default"
    }
  },
  {
    "dst": "$sample2",
    "src": [
      "$sample0"
    ],
    "action": "find_contours",
    "settings": {
      "classes_mapping": {
        "char-bitmap": "char-poly"
      }
    }
  },
  {
    "action": "approx_vector",
    "src": [
      "$sample2"
    ],
    "dst": "$sample3",
    "settings": {
      "classes": [
        "char-poly"
      ],
      "epsilon": 2
    }
  },
  {
    "action": "supervisely",
    "src": [
      "$sample3"
    ],
    "dst": "wai-contours",
    "settings": {}
  }
]
Here is the result:
Source mask.
Polygons after processing.
Now we got six polygons, with required holes in the largest.
Largest polygon selected
Let's see how approximation works:
Polygon after "Find Polygons" without approximation.
Polygon after approximation (epsilon=2).
Get skeleton
Another thing which may be required is extracting a skeleton from a bitmap. Simple DTL pipeline allows to do it. We will get figures of shape "line" as a result.
Here is the example of converting our "line-shaped" bitmap to convenient vector objects. We'll do the following:
Thin bitmap with Skeletonize layer, getting bitmap of "one-pixel edges".
Convert thinned bitmap to objects of shape "line" with Bitmap to Lines layer.
approximate line objects to decrease number of vertices with Approx Vector layer.
Here is the DTL graph:
[
  {
    "action": "data",
    "src": [
      "wai/ds"
    ],
    "dst": "$sample0",
    "settings": {
      "classes_mapping": "default"
    }
  },
  {
    "dst": "$sample1",
    "src": [
      "$sample0"
    ],
    "action": "skeletonize",
    "settings": {
      "method": "thinning",
      "classes": [
        "char-bitmap"
      ]
    }
  },
  {
    "dst": "$sample2",
    "src": [
      "$sample1"
    ],
    "action": "bitmap2lines",
    "settings": {
      "min_points_cnt": 2,
      "classes_mapping": {
        "char-bitmap": "char-line"
      }
    }
  },
  {
    "action": "approx_vector",
    "src": [
      "$sample2"
    ],
    "dst": "$sample3",
    "settings": {
      "classes": [
        "char-line"
      ],
      "epsilon": 2
    }
  },
  {
    "action": "supervisely",
    "src": [
      "$sample3"
    ],
    "dst": "wai-vectorized",
    "settings": {}
  }
]
Here is the result:
Source mask.
Resulting skeleton, figures of shape "line".
In details, this is how Skeletonize layer works:
Source mask.
Thinned mask. It's still a figure of shape "bitmap".
And this is why we need approximation with Approx Vector layer:
Line obtained brom bitmap, without approximation.
The line after approximation: two vertices.
Of course, the approximation may be "softer", producing smoother lines with more vertices. It is tuned by epsilon parameter in Approx Vector layer.
Duplicate Objects for complicated conversions
As an example, consider the two pipelines above. Our purpose is to get the following figures on the same image:
source mask ("bitmap")
found contours ("polygon"s)
found skeleton ("line"s)
It is useful in different cases, which this margin is too narrow to contain.
We'll simply apply Duplicate Objects layer to copy objects. Actually, we'll apply it twice:
There is a class "char-bitmap", and we want to save it.
Clone it to temporary class "bitmap-to-poly", which will be converted to "char-poly" polygons later.
And clone "char-bitmap" again to temporary class "bitmap-to-line", which will be converted to "char-line" lines later.
After that, we just need to stack the previous two pipelines. No branching.
Here is the DTL graph:
[
  {
    "action": "data",
    "src": [
      "wai/ds"
    ],
    "dst": "$sample",
    "settings": {
      "classes_mapping": "default"
    }
  },
  {
    "dst": "$dupl-1",
    "src": [
      "$sample"
    ],
    "action": "duplicate_objects",
    "settings": {
      "classes_mapping": {
        "char-bitmap": "bitmap-to-poly"
      }
    }
  },
  {
    "dst": "$dupl-2",
    "src": [
      "$dupl-1"
    ],
    "action": "duplicate_objects",
    "settings": {
      "classes_mapping": {
        "char-bitmap": "bitmap-to-line"
      }
    }
  },
  {
    "dst": "$thinned",
    "src": [
      "$dupl-2"
    ],
    "action": "skeletonize",
    "settings": {
      "method": "thinning",
      "classes": [
        "bitmap-to-line"
      ]
    }
  },
  {
    "dst": "$lines-1",
    "src": [
      "$thinned"
    ],
    "action": "bitmap2lines",
    "settings": {
      "min_points_cnt": 2,
      "classes_mapping": {
        "bitmap-to-line": "char-line"
      }
    }
  },
  {
    "action": "approx_vector",
    "src": [
      "$lines-1"
    ],
    "dst": "$lines-2",
    "settings": {
      "classes": [
        "char-line"
      ],
      "epsilon": 2
    }
  },
  {
    "dst": "$contours-1",
    "src": [
      "$lines-2"
    ],
    "action": "find_contours",
    "settings": {
      "classes_mapping": {
        "bitmap-to-poly": "char-poly"
      }
    }
  },
  {
    "action": "approx_vector",
    "src": [
      "$contours-1"
    ],
    "dst": "$contours-2",
    "settings": {
      "classes": [
        "char-poly"
      ],
      "epsilon": 2
    }
  },
  {
    "action": "supervisely",
    "src": [
      "$contours-2"
    ],
    "dst": "wai-three-classes",
    "settings": {}
  }
]
Here is the result. Lines are purple, bitmap is blue. Polygons are yellow.
Bitmap, polygons and lines
Download filtered data
Next - 🔮 Neural Networks
Basics
Last updated 4 months ago