Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
Benyun authored Sep 19, 2023
1 parent bc4c8ed commit 0aad240
Showing 1 changed file with 12 additions and 7 deletions.
19 changes: 12 additions & 7 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -37,11 +37,10 @@ Benyun Zhao<sup>1</sup>, Xunkuai Zhou<sup>2</sup>, Guidong Yang<sup>1</sup>, Jun
<h2>Abstract</h2>
</div>


Learning-based visual inspection, integrated with unmanned robotic system, offers a more effective, efficient, and safer alternative for infrastructure inspection tasks that are traditionally heavily reliant on human labor. However, the potential of learning-based inspection methods remains limited due to the lack of publicly available, high-quality datasets. This paper presents CUBIT, a high-resolution defect detection dataset comprising more than $5500$ images with resolutions up to $8000\times6000$ which covers a broader spectrum of practical situations, backgrounds, and defect categories than existing publicly available datasets. We conduct extensive experiments to benchmark the performance of state-of-the-art real-time detection methods on our proposed dataset, validating the effectiveness of it. Moreover, based on the benchmark results, we develop a module named GIPFPP to integrate multi-scale feature, enhancing the AP by 3\% while reducing the number of parameters by 10\% on baseline model. Additionally, a real-site UAV-based inspection has been conducted to verify the reliability of the dataset.

<div style="text-align: center; font-family: 'American Typewriter'; font-weight: 400; ">
<h3>Sample images in CUBIT</h3>
<h2>Sample images in CUBIT</h2>
</div>
The sample images in CUBIT has been shown below. All the data are collected by autonomous unmanned systems such as UAV and UGV. Our dataset includes various scenarios and defect categories compared with the existing open-source bounding-box level defect detection dataset.

Expand All @@ -54,7 +53,7 @@ Image Resolution | Year | Structure Type | Number of Images | Defect Type | Anno
</p>

<div style="text-align: center; font-family: 'American Typewriter'; font-weight: 400; ">
<h3>Defect Detection Framework based on CUBIT</h3>
<h2>Defect Detection Framework based on CUBIT</h2>
</div>
The visualization of defect detection framework based on CUBIT dataset is illustrated below, which encompasses the entire process: data collection by autonomous unmanned system; the baseline network integrated with our GIPFPP module; the output of defect detection results.
<p align="center">
Expand All @@ -63,20 +62,26 @@ The visualization of defect detection framework based on CUBIT dataset is illust


<div style="text-align: center; font-family: 'American Typewriter'; font-weight: 400; ">
<h3>Prediction results on the test set of the proposed CUBIT-RGB-v1 defect dataset are shown below
</h3>
<h2>Prediction results on the test set of the proposed CUBIT-RGB-v1 defect dataset are shown below</h2>
</div>
We enlarge the prediction results in the bottom right corner of framework images above. CUBIT dataset covers three infrastructure types: Building facade, Pavement, and Bridge, and aims for three types of defect: Crack, Spalling, and Moisture. Rectangles indicate the output prediction box Red for Crack, Pink for Spalling, and Orange for Moisture with inferred defect type and confidence score from YOLOv6-n+GIPFPP modle trained on the training set of our proposed dataset.
<p align="center">
<img src="./index_show.png" width=70% height=70%>
</p>
</div>


<div style="text-align: center; font-family: 'American Typewriter'; font-weight: 400; ">
<h3>Multi-UAV-based Real-world Infrastructure Defects Inspection</h3>
<h2>Multi-UAV-based Real-world Infrastructure Defects Inspection</h2>
</div>
Qualitative visualization of multi-UAV-based real-world experiment is shown below. On the left, our multi-UAVs inspection schematics is illustrated. On the right, the detection results of four direction façades of the building are displayed.
<p align="center">
<img src="./goodman_zigzag.png" width=80% height=80%>
</p>


<div style="text-align: center; font-family: 'American Typewriter'; font-weight: 400; ">
<h2>Acknowledgement</h2>
</div>
This work was supported by the InnoHK of the Government of the Hong Kong Special Administrative Region via the Hong Kong Centre for Logistics Robotics.


0 comments on commit 0aad240

Please sign in to comment.