Treffer: CPDD: A Cross-Scenario Photovoltaic Defect Detector Based on Fine-Grained Feature Autoencoding and Pseudo-Box Contrastive Learning.

The vision foundation model, relying on large-scale pre-training, has advanced image comprehension capabilities and excels in general scenarios. However, its performance remains suboptimal in specialized tasks, such as photovoltaic (PV) cells defect detection. This limitation stems from the models’ lack of domain-specific prior knowledge. To address this, we propose a two-stage pre-training framework comprising fine-grained feature autoencoding (FFA) and pseudo-box contrastive learning (PCL), which leverages extensive unlabeled raw images to inject domain expertise into the model. First, we investigate the fine-grained feature autoencoder, which trains a detail-sensitive vision transformer (ViT) backbone by reconstructing the histogram of oriented gradients (HOG) of masked images. Second, we pre-train the detection head through contrastive learning. Using selective search (SS) to generate pseudo-boxes, we treat paired boxes from two augmented views of an image as positive samples. The abundant unsupervised pseudo-boxes optimize the detection head’s local representation and localization capabilities. Finally, we fully fine-tune the model with labeled images. Based on this methodology, we build the cross-scenario photovoltaic defect detector (CPDD). The experimental results demonstrate that CPDD achieves state-of-the-art (SOTA) mAP50 scores on three benchmarks, outperforming detectors pre-trained on the COCO dataset as well as those specifically designed for PV defect detection. [ABSTRACT FROM AUTHOR]

Copyright of IEEE Transactions on Semiconductor Manufacturing is the property of IEEE and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)