Quantification and Classification of Carbon Nanotubes in Electron Micrographs using Vision Foundation Models
By: Sanjay Pradeep , Chen Wang , Matthew M. Dahm and more
Accurate characterization of carbon nanotube morphologies in electron microscopy images is vital for exposure assessment and toxicological studies, yet current workflows rely on slow, subjective manual segmentation. This work presents a unified framework leveraging vision foundation models to automate the quantification and classification of CNTs in electron microscopy images. First, we introduce an interactive quantification tool built on the Segment Anything Model (SAM) that segments particles with near-perfect accuracy using minimal user input. Second, we propose a novel classification pipeline that utilizes these segmentation masks to spatially constrain a DINOv2 vision transformer, extracting features exclusively from particle regions while suppressing background noise. Evaluated on a dataset of 1,800 TEM images, this architecture achieves 95.5% accuracy in distinguishing between four different CNT morphologies, significantly outperforming the current baseline despite using a fraction of the training data. Crucially, this instance-level processing allows the framework to resolve mixed samples, correctly classifying distinct particle types co-existing within a single field of view. These results demonstrate that integrating zero-shot segmentation with self-supervised feature learning enables high-throughput, reproducible nanomaterial analysis, transforming a labor-intensive bottleneck into a scalable, data-driven process.
Similar Papers
Zero-shot Shape Classification of Nanoparticles in SEM Images using Vision Foundation Models
CV and Pattern Recognition
Identifies tiny particle shapes without needing many examples.
Automated Feature Tracking for Real-Time Kinematic Analysis and Shape Estimation of Carbon Nanotube Growth
CV and Pattern Recognition
Tracks tiny tubes growing in real-time.
SAM-EM: Real-Time Segmentation for Automated Liquid Phase Transmission Electron Microscopy
CV and Pattern Recognition
Tracks tiny moving things in blurry science videos.