I Benchmarked 4 Lightweight Transformers for Fault Detection. Here's What Survived.

Everyone talks about deploying ML on edge devices. Very few people show what happens when you actually try. I ran a full benchmark of four lightweight transformer models - DistilBERT, MobileBERT, TinyBERT-6L, and TinyBERT-4L — against traditional ML baselines on three real-world fault detection data