Features matter. A lot of effort is being put into developing better “meta-architectures” for real world problems such as image classification, detection and segmentation. In parallel, one of the most significant improvements of the last decade came from simply pre-training the architectures on Imagenet and developing better features. Adding enough…