“Modernizing” ConvNets
“ConvNext” is a gradually “modernized” traditional ConvNet model designed to reexamine the design spaces and test the limits of what a pure ConvNet can achieve.
The paper does this by modifying the Micro Design of the ConvNet architecture to a more TRANSFORMER-style design, such as changing the activation function and etc.
