The Effect of Activation Functions On Superposition in Toy Models
An in-depth exploration of how different activation functions influence superposition in neural networks.
An in-depth exploration of how different activation functions influence superposition in neural networks.