The Effect of Activation Functions On Superposition in Toy Models

An in-depth exploration of how different activation functions influence superposition in neural networks.

December 2023 · Vedang Lad, Timothy Kostolansky

CleaNLP: Detecting Label Errors in General NLP Tasks

This paper presents a method for identifying label errors in natural language processing (NLP) datasets using the T5 model.

December 2022 · Vedang Lad, Ryan Wilson, Alex Wang

Building an Efficient Poker Agent Using RL

In this paper, we apply variations of Deep Q-learning (DQN) and Proximal Policy Optimization (PPO) to learn the game of heads-up no-limit Texas Hold’em.

May 2022 · Alex Kashi, Vedang Lad, Hakon Grini

GRUNet: A Novel Bi-directional RNN for VQA

We propose a new framework which we call GRUNet. GRUNet is a novel Bi-Directional RNN architecture that combines GRU + RNN + ResNet to effectively combine text and im- age input to answer VQA questions.

May 2021 · Vedang Lad, Lowell Hensgen