# CS336 Spring 2024 Assignment 1 (Basics) Leaderboard

To submit to the leaderboard, submit a pull request that adds your results to
the Markdown table below. The table should be sorted by increasing loss.

Note that your submission can run for at most 1.5 hours on an H100, and that you
may only use the OpenWebText training dataset that we provide.

In your pull request description, you should include:

- The final validation loss that was recorded
- A link to an associated learning curve that clearly shows a wallclock-time
  x-axis that is less than 1.5 hours . You may either upload an image directly
  to the repo (use the [./images](./images)) folder or link to a
  publicly-viewable plot from a service like Weights and Biases.
- A description of what you did


## OpenWebText (subsample) validation loss leaderboard

| Name           | Validation Loss | Link                                         |
|:---------------|----------------:|---------------------------------------------:|
| marcel         |            3.12 |https://api.wandb.ai/links/marcelroed/j5mgt64n|
| yann           |            3.18 |https://api.wandb.ai/links/hashimoto-group/5t1e2wjd|
| tony           |            3.38 | https://api.wandb.ai/links/tonysun9/sq4bs0al |
| sundararajan   |            3.55 | https://api.wandb.ai/links/sundararajan-team/hfzoaoof |
| Jason Wang     |            3.56 | https://api.wandb.ai/links/blahblahhhj/wzewv5jr |
| rohin          |            3.60 |https://api.wandb.ai/links/rohinmanvi/0xenuz30|
| rishabh        |            3.64 | https://api.wandb.ai/links/rishabh-ranjan/amq3n70d |
| chengshu       |            3.69 | https://api.wandb.ai/links/chengshu/q9dgud3z |
| imsanti        |            3.79 | https://api.wandb.ai/links/estanfor/6ia1n3zv |
| Matty Reed     |            3.80 | [image](./images/Matt_Reed_Validation_Loss.png) |
| Arvind         |            3.817| [image](./images/OWT_Leaderboard_Experiment_Arvind.png) |
| usman          |            3.86 | [image](./images/usman_val_loss.jpeg)          |
| wanqiao        |            3.87 | https://api.wandb.ai/links/wanqiao/thuus40n  |
| Judy Shen      |            3.87 | https://api.wandb.ai/links/jhshen/c7t0mvgk   |
| Shijia Yang    |            3.87 | https://api.wandb.ai/links/shijiayang/13ckenoc   |
| Nick Walker    |            3.89 | https://api.wandb.ai/links/nhwalk13/kkheu8no  |
| Zitong Yang    |            3.91 | https://api.wandb.ai/links/zitongyang/j0fzs8tn |
| Michael Ryan   |            3.91 | https://api.wandb.ai/links/michael-nlp/9hf4l35j |
| sarah          |            3.98 | https://api.wandb.ai/links/sachen/n5faddjv   |
| matt           |            4.13 | https://api.wandb.ai/links/myorg1/efyphohq   |
| Sudharsan      |            4.15 | https://api.wandb.ai/links/alephentine/phqvlcwh  |
| Mason          |            4.30 | [image](./images/mason_validation_loss_plot.png)  |
| Lucas          |            4.35 | [image](./images/lucas_val_loss.png)|
| Thomas Chen    |            4.89 | https://api.wandb.ai/links/aqlab/8gx0m7in    |
| naive baseline |            5.00 |                                              |