I love this paper, I always had an issue of visualizing transformers from readin... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		xiphias2 on June 16, 2021 \| parent \| context \| favorite \| on: Thinking Like Transformers I love this paper, I always had an issue of visualizing transformers from reading ML papers, with this I can just play with it. These are simple higher-order functions that can be implemented in any language though, so porting to Python and playing with it in a Jupyter notebook is trivial.

anentropic on June 16, 2021 [–]

I'm not sure if it's from the authors of the paper, but this appears to be that: https://github.com/tech-srl/RASP

polynomial on June 16, 2021 | [–]

The paper's lead author is the sole committer on that repo.

Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact