I was thinking the exact same thing. That sounds like a small ByT5 LLM model. Up...

fxtentacle on Aug 31, 2023 | parent | context | favorite | on: Show HN: I automated half of my typing

I was thinking the exact same thing. That sounds like a small ByT5 LLM model. Upon space you auto-complete the past word based on a moving context window of the past 32 characters or so.