Conventional wisdom states that running LLMs locally will require computers with high performance specifications especially GPUs with lots of VRAM. But is this actually true?

Thanks to an open-source llama2.c project, I ported it to work so vintage machines running DOS can actually inference Llama 2 LLM models. Of course there are severe limitations but the results will surprise you.

If I were to tell you a PC has a floppy drive, optical drive, Sound Blaster card, serial, parallel and PS/2 ports running DOS, you would think I’m referring to a machine from the 1990s. But my very modern PC built in 2024 possess these characteristics!

I recently built myself a PC as my previous desktop components was insufficient for my current needs. I decided to build one with the ability to still reach back into the past to run DOS.

In this post, I will go through my thought process I went through to decide on the specifications as well as the journey I made to run MS-DOS 6.22 on it.

I did an experiment on a relatively modern 2020 Thinkpad and found that it can still run DOS.

Modern features like Thunderbolt, 2.5 Gig Ethernet and Sound Blaster compatibility over Intel High Definition Audio can work which is pretty remarkable. Thanks to drivers that can actually be found online.

I also ran 8088 Domination and it seems to work well too.

This is however the end of the line, no more Thinkpads and likely other laptops made after this model generation will be able to run DOS natively.

I used Enhanced Doskey. http://paulhoule.com/doskey/

They have already written an article about it :)

https://hackaday.com/2023/09/10/upgraded-graphics-gremlin-ad...

With the recent attention on ChatGPT and OpenAI’s release of their APIs, many developers have developed clients for modern platforms to talk to this super smart AI chatbot. However I’m pretty sure almost nobody has written one for a vintage platform like MS-DOS.

I updated my blog post to include a memory and disk usage comparison :)

The printf is just for example code.

In actual fact, I'll have to copy the data to a char array to be sent to display in the listbox.

Fair enough. I read this quite literally and thought "not exactly":

> hence I need to use those values to copy out from memory to a separate char array for printing purposes. Certainly not so trivial.

VC++ 1.52 has an internal text editor but nowhere near the capabilities of Visual Studio Code or any modern text editors.

I also use Git and sourcetree and they won't run on Win 2K.

If someone has got a working TLS 1.2 on such an old OS, I'll like to know too. Because I certainly haven't saw any example.

I think the work to get TLS 1.2 working will certainly dwarf the work on this Slack app.