Posted on September 25, 2023
This week’s highlight from our research is LM Studio.
It is now easy to run a Local Large Language Model (LLM) on your computer.
Why would you want to do this?
Privacy. If you are dealing with sensitive data, most clients would not be comfortable with their data traversing the internet to get to say chatGPT.
Cost. If you are going to be making a repetitive set of calls to OpenAi – let’s say doing data manipulation – the costs quickly add up. Running an LLM on your own computer is free.
Internet Access. If you are in an area where you do not have internet, let’s say an overseas flight or out in the countryside – it might still be super useful to have access to an LLM. By having one on your computer you still have access to specialised knowledge that only an LLM can provide!
Unfortunately until recently it has been very difficult to run a Large Language Model on your own computer. You had to have basic dev skills & understand a considerable amount on how the models themselves worked to even get started.
Recently however I discovered LM Studio and simply put, LM studio abstracts away all the pain.
Unlike all of the other solutions out there at the moment – LM Studio is simply an app.
All you need to do is visit their website & with a couple of clicks it is painlessly installed.
Best of all it is 100% free and works on both Windows & Mac.
You can get started yourself by visiting LM Studio’s website here