How to Execute LLMs Model Remotely at No Cost Using Google Colab T4 GPU

Harness ollama + google colab 🦙

Korkrid Kyle Akepanidtaworn

--

Have you ever worried about not having enough GPU running LLMs?

Have you ever considered Private LLMs?

As a seasoned data scientist, I’m a big fan of Google Colab (Oops, sorry Microsoft), and it requires no setup to use, while providing…

--

--

Korkrid Kyle Akepanidtaworn

AI Specialized CSA @ Microsoft | Enterprise AI, GenAI, LLM, LLamaIndex, ML | GenAITechLab Fellow, MScFE at WorldQuant, MSDS at CU Boulder