How do you currently use LLMs for learning? If you mainly rely on them for quick answers, you're only scratching the surface of their potential.

LLMs can be powerful tools for testing and deepening your understanding of any subject. Instead of just asking for answers, try engaging an LLM in …

Ollama vs. vLLM: A Power-user's Perspective on LLM Serving

For the past 18 months, Ollama has been my go-to tool for running Large Language Models (LLMs). Its reliability and minimalist design, focusing on user experience, are truly commendable. Installation, configuration and model management are incredibly straightforward. However, the rise of …

Ever wondered how well Retrieval-Augmented Generation (RAG) can perform with a classic like Alice's Adventures in Wonderland? I recently used the RAG Assessment (ragas) Python module to automatically create a set of Q&A and then performance benchmark different configurations. Some of the results were surprising.

Dive into my detailed …

Ever felt lost when a sommelier throws out words like "Rhubarb hangs out with cherry cider and the mellowest cinnamon" to describe a wine? ‍ Well - me too!

At the end of last week I was on a quest to bridge the gap between flowery descriptions and actual grape varieties! Inspired …

While text-to-image and text-to-text take most of the Generative AI headlines, the field of text-to-speech (TTS) continues to make steady progress. Recently, I explored the capabilities of Tortoise-TTS, an open-source framework for building high-fidelity TTS systems.

I've captured my research and experimentation in a Jupyter notebook. You can find it …

🔥 Meta's latest release, Llama 3, has delivered an impressive set of Large Language Model (LLM) benchmarks. While the 8B and 70B parameter models show impressive results against closed-source and open-source models such as Claude, Gemini and Mistral, it's interesting to compare improvements of …

In my role as field CTO, I sometimes speak with analysts and the media. Conversations often focus around a predetermined area of interest of set of questions. The follow text is based on my preparation for an interview with Techgoondu, Sinagpore.

Q1. What’s the Asia-Pacific AI landscape like currently …

Each day we are presented with an almost limitless supply of potentially interesting and valuable media to consume. In a fraction of the second we make the decision to consume it, delay it for later or simply ignore it. But how often do we defer reading something and never get …