Ever wondered how a transformer (LLM) works? How input text is tokenised, embedded, normalised and passes through multi-head self-attention layers? Well, someone decided to make it into an interactive visualisation. Wow.

Have you ever worked with a professional interpreter? They perform impressive mental gymnastics, especially in simultaneous translation, where they listen to a live audio stream in one language while translating and speaking in another at the same time.

Over the past fifteen years, I’ve travelled extensively across APAC, speaking …

5G’s low latency, greater throughput and more consistent connections make remote driving technically viable—but is it truly the better option? While 5G can help address reliability concerns, the biggest challenge might not be the network but the human element. Could a remote driver be the weakest link in …

The Text-to-Speech (TTS) landscape is transforming rapidly. Have you explored the latest advancements?

I recently came across Kokoro, a compact yet powerful TTS model (only 82M parameters!), and I'm impressed. Its audio quality is exceptional, rivalling much larger models. Beyond quality, Kokoro is fast enough for real-time applications and can …

Ever wish you could give those annoying scammers a taste of their own medicine? O2 has found a brilliant way to do just that! Their AI chatbot, "DAIsy," poses as a sweet but slightly confused old lady, politely but effectively wasting scammers' time. It's a clever and entertaining approach to …

I had been curious about the benefits of e-ink tablets since the release of the Remarkable v1. I wondered whether its lightweight design and supposedly paper-like writing experience would allow me to replace my paper notebooks and complement my digital note-taking system. When Boox released the Go 10.3, I …

How do you currently use LLMs for learning? If you mainly rely on them for quick answers, you're only scratching the surface of their potential.

LLMs can be powerful tools for testing and deepening your understanding of any subject. Instead of just asking for answers, try engaging an LLM in …

Ollama vs. vLLM: A Power-user's Perspective on LLM Serving

For the past 18 months, Ollama has been my go-to tool for running Large Language Models (LLMs). Its reliability and minimalist design, focusing on user experience, are truly commendable. Installation, configuration and model management are incredibly straightforward. However, the rise of …

Phishing is becoming more sophisticated with advances in generative AI. A capable attacker with enough of your personal data can do significant harm. This makes data security and privacy more important than ever. Fortunately, AI is also part of the solution, helping to detect and defend against these threats.

In December, OpenAI released an update for ChatGPT, supporting project folders, allowing users to group together chats and files. For many, it was a small but important update that helped them better organise their resources and conversations. However, for a small number of developers who had built symbiotic, complementary software …