It’s not Google’s largest language model, but the company claims PaLM is its most advanced.
Getty Images
“Roger has five tennis balls. He buys two more cans of tennis balls. Each can has three tennis balls. How many tennis balls does he have now?”
For you, this may have triggered stress-flashbacks to grade-school math quizzes. But for Google’s brand-new large language model, it’s a key part of training.
This week, Google introduced the Pathways Language Model (PaLM), its new AI tool designed to answer questions, reason through arithmetic questions, and even explain jokes. According to Google’s performance report, it may be the most advanced model of its kind on a number of benchmarks, including tasks in reasoning and logical inference.
Quick recap: Large language models (LLMs) are an increasingly popular—and controversial—AI tool used for all things natural language processing (think: summarizing text, participating in dialogue, writing articles, and more).
With 540 billion parameters, Pathways isn’t Google’s largest language model—the company’s 1.6-trillion-parameter model, announced last year, owns that spot. But PaLM is a headliner in other ways, performing better than comparable LLMs (think: GPT-3 and LaMDA) in reasoning tasks, multi-step arithmetic, and multilingual tasks like translation.
And when given a string of emojis, the model can also guess the movie title from a multiple-choice list (🤖🪳🌱🌎 = WALL-E) and explain a niche tech joke (the punch line: a group of TPU computer chips and a group of whales are both known as a pod).
Big picture: With great model size comes great responsibility. It’s important to note that LLMs tend to propagate human bias, which can harm vulnerable populations. For its part, Google provides some risk analysis for PaLM, including a data sheet, model card, and responsible AI benchmark results.
Last year, the company fired two top AI ethics researchers after they wrote a paper about the dangers of large language models, though Google disputes this account. That very same paper is cited by Google in its research on PaLM.—HF