Tendem
Mini toolsPaLM
By Google LLC
Text
Gen 2
Overview
PaLM is Google’s Pathways Language Model, a large decoder-only Transformer built to scale across thousands of TPUs. It delivers strong few-shot reasoning, multilingual ability, and coding, and it popularized chain-of-thought prompting in large production models.
Description
PaLM introduced Google’s Pathways era of training, where one model can be trained efficiently across many accelerators and generalize across tasks. The model is a high-capacity, dense Transformer trained on a broad mix of web, books, code, and multilingual text. It excels at few-shot learning, long-form answers, math and logic with chain-of-thought prompting, and code generation through PaLM-Coder variants. Engineering advances included large-batch optimization, memory-efficient sharding, and robust data filtering, which enabled stable training at unprecedented scale. In practice, PaLM served as the foundation for research and product lines that followed, influencing techniques for reasoning prompts, multilingual transfer, and code-focused fine-tunes, and setting the stage for successors like PaLM 2 and later Gemini models.
About Google LLC
At Google, we think that AI can meaningfully improve people's lives and that the biggest impact will come when everyone can access it.
View Company Profile
Last updated: October 14, 2025
