Temperature is a value that controls how predictable or creative an LLM's output is

Transformer architecture can recognize and predict patterns in language

The underlying software powering text generation in AI tools associates each word or subword—called a token—with a set of values corresponding to how often it appears near other tokens. By recognizing these associations in prompts, the LLM can infer meaning.

LLMs are the backbone of AI tools that process and generate natural language

Large language models identify patterns in massive datasets of books, code, and unlabeled text from which to generate coherent responses. GPT-3 was trained on about 45 terabytes of data and uses 175 billion parameters—each parameter being a value the model adjusts as it learns.

LLMs are trained via modeling, imitation learning, and reinforcement learning

Training large language models begins with pretraining the model to predict the next word in a sequence based on finding patterns in massive amounts of text. Patterns are then fine-tuned to model human-written dialogue and to align responses with user preferences.

Visualize how transformer architecture generates a large language model's outputs by running words and subwords assigned to specific numbers through multiple rounds of mathematical processing.

Anthropic's interpretability team discusses how AI models' thinking mimics biology

Just as humans engage in complex behaviors to survive and reproduce, teams of experts in neuroscience, virology, mathematics, and other disciplines argue that large language models develop complex mechanisms to achieve their goals. These mechanisms can be manipulated to assess how they modify outputs—much like stimulating individual neurons—to uncover how LLMs "think."

LLMs explained simply and quickly

Large language models generate responses by predicting one token at a time, based on patterns they’ve learned from massive datasets. This explainer covers their core components: data, architecture, training, and how transformer models use context to simulate conversation.

Find out how important you are to AI tools when they generate text responses with this tool, which estimates the weights of people's names.

Explore rankings of large language models

The SEAL LLM Leaderboards provide benchmarks for LLMs by assessing them against agentic, frontier, and safety tasks, providing insights into each model's strengths, deficiencies, and failures.

Tokens—numbers assigned to words and subwords—are the basic units of data that AI tools process to generate outputs that mimic language without understanding the text itself.

Understanding the 1.5 degree Celsius climate benchmark

As more parts of the world are facing extreme weather, from high temperatures to increased natural disasters, there is much debate about what can be done. MIT News explores and explains the 1.5-degree benchmark for limiting the effects of climate change. Read to understand where the planet stands in relation to this threshold and what can be done at the global, regional, and personal levels to “keep 1.5 alive.”

Feels-like temperature indicates how our skin will feel

When the wind is moving faster, we tend to feel colder due to the so-called "wind chill," which cools our bodies by moving heat away from them and making water evaporate faster. On the other hand, high levels of humidity can make us feel 10 degrees warmer at times.

AI models incorporate a randomness parameter when generating responses to prompts

AI models use this parameter to prevent repeated outputs by sometimes choosing less likely next words during sequential generation. However, this randomness—alongside insufficient data and training—may cause hallucinations of incorrect results.

Chaos theory—informally known as the butterfly effect—is the reason why weather forecasts are presented with probabilities rather than certainties.

Extreme temperature resilience appears to be temporary for tardigrades

Although often considered indestructible, scientists observed these creatures could endure temperatures near 150°C for only a few minutes in their tun state. Outside this state, only half the samples in a Danish study survived 37.1 degrees Celsius (98 degrees Fahrenheit) for 24 hours, making tardigrades extremotolerant rather than extremophiles.

Computational and biological systems share fundamental principles, like randomness

Proposed by Alan Turing and John von Neumann, the concept originates from how DNA and computers run by executing encoded instructions in parallel. The advent of AI and the temperature parameter has seen neural networks mimic the randomness of protein encoding.

How ChatGPT learns to read

The introduction of ChatGPT last fall jumpstarted public interest in the future capabilities of artificial intelligence and what it means for society. Of many somewhat "jargony" terms thrown around, the phrase "Large Language Model" is commonly seen—but also incredibly unclear as to what it means. In the simplest sense, the programs comb through mountains of internet data in response to a question and guess at what should come next (subscription needed).

Trick a large language model into revealing secret passwords over multiple rounds, each with increasing safeguards.

Generative AI tools excel at pattern recognition, not contextual accuracy

Large language models are trained on vast amounts of unstructured data, from which they develop parameters for grammar and associations between words. These connections can introduce errors due to inapplicable reasoning when used on new data in unfamiliar contexts.

Large language models struggle to play video games, despite coding them easily

As of 2025, given clear tasks, specific feedback, and test results to learn from, LLMs have been successful at coding simple video games that resemble pre-existing ones. However, given the variety of games, the lack of training datasets, and the need for spatial awareness, which LLMs find challenging, some of these models experience greater difficulty navigating and "winning" games.

EOS and maximum length tokens tell an LLM when to stop generating a response

Tokens are words or subwords (e.g., prefixes) that a large language model processes to generate a response. During training, the model is taught that if it ever generates a special token called end-of-sequence, its response is complete.

Understanding how Claude Code and other AI coding agents function

Under human oversight, a supervising large language model interprets user tasks and delegates work to subordinate LLMs, which can generate code, fix bugs, and run tests, often most effectively for proofs of concept. Incremental backups and versioning are crucial when using such agents, which can lose details during their work as a result of compressing context history to work around memory limitations.

Everything with a temperature above absolute zero emits light at nearly all wavelengths

Thermal radiation results from random motions of particles that make up an object, which only theoretically cease at 0 Kelvin, or -273.15 degrees Celsius. The greatest intensity of thermal radiation, also known as blackbody radiation, is emitted at a characteristic wavelength corresponding to the object's surface temperature.

Geothermal power can be used beyond heating and energy production

Depending on the depth of the natural vents or artificial wells drilled, the surrounding fluid temperature will vary greatly—from 10 to 371 degrees Celsius (50 to 700 degrees Fahrenheit)—allowing for various applications, including the drying of cement, concrete, and lumber, as well as the processing of pulp and paper.

Fevers are an immune response to create hurdles for pathogens

Substances called pyrogens prompt the brain to raise the body temperature to levels where bacteria and viruses struggle to survive. The higher temps also support immune cells fighting off the invaders.

What's the difference between weather and climate?

A five-minute TedEd video exploring the differences between weather and climate – what they are, how we predict them, and what those predictions can tell us.

Viscosity is a fluid's resistance to flow, which varies with temperature

Liquids become less viscous as temperature increases, while gases become more viscous and therefore flow more slowly. The increased gas collisions at higher temperatures contribute to greater friction between streamlines, increasing viscosity.

Lasers can be used to reduce the motion of atoms because particles of light—photons—can collide with particles of matter, as billiard balls do, to slow them down.

The top several meters of the world's oceans can hold as much thermal energy as the entire atmosphere.

Climate models use complex equations and supercomputers to predict future climate

The equations apply the laws of thermodynamics, fluid motion, and radiative transfer to a 3D grid along Earth's surface. After solving them for each cell in the grid over a time interval, the results carry over to neighboring cells, and the process repeats into the future.

How 'vibes' factor into scientists' decisions about using certain units

Although there are absolute quantities from which units can be defined, such as the speed of light and the corresponding light year for distance, the usefulness of units comes from their ability to easily communicate values, rather than how fundamental their origins are. For example, while Kelvin measures absolute temperature, Celsius is scaled to the temperatures of boiling and freezing water, making them more practical for everyday usage.

AI tools that generate images, audio, video, and 3D models rely on diffusion models, which begin with random data, such as visual noise, and gradually refine it into the requested media.

Explore how temperatures compare to historical averages in cities worldwide with this interactive global monitor.

Normal body temperature varies from one person to another; it's not uniformly 98.6 F, as physician Carl Wunderlich determined in the 1800s.

Visualizing changes in ocean temperatures between 2016 and 2020

How much does the temperature of the sea change in a given year? This visualization helps illustrate the changes by showing sea surface temperature data from January 2016 through March 2020. Sea surface temperature, which refers to water temperature at the sea's surface, plays a significant role in climate and weather.

Under certain conditions, very hot liquids can freeze more quickly than cooler ones—a phenomenon called the Mbemba effect, after the Tanzanian high school student who accidentally observed it.

Research suggests AI data centers may be creating microclimate heat islands

An analysis of satellite data from 2004 to 2024 showed that land surface temperatures in the areas surrounding AI data centers typically increase by an average of 2 degrees Celsius (3.6 degrees Fahrenheit) after they begin running. Across the 6,000 global data centers analyzed by the study, temperatures increased by as much as 9.1 degrees Celsius (16.4 degrees Fahrenheit).

Why do you shiver when cold?

Humans are warm-blooded creatures, so our bodies like to maintain internal temperatures separate from and typically above those in their environment. This is made possible by a process known as thermoregulation. When the brain's hypothalamus senses a drop in the body's core temperature, skeletal muscles may be ordered to shiver, sending out waves of muscle contractions and exothermic biochemical reactions whose byproduct includes heat and energy.

Accurate climate models incorporate calculus to account for complex feedback loops

The simplest models assume uniformity across the Earth, with incoming energy from the sun being offset by the planet's albedo, or reflectiveness, which prevents the radiation from being fully absorbed. Incorporating elements such as atmospheric layers, latitude bands, geographic variability, and emissivity yields coupled differential equations quantifying Earth's interconnected systems.

Our bodies cool us down by sweating because water requires a significant amount of energy to change state from liquid to gas, making it an ideal medium for carrying thermal energy away from our bodies.

Clouds' subtle climate effects require significant computational power to simulate

Responsible for reflecting sunlight and preventing thermal energy from entering the Earth system while also trapping energy and keeping it in the system, clouds are understood to substantially influence climate predictions. Because even supercomputers struggle to accurately model their dynamic behavior, researchers have used AI to indirectly incorporate clouds into climate models.

View thermophiles found in Hot Springs National Park, including nanobacteria and ostracods

Most organisms in this subset of extremophiles live at temperatures between 60 and 80 degrees Celsius (140 to 176 degrees Fahrenheit), which is hot enough to unfold proteins needed for most biochemical reactions. In thermophiles, these molecules, including those needed to replicate DNA during cellular division, are tightly packed and held by stronger bonds to resist changes in shape.

Heatstroke can reprogram your DNA, putting survivors at risk of future health problems.

Machine learning lets computers learn from data instead of relying on programming

ML is a core part of artificial intelligence and is foundational to applications like chatbots, fraud detection, and self-driving cars. Businesses are also adopting it to improve efficiency and identify patterns in data, though the latter may be inaccurate.

Most fungal pathogens can't survive the heat of our bodies.

Large language models are examples of foundation models

Such models are trained on massive amounts of data, which enable them to perform a variety of tasks, rather than being provided task-specific data to complete a narrow function. Such models come with high compute costs and potential trust issues due to the nature of their unorganized training data.

Because they are built on content produced by humans, who possess biases, generative AI tools inherit prejudices and stereotypes from training data, which later appear in their outputs.

Understanding why the thermosphere feels cold, despite exceeding 2,000 degrees Celsius

High-energy solar radiation can raise temperatures above 2,000 degrees Celsius (3,632 degrees Fahrenheit), but the air density in this layer is so low that there would be insufficient collisions between energized molecules and a person's skin to cause them to experience this warmth. Variations in the level of solar radiation reaching the layer cause it to swell and shrink.

Neural networks are modeled after an idealization of the brain

These networks—including the backbone of ChatGPT-3, which has approximately 175 billion parameters—naturally discover the implicit rules of grammar and syntax within language by identifying patterns. Deviations in word patterns add creativity to the text generation.

View the 55 ECVs used to describe Earth's atmospheric conditions

Essential climate variables include physical, chemical, and biological variables that meaningfully contribute to Earth's climate and how it changes with time. Many of these variables influence one another through feedback mechanisms across Earth's atmosphere, hydrosphere, cryosphere, biosphere, and geosphere.

The field of attribution science seeks to determine whether specific phenomena, such as melting glaciers, droughts, and hurricanes, are driven by Earth's natural climate cycles or by human-caused climate change.