← Back to CoursesStatistics: PhD Level

Neuroanatomy Explorer

Drag to rotate · scroll to zoom · click regions to explore

View
Loading 3D model…

Click a region
to explore it

Memory Deck

Flip each card and rate whether you knew it. Your score is saved.

Term
Definition

Deck complete — score saved.

Match the Pairs

Match each term to its definition. Finish the board to earn your score.

All matched — score saved.

Concept Constellation

Every key idea in this course, mapped as an explorable 3D constellation. Drag to rotate, scroll to zoom, click a node.

Click a node to read its definition.

Bayesian Inference and Decision Theory

Manual: General · Subject: Statistics

Explore Bayesian updating, posterior computation, and the decision-theoretic foundations of inference.

Bayesian Updating

Posterior distribution

Bayesian inference combines prior belief π(θ)\pi(\theta) with likelihood p(x∣θ)p(x\mid\theta) to obtain the posterior π(θ∣x)∝p(x∣θ)π(θ)\pi(\theta\mid x) \propto p(x\mid\theta)\pi(\theta). The posterior is the basis for estimation, prediction, and uncertainty quantification.

Posterior summaries

Common summaries include the posterior mean, median, mode, credible intervals, posterior predictive distributions, and Bayes factors. The choice of summary depends on the decision problem and loss function.

🔑

Decision-theoretic framing

A Bayesian decision rule minimizes posterior expected loss, not merely posterior variance or posterior entropy.

Loss functions and optimal decisions

Risk

For action aa and parameter θ\theta, the loss is L(a,θ)L(a,\theta). The posterior expected loss is ρ(a∣x)=E[L(a,θ)∣x]\rho(a\mid x)=\mathbb{E}[L(a,\theta)\mid x]. The Bayes action minimizes ρ(a∣x)\rho(a\mid x).

Under squared error loss, what posterior summary is Bayes-optimal?

What is a credible interval?

Computation and modern Bayesian methods

Approximate inference

Exact posteriors are often intractable. Markov chain Monte Carlo, variational inference, Laplace approximation, expectation propagation, and sequential Monte Carlo are central computational tools.

Method comparison

MCMC
Asymptotically exact, often slower and harder to diagnose.
Variational inference
Fast optimization-based approximation, often underestimates posterior uncertainty.
Laplace approximation
Second-order local Gaussian approximation near the posterior mode.
SMC
Useful for sequential data and online updating.

Which method typically converts posterior inference into an optimization problem?

Why is a Bayes factor used cautiously in practice?