STAT314-14S2 (C) Semester Two 2014

Bayesian Inference

15 points

Details:
Start Date: Monday, 14 July 2014
End Date: Sunday, 16 November 2014
Withdrawal Dates
Last Day to withdraw from this course:
  • Without financial penalty (full fee refund): Friday, 25 July 2014
  • Without academic penalty (including no fee refund): Friday, 10 October 2014

Description

This course explores the Bayesian approach to statistics by considering the theory, methods for computing Bayesian solutions, and examples of applications.

STAT314 and STAT461 introduce the Bayesian approach to Statistics using elementary parametric models and inference problems. Usually, these are the Bernoulli, Poisson, normal and linear regression models used in problems such as parameter estimation, hypothesis testing, model selection and prediction. Some comparisons with results from the frequentist approach, will be made to illustrate similarities and differences between the two approaches.

Topics that are usually covered include:

• foundations of Bayesian Statistics: Treating parameters as random variables, prior information about parameters, Bayes’ theorem for combining information
• prior distributions: Conjugate priors including conjugate mixtures, objective priors such as the flat prior, Jeffreys’ prior and Zellner’s prior
• bayesian estimation: Deriving the posterior distribution using Bayes’ theorem, credible intervals such as the highest posterior density interval and equal-tail interval
• bayesian testing of composite hypotheses using a posterior distribution
• bayesian model selection: Bayesian testing as a special case of model selection, prior and posterior model probabilities, Bayes factors, difficulties with use of improper prior distributions for model selection, use of the deviance information criterion
• posterior predictive distributions for inference about future observations.
• tools for computing Bayesian solutions such as numerical integration, Monte Carlo integration and Markov chain Monte Carlo

Statistical computations will be performed using the R software but students do not need to know R beforehand.

STAT461 students attend the same lectures and computer labs as STAT314 but will be assigned additional readings and assessment.

Students who have done or are doing STAT314 cannot do STAT461.

Learning Outcomes

  • Through this course, you will be able to do the following for common parametric models:

  • elucidate the similarities and differences between Bayesian and frequentist statistics
  • find a conjugate prior distribution or an objective prior distribution
  • derive a posterior distribution for a given prior distribution and check that the posterior distribution is a proper distribution
  • obtain point estimates and interval estimates from a posterior distribution.
  • test composite hypotheses using a posterior distribution
  • evaluate posterior model probabilities, Bayes factors and the deviance information criterion, and use them for hypothesis testing or model selection
  • derive a posterior predictive distribution and use it to infer about future observations

Prerequisites

One of the following: 1) (MATH103 or MATH199 or EMTH119) and (15 points at 200-level MATH or STAT (or other quantitative 200 level courses by approval of the Head of School)); 2) STAT211 or STAT213 or STAT221.

Course Coordinator

Nuttanan Wichitaksorn

Assessment

Assessment Due Date Percentage 
Attendance and Class Participation 10%
Continual Internal Assessment 30%
Assignment 10%
Test 1 25%
Test 2 25%


There will be two lectures and one computer lab per week for this course. Attendance at lectures and computer labs is mandatory because supervised instruction is essential for understanding the course material.

The continual assessment consists of a series of exercises that must be submitted at specified times throughout the course. These exercises and their timings are designed to help you keep up with the course material. They also allow the lecturer to monitor progress and to provide assistance in a timely manner when needed.

There will be two tests, one at the end of each term, but no final exam.

The assignment is for STAT314 while the project is for STAT461. Further information for assignment and project will be provided within Term 3.

Textbooks / Resources

Course materials will be provided and no textbook is needed. After enrolling in the course, you will be able to access materials from the course web page in Learn at: http://www.learn.canterbury.ac.nz/

Students who have not used the R software before can refer to the following e-book available from the UC Library:

A Beginner’s Guide to R, by Zuur, Ieno and Meesters (Springer, 2009).

Indicative Fees

Domestic fee $672.00

International fee $3,388.00

* All fees are inclusive of NZ GST or any equivalent overseas tax, and do not include any programme level discount or additional course-related expenses.

For further information see Mathematics and Statistics .

All STAT314 Occurrences

  • STAT314-14S2 (C) Semester Two 2014