包含Cauchy位置, 局部最大值和甲虫数据模型三个部分
Exercises
3.5.1 Cauchy with unknown location.
Consider estimating the location parameter of a Cauchy distribution with a known scale parameter. The density function is
Let
be a random sample of size
and
the log-likelihood function of
based on the sample. – Show that
where
is the Fisher information of this sample. – Set the random seed as
and generate a random sample of size
with
. Implement a loglikelihood function and plot against
. – Find the MLE of
using the Newton–Raphson method with initial values on a grid starting from
to
with increment
. Summarize the results. – Improved the Newton–Raphson method by halving the steps if the likelihood is not improved. – Apply fixed-point iterations using
, with scaling choices of
and the same initial values as above. – First use Fisher scoring to find the MLE for
, then refine the estimate by running Newton-Raphson method. Try the same starting points as above. – Comment on the results from different methods (speed, stability, etc.).
3.5.2 Many local maxima
Consider the probability density function with parameter
:
A random sample from the distribution is
x <- c(3.91, 4.85, 2.28, 4.06, 3.70, 4.04, 5.46, 3.53, 2.28, 1.96,
2.53, 3.88, 2.22, 3.47, 4.82, 2.46, 2.99, 2.54, 0.52)
- Find the the log-likelihood function of
based on the sample and plot it between
and
.
- Find the method-of-moments estimator of
. That is, the estimator
is value of
with
where
is the sample mean. This means you have to first find the expression for
.
- Find the MLE for
using the Newton–Raphson method initial value
.
- What solutions do you find when you start at
and
?
- Repeat the above using 200 equally spaced starting values between
and
. Partition the values into sets of attraction. That is, divide the set of starting values into separate groups, with each group corresponding to a separate unique outcome of the optimization.
3.5.3 Modeling beetle data
The counts of a floor beetle at various time points (in days) are given in a dataset.
beetles <- data.frame(
days = c(0, 8, 28, 41, 63, 69, 97, 117, 135, 154),
beetles = c(2, 47, 192, 256, 768, 896, 1120, 896, 1184, 1024))
A simple model for population growth is the logistic model given by
where
is the population size,
is time,
is an unknown growth rate parameter, and
is an unknown parameter that represents the population carrying capacity of the environment. The solution to the differential equation is given by
where
denotes the population size at time
.
- Fit the population growth model to the beetles data using the Gauss-Newton approach, to minimize the sum of squared errors between model predictions and observed counts.
- Show the contour plot of the sum of squared errors.
- In many population modeling application, an assumption of lognormality is adopted. That is , we assume that
are independent and normally distributed with mean
and variance
. Find the maximum likelihood estimators of
using any suitable method of your choice. Estimate the variance your parameter estimates.

EasyDue™ 支持PayPal, AliPay, WechatPay, Taobao等各种付款方式!
E-mail: easydue@outlook.com 微信:easydue
EasyDue™是一个服务全球中国留学生的专业代写公司
专注提供稳定可靠的北美、澳洲、英国代写服务
专注提供CS、统计、金融、经济、数学等覆盖100+专业的作业代写服务