Characteristics of Probability Distributions

• Distribution function– this is for the discrete case, the distribution function is thus denoted by F(x) and is expressed as

F(x) = P[X ≤ x ]

The distribution for the above function will be all follows:

For continuous case, the function distribution van be defined like,

F(x) = P[X ≤ x] = ʃ f(x) dx

Hence for the above example,

F(x) = ^x ʃ_-∞f(x) dx = ⁰ʃ_-∞f(x) dx + ^x ʃ₀ f(x) dx

= 0 + ^x ʃ₀ 1. dx = x

Properties:

Discrete case

1. P (a < X < b) = F (b) – F (a)
2. P (a ~ X <b) = P[X = a] + [F (b) – F (a)]

• P (a < X ~ b) = [F (b) – F (a)] – P[X = b]

1. P (a < X < b) = F (b) – F (a) + P [X = a] – P [X = b]

Continuous case

1. P (a < X < b) = P (a < X < b) = P (a < X ~ b) = P (a < X < b) = F (b) – F (a)
2. F (-_∞) = Lt _{x à-∞} F(x) = 0

F (∞) = Lt  _xà∞ F(x) = 1

• F(x) ->F(y) whenever x < y.

1. F (a) – F (a – 0) = P[x = a] and F (a + 0) = F (a)
2. For continuous case, F'(x) = j (x) ~ 0 => F(x) is non-decreasing function.

• Mean/expectation- consider X as a random variable. Then the mean/ expectation is defined as

µ = E [X] = Σ x.p (x)                                  (discrete case)

= ^∞ʃ –_∞x f(x) dx                  (continuous case)

It has got an exception which is known as the ‘Population mean’.

Properties:

1. E[X + Y] = E[X] + E[Y]

1. E [cX] = c E[X]

• E[c] = c and E [X + c] = E[X] + c

1. If X and Y are independent then E (XY) = E(X). EM

1. Physically, expectation signifies the center of mass of the probability distribution.

• Variance- it is the probability distribution expressed as below:

σ²= V[X] = Σ_x (x- µ) ² p(x)

   ₌^∞ʃ_{-∞ (x} – µ)²  f(x) dx

σ² = E [(X – µ)²] = E[X²] – {E[X]}²

= Σ_X x² . p(x) – µ²

= P (M₁/A)

P(M₁).P(A/M₁)

=  ———————————————————————–

P(M₁).P(A/M₁)+P(M₂).P(A/M₂)+P(M₃).P(A/M₃)

0.2 X 0.3

= ———————————————————————

0.2 X 0.03 + 0.45 X 0.05 + 0.34 X 0.04

= 0.14

Properties:

1. V[aX + b] = a2 V[X]

1. Physically the variance signifies the moment of inertia of the probability mass distribution in a line, perpendicular to the line of the distribution.

Example 1. For the following distribution

1. Find out the value of k
2. Calculate the mean and variance

• Find out the distribution function

Solution:

1. Since this is a pmj we have,

Σ p(x) = 1

= > 0.1 + k + 0.2 + 3k + 0.3

= > 4k + 0.6 = 1

= > 4k = 0.4

= > k = 0.1

1. µ = mean = Σ x. p (x)

= 1(0.1) + 2(0.1) + 3(0.2) + 4(0.3) + 5(0.3) = 3.6

σ2 = Variance = Σ (x – µ)² . p(x)

= (1 – 3.6) (0.1) + (2 – 3.6)2 (0.1) + (3 – 3.6)2 (0.2)+ (4 – 3.6f (0.3) + (5 – 3.6)2 (0.3)

=1.64.

• Distribution function is given below as follows:

Example 2:

Find out the mean, variance and distribution of the function pdf

f(x) = ax2, 0 .::;, x .::;, 1

= 0,      elsewhere.

Solution: since this is a pdf, then

^∞ʃ –_∞x f(x) dx = 1

=¹ʃ₀x f(x) dx = 1

=   a[ x³/ 3]¹₀ = 1

a = 3

So the pdf can be taken as

f(x) 3×2,           0 < x > 1

= 0, elsewhere

µ = mean = ¹ʃ₀ x f(x) dx = 3¹ʃ₀ x³dx = 3 [x⁴/4]¹₀ = ¾

σ2 = Variance =¹ʃ₀ (x- ¾)². 3x².dx

= 3/16 ¹ʃ₀ [16x⁴ – 24x³ + 9x²] dx

= 3/16 [16/5 – 24/4 + 9/3] = 3//80

Distribution function

= 3 ^xʃ₀ x² dx,0 ≤ x ≤ 1

=[x³    ,    0 ≤ x ≤ 1

[0     ,   elsewhere.

Moments and moment generating function:therth instant of the mean is defined as

µ_r = E[(X – µ)^r] = Σ_x (x – µ)^r. P[ X = x]

=^∞ʃ_-∞(x- µ)^r f(x) dx

Take a look at the discrete case now,

M_x (t) = Σ p_i e^t(x_i^{– t)} , where p(x) is expressed by P.

= Σ p_i [1 + t(x_i – a ) + t²/2! (x_i-a)²+….]

= Σ p_i + t Σ p_i (x_i – a) +  _t²/2!Σ p_i (x_i-a)²

= 1 + t µ’₁ + (t²/2!) µ’₂ + …………+ (t^r/r!) µ’₁+…..

So the µ’ = coefficient of t^r/r! in the expression mx(t).

On the other hand we have,

µ_r’ = [d’/dt’. M_x(t)]^t=0

Thus the relation of raw moments and central moments are like:

µ2 = µ’2 -µ2 = variance

µ4 = µ’₄ – 4µ’₃.µ + 6µ’₂ µ² – 3µ⁴

(Thus the moment that is acquired from a distribution (discrete/ continuous) is known as “population moments”)

Note. I. in case in the mgf if the point an absent, then it can be taken as zero.

2. A r.v. X will probably have no moments, in spite of mgf existing.

Example:

f(x) = 1/(x+1)(x+2),   x=0,1,2…… (The reader can verify)

3. A r.v. X can also have moments, in spite of its mgf is unsuccessful to produce the moments.

Example 3. The pdf of Rayleigh scattering is expressed as:

µ3 = µ‘3 – 3 µ‘2. µ + 2 µ3

f(x) = [x/a² exp (-x²– 2a²) x≥0

, x<0

Find out the distribution function, variance and mean.

Solution:

For x ≥ 0, ¹ʃ₀x/a² .exp (-x²/2a²)dx = ¹ʃ₀exp (-x²/2a²).d (x²/2a²)

= 1 – exp (-x²/2a²)

Distribution function – [^1-₀ exp (-x²/2a²), x ≥ 0

X < 0

µ = ¹ʃ₀(x²/2a²).exp (-x²/2a²)dx

Putting, (x²/2a²)=t , so xdx= a²dt

= a√2 ^∞ʃ₀e^-1 t^1/2 dt

= a√2 ^∞ʃ₀e^-1 t^3/2-1 dx

= a√2 √3/2

= a√2 ½

Now,  = µ = ¹ʃ₀ f(x)dx         (considering the point a=0)

Variance = µ’₂ – µ²

= 2a²a²/2

= (2-  a²

• Skewness and Kurtosis:

Skewness =ᵦ₁= µ₃²/ µ₂³

ɣ₁ = √ᵦ₁

For the symmetric scattering, ᵦ1 = 0. If ᵦ1 > 0 then the dispersion is known as positive skew.

ᵦ1 < 0 , in this case the distribution is known as a negative skew.

Kurtosis = ᵦ₂ = µ₄/µ₂,                     ɣ₂ = ᵦ₂ – 3

For, ᵦ₂ = 3 this type is called the platykurtic

ᵦ₂> 3 this type is known as mesokurtic

ᵦ₂< 3 this type is known as the leptokurtic

Example 4: a continuous random variable

f(x) = 3×2, 0 < x< 1

Beginning the calculation with the first four central moments,β₁ and β₂

µ’₁ = ¹ʃ₀x.f(x) dx = 3 ¹ʃ₀x³ dx = 3 / 4

µ’₂ = ¹ʃ₀x².f(x) dx = 3 ¹ʃ₀x⁴ dx = 3 /5

µ’₃ = ¹ʃ₀x³ f (x) dx = 3 ¹ʃ₀x⁵ dx = 1 / 2

µ’₄ = ¹ʃ₀x⁴.f(x) dx = 3 ¹ʃ₀x⁶ dx = 3 / 7

µ’₁ = µ₁ = 3 / 4 = 0.75

µ₂ = µ_’2 – ( µ₁)² = 3/5 – (3/4)² = 3 / 80 = 0.0375

µ₃ = µ’₃ – 3µ’₂. µ₁ + 2µ₁³

= 1 /2 – 3. 3 /5. ¾ +2 = – 1/160 = 0.00625

µ₄ = µ’₄– 4µ’₃. µ₁ + 6µ₂^’.µ₁² – 3µ₁⁴

3/ 7 – 4.1 /2.3+ 6.3/5.9/16 – 3.81/256

= 0.00435

So β1 = µ₃² / µ₂³ = (0.00625)² / (0.00375)³ = 3.09

So now, therefore β₁> 0, where the distribution is a skewed positive.

β2 = µ4 / µ22 = 0.00435/(0.0375)2 = 3.09

Since β2 > 3, the distribution is leptokurtic.

Example 5. Find out the moment producing function of the distribution given below.

P[X = x¹= q²p, x = 0, 1, 2, ….., 0 <p .:S 1, q = .1 – p

= 0, otherwise.

So calculate the the mean and variance.

Solution. The given arrangement is evidently a discrete distribution.

Mx (t) = E [ e^tx]

Σ^∞_x=0 e^tx q^x = p Σ^∞_x=0(e^t.q)^x

P (1-q^e. t¹)^-1

p/1-q^et, this is mgf

µ₁’ = [d/dt M(t)]_t=0

= [d/dt. p(1-qe^t)^-1]_t=0 = [p q e^t (1-q e^t)^-2] t=0

= pq (1-q)^-2 = pq/p² = p/q                                   (therefore, p=1-q)

µ₂’ = [d/dt M(t)]_t=0

pq [d/dt {e’(1-qe^t)^-2}]_t=0                             (taken from the previous part)

=  pq [ e^t ( 1- q e^t ) ^-2-2e^t(1-qe^t)^-3. (-q e^t)

=  pq[ (1 – q)^-2+ 2q(1 – qr)³] = .p/q + 2q²/p²

Mean = µ₁’= q/p

Variance =       µ₂ =  µ₂’- (µ₁’)² =q/p + 2q²/p² – q²/p²  =  q/p + q²/p²  =  pq + q²/q² = q/p³

• Mean Deviation (M.D.)

M.D. = ^∞ʃ_-∞ [x- µ] f(x)dx                                      (in case of continuous)

= Σ_x [x – µ]. P {X=x}                                          (in case of discrete)

• Median- The median is defined as the point that splits the whole distribution into two equal parts. In case ofpdf, the total portion is being parted into two equal halves by the median. Therefore after creation the solution we get the following:

^Mʃ_-∞ f(x)dx= ½  or ^∞ʃ_M f(x)dx= ½

(h) Mode. Mode can be defined as the value of x, where f(x)carries the maximum value and is expressed likef'(x) = 0, f “(x) < 0. This lies in the interlude of the arrangement.

(i) Quartiles. In pdf, the quartiles Q1 and Q3 are expressed as following

^Q₂ʃ_-∞ f(x)dx= 1/4  and  ^∞ʃ_Q3 f(x)dx= 1/4

Note: now let’s take a look on a couple of special probability

(i)  There remains achance that a specific magnitude (K) might exceed up to, P[X > K] = p0 and this isknown as the ‘Exceedance Probability’.

(ii) Median Exceedance Probability can be well explained as the value that exceeds 50 in a example of evaluations of the exceedance probability of certain specific magnitude.

Example 6.Find the median for the arrangement shown below.

 f(x) = 3x²,         0 <x <1.

 Solution. Let us assume M as the median, then

f(x) dx = 1/2

3 x²dx = 1/2

= 1/2

M² =1/2  =  M  =  (1/2)^1/3 =  0.079

Example 7. Find outthe mean deviation of the distribution given below.

Solution. Here in this problem we se,           µ =  Σp(x)

=  0 + 1(0.3) + 2(0.4) + 3(0.1) + 4(0.1)

= 0.3 + 0.8 + 0.3 + 0.4 = 1.8

Hence,             M.D  = Σ| x-µ | p(x)

= 0 – 1.8 . 0 +  l – 1.8  (0.3) +  2 – 1.8  (0.4) +  3 – 1.8   (0.1)  +  4 – 1.8    (0.1) = 0.66.

Example 8. Find out the quartiles of the following:

f(x) = 3×2, 0 <x < 5. 1.

Solution.  For lower quartile, ^Q2ʃ₀ f(x)dx= 1/4

^Q2ʃ₀ x²dx= 1/4

[ x³]^Q1₀ = 1/4

Q₁³ ¼ = q₁ =(1/4)^1/3

For upper quartile,  3.  ¹ʃ_Q3 x² dx= 1/4

[ x³]¹_Q3 = 1/4

1-Q³₃  =  1/4    =  Q³₃  =  3/4   =  Q₃ (3/4)^1/3 

PROBLEMS

1. A random variable X consists of the distribution as given below

(a) Calculate the value of k.

(b) Find out the mean and variance.

(c) Evaluate the mean deviation.

(d) solve:  P(l <  x <  S 3), P(x > 1).

2. The probability distribution as given below:

(i) Find the value of a.

(ii) Calculate the distribution function.

(iii} evaluate the mean and variance.

(iv) Solve P(X<4), P(2 < X < 5).

3. A random variable X has the probability distribution:

Find out the first four central moments.

4. Assume the probability distribution given below:

        f(x) = kx,                                      O<x<l

(a) Calculate the value of k.

(b) Bring out the mean and variance.

(c) Solve to find the median, Q1 and Q3

5. The Maxwell-Boltzmann distribution is given below:

f(x) = 4a. x2 e^-ax2 ,           0< x < ∞ ,a > 0

 In the above expression, a = m/2kT, m = Mass, T = Temperature (K), k = Boltzmann constant and x = Speed of a gas molecule.

(a) Now prove that this is a pdf.

(b) Determine the mean and variance.

6. The range of a random variable namely X contains of the points I, 2, …, up to nprovided information is P[X = i] is proportional to 1/ i(i+1). Now evaluate the distribution function of x. Calculate P[3 < X S n] and P[X > 5].

7. Three balls are taken out randomly without replacement from acontainerwhich consists of 4 red and 6 white balls. Now let’s consider X as a random variable which indicates the total number of red balls taken out from the container, then draw a table that represents the probability distribution of X. calculate the expectation also.

8. Calculate the estimated value and variance of the number of times the heads appears when two coins are tossed.

9. Let the probability density function be

f(x) = 0.5 (x + 1),                                 -1 < x <1

= 0, elsewhere

Now evaluate the (i) Mean,   (ii) Median,     (iii) Q₁,       (iv)Q_3,        (v) β_1,            (vi) β²       (vii) Distribution function.

10. Calculate the mgf of the following:

(i)     F(x) = 1/b-a,           a <x <b

= 0,                 elsewhere.

(ii)                 p(x) = e^{– λ} λ^x /x  ,    x  =  0,1, 2….

Hence find the mean and variance in (ii).

11. In a delivery of 7 items there were three defective items. Then random 4 items were selected. Then find out the expected number of defective items?

12. The diameter of an electric cable wasexpected to be anuninterrupted random variable X with pdf

f(x) = 6x(1 – x), 0 <x < 1.

Calculatebsuch that P[X <b] = P[X >b].

ANSWERS

1. (a)   0.2

(b)   1.1, 1.69

(c)  1.1

(d)    0.7, 0.5.

2    (i) a = 0.1

(iii) 3.9, 2.89

(iv)0.4, 0.2

3   µ¹, = 0, µ2 = 2.24, µ3 = -1.75, µ4 = 9.03

4. (a) 2,

(b) 2/3, 1/18

8. Expected value = 1, · Variance= 1/2
9. (I) 0.33, (ii) 0.414, (iii) 0, (iv) 0.732, (v) 0.3172, (vi) 2.4,

(vii) F (x) = ¼ (x+1)², -1≤x≤1

=0, elsewhere

11.12/7

12.b=1/2

Links of Previous Main Topic:-

• Introduction to statistics
• Knowledge of central tendency or location
• Definition of dispersion
• Moments
• Bivariate distribution
• Theorem of total probability addition theorem
• Random variable

Links of Next Statistics Topics:-

• Binomial distribution
• What is sampling
• Estimation
• Statistical hypothesis and related terms
• Analysis of variance introduction
• Definition of stochastic process
• Introduction operations research
• Introduction and mathematical formulation in transportation problems
• Introduction and mathematical formulation
• Queuing theory introduction
• Inventory control introduction
• Simulation introduction
• Time calculations in network
• Introduction of game theory