Regular conditional probability

Regular conditional probability is a concept that has developed to overcome certain difficulties in formally defining conditional probabilities for continuous probability distributions. It is defined as an alternative probability measure conditioned on a particular value of a random variable.

Contents

• 
  1 Motivation
  


• 
  2 Definition
  


• 
  3 Alternate definition
  


• 
  4 Example
  


• 
  5 See also
  


• 
  6 References
  


• 
  7 External links
  

Motivation

Normally we define the conditional probability of an event A given an event B as:

P(A|B)=P(A∩B)P(B).{displaystyle P(A|B)={frac {P(Acap B)}{P(B)}}.}

The difficulty with this arises when the event B is too small to have a non-zero probability. For example, suppose we have a random variable X with a uniform distribution on [0,1],{displaystyle [0,1],} and B is the event that X=2/3.{displaystyle X=2/3.} Clearly, the probability of B, in this case, is P(B)=0,{displaystyle P(B)=0,} but nonetheless we would still like to assign meaning to a conditional probability such as P(A|X=2/3).{displaystyle P(A|X=2/3).} To do so rigorously requires the definition of a regular conditional probability.

Definition

Let (Ω,F,P){displaystyle (Omega ,{mathcal {F}},P)} be a probability space, and let T:Ω→E{displaystyle T:Omega rightarrow E} be a random variable, defined as a Borel-measurable function from Ω{displaystyle Omega } to its state space (E,E).{displaystyle (E,{mathcal {E}}).} Then a regular conditional probability is defined as a function ν:E×F→[0,1],{displaystyle nu :Etimes {mathcal {F}}rightarrow [0,1],} called a "transition probability", where ν(x,A){displaystyle nu (x,A)} is a valid probability measure (in its second argument) on F{displaystyle {mathcal {F}}} for all x∈E{displaystyle xin E} and a measurable function in E (in its first argument) for all A∈F,{displaystyle Ain {mathcal {F}},} such that for all A∈F{displaystyle Ain {mathcal {F}}} and all B∈E{displaystyle Bin {mathcal {E}}}^[1]

P(A∩T−1(B))=∫Bν(x,A)P(T−1(dx)).{displaystyle P{big (}Acap T^{-1}(B){big )}=int _{B}nu (x,A),P{big (}T^{-1}(dx){big )}.}

To express this in our more familiar notation:

P(A|T=x)=ν(x,A),{displaystyle P(A|T=x)=nu (x,A),}

where x∈suppT,{displaystyle xin mathrm {supp} ,T,} i.e. the topological support of the pushforward measure T∗P=P(T−1(⋅)).{displaystyle T_{*}P=P{big (}T^{-1}(cdot ){big )}.} As can be seen from the integral above, the value of ν{displaystyle nu } for points x outside the support of the random variable is meaningless; its significance as a conditional probability is strictly limited to the support of T.

The measurable space (Ω,F){displaystyle (Omega ,{mathcal {F}})} is said to have the regular conditional probability property if for all probability measures P{displaystyle P} on (Ω,F),{displaystyle (Omega ,{mathcal {F}}),} all random variables on (Ω,F,P){displaystyle (Omega ,{mathcal {F}},P)} admit a regular conditional probability. A Radon space, in particular, has this property.

See also conditional probability and conditional probability distribution.

Alternate definition

Consider a Radon space Ω{displaystyle Omega } (that is a probability measure defined on a Radon space endowed with the Borel sigma-algebra) and a real-valued random variable T. As discussed above, in this case there exists a regular conditional probability with respect to T. Moreover, we can alternatively define the regular conditional probability for an event A given a particular value t of the random variable T in the following manner:

P(A|T=t)=limU⊃{T=t}P(A∩U)P(U),{displaystyle P(A|T=t)=lim _{Usupset {T=t}}{frac {P(Acap U)}{P(U)}},}

where the limit is taken over the net of open neighborhoods U of t as they become smaller with respect to set inclusion. This limit is defined if and only if the probability space is Radon, and only in the support of T, as described in the article. This is the restriction of the transition probability to the support of T. To describe this limiting process rigorously:

For every ϵ>0,{displaystyle epsilon >0,} there exists an open neighborhood U of the event {T=t}, such that for every open V with {T=t}⊂V⊂U,{displaystyle {T=t}subset Vsubset U,}

|P(A∩V)P(V)−L|<ϵ,{displaystyle left|{frac {P(Acap V)}{P(V)}}-Lright|<epsilon ,}

where L=P(A|T=t){displaystyle L=P(A|T=t)} is the limit.

Example

To continue with our motivating example above, we consider a real-valued random variable X and write

P(A|X=x0)=ν(x0,A)=limϵ→0+P(A∩{x0−ϵ<X<x0+ϵ})P({x0−ϵ<X<x0+ϵ}),{displaystyle P(A|X=x_{0})=nu (x_{0},A)=lim _{epsilon rightarrow 0+}{frac {P(Acap {x_{0}-epsilon <X<x_{0}+epsilon })}{P({x_{0}-epsilon <X<x_{0}+epsilon })}},}

(where x0=2/3{displaystyle x_{0}=2/3} for the example given.) This limit, if it exists, is a regular conditional probability for X, restricted to suppX.{displaystyle mathrm {supp} ,X.}

In any case, it is easy to see that this limit fails to exist for x0{displaystyle x_{0}} outside the support of X: since the support of a random variable is defined as the set of all points in its state space whose every neighborhood has positive probability, for every point x0{displaystyle x_{0}} outside the support of X (by definition) there will be an ϵ>0{displaystyle epsilon >0} such that P({x0−ϵ<X<x0+ϵ})=0.{displaystyle P({x_{0}-epsilon <X<x_{0}+epsilon })=0.}

Thus if X is distributed uniformly on [0,1],{displaystyle [0,1],} it is truly meaningless to condition a probability on "X=3/2{displaystyle X=3/2}".

See also

• Conditioning (probability)


• Disintegration theorem


• Adherent point


• Limit point

References

1. 
   ^ D. Leao Jr. et al. Regular conditional probability, disintegration of probability and Radon spaces. Proyecciones. Vol. 23, No. 1, pp. 15–29, May 2004, Universidad Católica del Norte, Antofagasta, Chile PDF
   

External links

• 
  Regular Conditional Probability on PlanetMath
  

This page is only for reference, If you need detailed information, please check here