Module 3: Probability Concepts

Supporting Lectures:
EGN3443 Module 3 - Probability Distributions

1. Basic Probability Axioms and Rules

Definition

Probability is a mathematical measure of the likelihood of an event occurring, ranging from 0 (impossible) to 1 (certain).

Fundamental Axioms of Probability

1. Non-negativity Axiom: Probability of any event is non-negative
   
   

   • P(A) ≥ 0 for any event A

2. Totality Axiom: Probability of the entire sample space is 1
   
   

   • P(Ω) = 1, where Ω represents the sample space

3. Additivity Axiom: Probability of mutually exclusive events can be added
   
   

   • For mutually exclusive events A and B: P(A ∪ B) = P(A) + P(B)

Probability Calculation Example

Consider a fair six-sided die:

• Probability of rolling a 3: P(3) = 1/6

• Probability of rolling an even number: P(even) = 3/6 = 1/2

Web References: https://en.wikipedia.org/wiki/Probability 

2. Sample Spaces and Events

Definitions

• Sample Space (Ω): The set of all possible outcomes of an experiment

• Event: A subset of the sample space

Types of Events

1. Simple Event: A single, specific outcome

2. Compound Event: Combination of multiple simple events

3. Impossible Event: An event with zero probability

4. Certain Event: An event that always occurs

Example

Coin Toss Experiment

• Sample Space Ω = {Heads, Tails}

• Simple Events: {Heads}, {Tails}

• Compound Event: {Getting Heads at least once in 3 tosses}

Probability Calculation

Probability of a specific event = (Number of favorable outcomes) / (Total number of possible outcomes)

Web References: https://en.wikipedia.org/wiki/Event_(probability_theory) 

3. Mutually Exclusive and Independent Events

Mutually Exclusive Events

• Events that cannot occur simultaneously

• P(A ∩ B) = 0

• Probability of either event: P(A ∪ B) = P(A) + P(B)

Independent Events

• Occurrence of one event does not affect the probability of the other

• P(A and B) = P(A) * P(B)

Calculation Example

Card Drawing

• Drawing a red card and a face card from a standard deck

• These events might be mutually exclusive or independent depending on the specific draw

Probability Calculation

• P(Independent Events) = P(A) * P(B)

• P(Mutually Exclusive Events) = P(A) + P(B)

Web References: https://www.statology.org/understanding-independence-vs-mutual-exclusivity/ 

4. Conditional Probability

Definition

Conditional probability is the probability of an event occurring given that another event has already occurred.

Conditional Probability Formula

P(A|B) = P(A ∩ B) / P(B)

• P(A|B): Probability of A given B has occurred

• P(A ∩ B): Probability of both A and B occurring

• P(B): Probability of B occurring

Calculation Example

Medical Test Scenario

• Probability of having a disease given a positive test

• Bayes' Theorem application

Practical Calculation

P(Disease|Positive Test) = [P(Positive Test|Disease) * P(Disease)] / P(Positive Test)

Web References: https://en.wikipedia.org/wiki/Conditional_probability 

5. Engineering Reliability Problems

Definition

Reliability analysis involves calculating the probability of a system or component functioning successfully over a specific time period.

Key Concepts

1. Failure Rate: Probability of component failure per unit time

2. Reliability Function: Probability of successful operation

3. Survival Probability: Probability of system functioning without failure

Reliability Calculation Methods

• Series Systems

• Parallel Systems

• Mixed Configurations

Example Calculation

Series System Reliability R(system) = R1 * R2 * R3

• Where R is the reliability of each component

Reliability Distribution Models

• Exponential Distribution

• Weibull Distribution

• Normal Distribution

Web References: https://en.wikipedia.org/wiki/Conditional_probability - This article does not cover the statistics, but does cover the fundamentals of engineering reliability (you should read it). 

Supplementary Learning Resources

• Textbook: "A First Course in Probability" by Sheldon Ross

• Online Course: Coursera - Introduction to Probability and Data

• Interactive Learning: R Programming for Probability Calculations

Recommended Practice

1. Solve multiple-choice probability problems

2. Use simulation tools like Monte Carlo methods

3. Practice calculating probabilities for real-world scenarios

4. Learn basic programming for probability simulations (Python, R)