Testing

• Type I Error

may sing to the tune of Queen's "We Will Rock You"

If the null is really true and we get a sample
That causes us to reject the null,
That’s a Type I Error

Type I, Type I Error
Type I, Type I Error

Repeat

• Statistically Significant

may sing to the tune of "Star Spangled Banner"

Statistically significant
Is so far away
Far away from expected

There’s not really a way
That’s the sample I got
Happened because
Of chance, because of chance

Sampling variability
Sampling variability
Happens because you got
Different data than me

Oh if my observed sample’s
In the rejection region
Then the data that I got’s
Statistically significant

• P-Value is Low

may sing to the tune of "Hound Dog" by Elvis Presley

If the p-value is low
If the p-value is low
The null hypothesis has to go

If the p-value is low
If the p-value is low
The null hypothesis has to go

• Definition of P-Value

may sing to the tune of "Brown-Eyed Girl" by Van Morrison

Do you remember when we used to sing…
The p-value is the probability
Of getting this sample
Or something more extreme
If the null is true

The p-value is the probability
Of getting this sample
Or something more extreme
If the null is true