ADA Summary Test

The distance of each score from the mean

The total amount of error in the mean (the errors/deviances are squared before adding them up)

The average distance of scores from the mean. (it is the sum of squares divided by the number of scores) Tells us how widely dispersed scores are around the mean.

The square root of the variance

The sign tells us if the original score was above or below the mean, the value tells us how far the score was from the mean in sd units. (z-score = (score - mean of all scores)/ standard deviation of all scores)

Uses language of sets

A collection of things/ elements

is the set of all things that we could possibly consider in the context of what we are studying (S={1,2,3,4,5,6} --> for a dice)

A rule that takes an input from a specific set, called the domain and produces an output from another set, called co-domain

The set of all possible outcomes

A function as the set containing all the possible values of f(x). Thus the range of a function is always a subset of its co-domain

--> Mutually exclusive events cannot be statistically independent, since knowing that one occurs gives information about the other (specifically, that it certainly does not occur) --> can’t happen at the same time --> If A and B are mutually exclusive events they are statistically independent if and only if P(A)=0 or P(B)=0 or both are zero

The higher the numbers of trials the closer we get to the true probability

framework so we can do statistical inference, as the sample size increases becomes more and more like a normal distribution

When you take the average of the sample averages, it will look like your population mean because it is a normal distribution we can come up with p-values

Summarize the characteristics of a data set (The data with regards to average mean, median, range)

Allows you to test a hypothesis or asses whether your data is generalizable to the broader population.

• takes data from a sample and makes inferences about the larger population from which the sample was drawn.

• goal of inferential statistics is to draw conclusions from a sample and generalize them to a population

• draw conclusion from the sample, happens when calculating p values

99,7% of sample results are contained within 3 standard errors 95% within 2 standard errors 68% within 1 standard error

= standard deviation of a sampling distribution

probability between the 2 rejection regions for a two tailed test. If α=0,10, then the Confidence Level is 1-0,10 = 0,90 or 90%

The bounds equal to the lower and upper critical values (The area (region can measure anything))

False positive (reject a true null hypothesis)

False negative (accept a false null hypothesis)

does not assume anything about the underlying distribution (for example, that the data comes from anormal distribution and does not have a normal distribution)

makes assumptions about a population’s parameters(for example, the mean or standard deviation)

When you want to know if something is simply higher or lower

Welch's ANOVA

The analysis of the variances, it tells you if there is a difference between at least 2 of the groups, not which groups are different from another.

tells you how much variation there is in the dependent variable, it is a measure of how a data set varies around a central number (like the mean)

the main goal is to see if there is any overlapping, just like variance

the explained Sum of Squares tells you how much of the variation in the dependent variable of your model is explained.

tells you how much of the dependent variable’s variation your model did not explain. It is the sum of the squared differences between the actual Y and the predicted Y (observed vs expected)

We use an F-distribution when we are studying the ratio of the variances of two normally distributed populations

The further the groups are from the grand mean, the larger the variance in the numerator becomes. In our F-test, this corresponds to having a higher variance in the numerator.

=MSB/MSE

one-way ANOVA

two-way anova

three-way Anova

1. Check Assumptions a. Normality (Sharpiro-Wilk) b. Outliers (BoxPlots)

2. Run one-way ANOVA with post-hoc a. Tukey & Games Howell b. Levene’s Test= do the distribution for each group, looking almost the same, is there homogeneity?

3. Run GLM to check partial eta squared a. Estimates of effect size

4. Calculate omega-squared

5. Interpret the data

How good that measures the outcome; how much does my model explain the total variance in the observations; how much does it explain of the total variation (= SSbetween / SStotal)

less biased alternative measure of the how good your model explains the results (especially when sample size is small)

= we are examining how much of the variance in our data can be explained by our independent variables (>1) = it looks at the main effects of the PV and their interaction effect on the OV =a (name) with 2 PVs is a two-way ANOVA, etc.

a) OV (outcome variable) = quantitative b) PV= categorical c) Independent groups (between-subject design) d) Variance is homogenous across groups (similar in shape) e) (Residuals (actual obs. to the average) are normally distributed) If you have an interaction effect= there is dependency

It is a way to check whether that third variable influences the strength or direction of the relationship between independent and dependent.

= mediated the relationship between independent and dependent; explains the reason for such a relationship to exist Is the influence of mediator stronger than the influence of the direct independent variable (imagine you have grades lead to happiness and self-esteem is the mediator; what you want to do with mediation= we try to see if the variable “self-esteem” explains the existence of the “grades” variable completely)

= measures the degree of a relationship between two variables (x and y) = find the numerical value that shows the relationship between the two variables and how they move together

= analysis helps to determine the functional relationship between two variables (x and y) so that you’re able to estimate the unknown variable to make future projections on events and goals

= to estimate the values of a random variable (z) based on the values of your known (or fixed) variables (x and y). = is considered to be the best fitting line through the data points

= measures the strength of the linear relationship between two quantitative variables. = is always a number between -1 and 1. r > 0 indicates a positive association.

Coefficient of determination= tells you SSB (SSM)/ SST= tells you whether your model, how much the variability in the outcome is explained by the model; indicator on how good your linear model is/ proportion of variability in your outcome that is explained by the model

= shows how well the data fit the regression model (the goodness of fit) = The higher the better

1. Choose a number of bootstrap samples to perform

2. Choose a sample size

3. For each bootstrap sample

4. Draw a sample with replacement with the chosen size

5. Calculate the statistic on the sample

6. Calculate the mean of the calculated sample statistics

represented by: y = β0 +β1x+ε β0 --> y-intercept β1 --> slope E(y) --> is the mean or expected value of y for a given value of x

A modified version of R-squared that has been adjusted for the number of predictors in the model. The adjusted R-squared increases when the new term improves the model more than would be expected by chance. It decreases when a predictor improves the model by less than expected. Typically, the adjusted R-squared is positive, not negative. It is always lower than the R-squared.

= Standardize (we use it; use apples & apples – just brings everything to the same base) = we want to compare between two variables (for example 0.467 has a bigger effect than 0.146); which has a bigger predictive effect  Use it when we want to compare effect sizes across PV  Easier to compare

= we want to figure out the exact relation/ predictive relation between the variables and our outcome The math aptitude test scores for every unit increase in that, we can see at point 0.116 increase in our statistics exam results= the actual outcome that happens

 If you want to interpreted individual PVs impact on the OV  Easier to interpret

= refers to axes being at a right angle = in moderation we need it to fix the distorting effect of multicollinearity (increasing standard errors and decreasing the t-statistic) In factor analysis we also make use of orthogonalization when we rotate the factors because all the multidimensional axes have to be at a right angle to form the factor/component

= an indication of a percent of variance in the predictor that cannot be accounted for by the other predictors; meaning that very small values indicate that a predictor is redundant

=in statistics and econometrics, particularly in regression analysis, a dummy variable is one that takes (converts – main goal) only the value 0 or 1 to indicate the absence or presence of some categorical effect that may be expected to shift the outcome. =dummy variable is a dichotomous, but a dichotomous is not necessarily a dummy variable

In ANOVA, the dependent variable was continuous  Independent variables can be dichotomous (dummy variables), but not the dependent variables

= probability of success/ probability of failure

= the joint behavior of more than one random variable

= reduce the number of dimensions that we have; We decide on the 2 or 3 variables (15 variables) we do that by Scree Plot

We started in the survey with 15 questions, but we don’t really know what variable they are measuring, so PCA will help us to see if any underline variables that we cannot see just by looking at the data

= reduce dimensionality of the problem to better understand the underlying factors affecting those variables

= Linear combination (variate) of the original variables. Factors also represent the underlying dimensions (constructs) that summarize or account for the original set of observed variables. Factors are a type of latent (hidden/ underlying/ its hidden somewhere there, but you don’t know yet) variable. It is a variable that is dependent on any other variables

= correlation between variables (it is the SWLS1) A question is a variable

= another word from R-square (how much does you PV explain the OV variance)

% of variance explained * the total number of variables (throw away eigenvalue below 1)

= involves 2 dimensions; think of it like correlation

= can be calculated covariance of 2 dimensions/ SD of X * SD of Y