Learning and Applying Tests of Significance
Mock Study 1: t-Test for a Single Sample (15 points)
- Research hypothesis (H1) and null hypothesis (H0).
- H1: The average number of Activities of Daily Living (ADL) obtained after therapy is significantly different from the mean number of activities (15) that is typical for depressed people
- H0: The average number of Activities of Daily Living (ADL) obtained after therapy is not significantly different from the mean number of activities (15) that is typical for depressed people
- H1: x̄ = 15 vs H0: x̄ ≠ 15
- The significance level (alpha) used in the current mock study is at .05 and .01. The results of BOTH .05 and .01 are to test the hypotheses.
- Analysis in SPSS.
One-Sample Test | ||||||
Test Value = 15 | ||||||
t | Df | Sig. (2-tailed) | Mean Difference | 95% Confidence Interval of the Difference | ||
Lower | Upper | |||||
ADL | 1.619 | 19 | .122 | 1.650 | -.48 | 3.78 |
One-Sample Test | ||||||
Test Value = 15 | ||||||
t | Df | Sig. (2-tailed) | Mean Difference | 99% Confidence Interval of the Difference | ||
Lower | Upper | |||||
ADL | 1.619 | 19 | .122 | 1.650 | -1.27 | 4.57 |
- The p-value obtained for both 0.05 and 0.01 significance levels is 0.122
- The p-value obtained indicates that the p-value (0.122) is larger than the alpha 0.05 and 0.01. According to the decision rule, this indicates that we should accept the null hypothesis and conclude that the average number of Activities of Daily Living (ADL) obtained after therapy is not significantly different from the mean number of activities (15) that is typical for depressed people. Since there is no significant difference, the scientists should find alternative methods of therapy for depressed people that will increase the number of ADLs for positive outcomes other than group therapy programs.
Mock Study 2: t- Test for Dependent Means (15 points)
- Research hypothesis (H1) and the null hypothesis (H0).
- H1: The observed differences in the number of activities of daily living obtained before and after therapy are statistically significant.
- H0: The observed differences in the number of activities of daily living obtained before and after therapy are not statistically significant.
- The significance level (alpha) used in the current mock study is at .05.
- The SPSS Analysis output
Paired Samples Test | |||||||||
Paired Differences | t | df | Sig. (2-tailed) | ||||||
Mean | Std. Deviation | Std. Error Mean | 95% Confidence Interval of the Difference | ||||||
Lower | Upper | ||||||||
Pair 1 | ADLPRE – ADLPOST | -4.300 | 3.199 | 1.012 | -6.588 | -2.012 | -4.251 | 9 | .002 |
- The p-value obtained is 0.002 at a .05 level of significance.
- The p-value (0.002) is smaller than the alpha value of 0.05. Based on the decision rule, we reject the null hypothesis and conclude that the observed differences in the numbers of activities of daily living obtained before and after therapy are statistically significant. This provides sufficient evidence that indicates that scientists should recommend group therapy for all depressed people.
Mock Study 3: t-Test for Independent Samples (15 points)
- Research hypothesis (H1) and the null hypothesis (H0).
- H1: The job satisfaction scores of the group that participated in a counseling session are statistically different from the scores of employees who chose not to participate in counseling sessions.
- H0: The job satisfaction scores of the group that participated in a counseling session are not statistically different from the scores of employees who chose not to participate in counseling sessions.
- The test of the hypothesis is performed at a 0.01 level of significance.
- SPSS Analysis
Independent Samples Test | ||||||||||
Levene’s Test for Equality of Variances | t-test for Equality of Means | |||||||||
F | Sig. | t | df | Sig. (2-tailed) | Mean Difference | Std. Error Difference | 95% Confidence Interval of the Difference | |||
Lower | Upper | |||||||||
ADL | Equal variances assumed | 1.337 | .263 | 1.706 | 18 | .105 | 2.200 | 1.289 | -.509 | 4.909 |
Equal variances not assumed | 1.706 | 15.676 | .108 | 2.200 | 1.289 | -.538 | 4.938 |
- The p-value obtained under the t-test for equality of means is 0.105.
- The p-value obtained is larger than the alpha value (0.01) set for the study. According to the decision rule, we should accept the null hypothesis and conclude that the job satisfaction scores of the group that participated in counseling session are not statistically different from the scores of employees who chose not to participate in counseling sessions. These findings provide a basis to conclude that counseling is not an effective method to improve job satisfaction following industrial accidents.
Mock study 4: One-Way ANOVA
- Research hypothesis (H1) and null hypothesis (H0).
- H1: The observed differences in the number of hours watching TV across three groups are statistically significant
- H0: The observed differences in the number of hours watching TV across three groups are not statistically significant.
- The level of significance for the mock study is alpha at .05
- SPSS Analysis
ANOVA | |||||
Hours per day watching TV | |||||
Sum of Squares | df | Mean Square | F | Sig. | |
Between Groups | 409.066 | 2 | 204.533 | 26.236 | .000 |
Within Groups | 12099.008 | 1552 | 7.796 | ||
Total | 12508.073 | 1554 |
- The p-value obtained is a small number, reported as p<.0001.
- This indicates that the p-value is less than alpha value of 0.05. Based on the decision rule, we should reject the null hypothesis and conclude that the observed differences in the number of hours watching TV across three groups are statistically significant. This provides an evidence that the advertising firm should target each racial group differently since their TV watching habits differ significantly.
Circumstances when ANOVA is appropriate compared to t-test: Although t-test and ANOVA all test differences between groups, the ANOVA test is appropriate when testing differences for more than one group. This is why t-tests are referred as special types of ANOVA.
Mock Study 5: Chi-Square Test for Independence
- Research hypothesis (H1) and null hypothesis (H0).
- H1: The observed frequency is significantly different from the expected frequency.
- H0: The observed frequency is not significantly different from the expected frequency
- The level of significance for the test of independence is .05.
- SPSS Analysis
Chi-Square Tests | |||
Value | df | Asymptotic Significance (2-sided) | |
Pearson Chi-Square | 27.658a | 14 | .016 |
Likelihood Ratio | 27.897 | 14 | .015 |
Linear-by-Linear Association | 4.754 | 1 | .029 |
N of Valid Cases | 1506 | ||
a. 1 cells (4.2%) have an expected count of less than 5. The minimum expected count is 2.73. |
- The analysis indicates that the Pearson Chi-Square p-value is 0.016.
- The p-value is smaller than 0.05. Based on the decision rule, we should accept the null hypothesis and conclude that the observed frequency is significantly different from the expected frequency. This provides evidence to conclude that an individual’s political party affiliation affects their confidence in Congress.
Mock study 6: Linear Regression
- Research hypothesis (H1) and null hypothesis (H0).
- H1: Age affects the number of poor mental health days
- H0: Age does not affect the number of poor mental health days
- The level of significance used for the model is .05.
- SPSS Analysis
ANOVAa | ||||||
Model | Sum of Squares | df | Mean Square | F | Sig. | |
1 | Regression | 611.395 | 1 | 611.395 | 12.917 | .000b |
Residual | 66266.114 | 1400 | 47.333 | |||
Total | 66877.509 | 1401 | ||||
a. Dependent Variable: Days of poor mental health past 30 days | ||||||
b. Predictors: (Constant), Age of respondent |
- The p-value obtained is .000, reported as p<.0001.
- The p-value obtained is smaller than the level of significance. This indicates that we should reject the null hypothesis and conclude that age affects the number of poor mental health days. This shows a relationship between age and poor mental health days
The Model
Coefficientsa | ||||||
Model | Unstandardized Coefficients | Standardized Coefficients | t | Sig. | ||
B | Std. Error | Beta | ||||
1 | (Constant) | 5.602 | .594 | 9.425 | .000 | |
Age of respondent | -.047 | .013 | -.096 | -3.594 | .000 | |
a. Dependent Variable: Days of poor mental health past 30 days |
Y= 5.602 – 0.047X1
Where Y= Poor Mental Health Days
X1= Age of the respondent.
Therefore, the model indicates that age is negatively related to poor mental health days.
ORDER A PLAGIARISM-FREE PAPER HERE
We’ll write everything from scratch
Question
Complete the following assignment by filling in all requested information. In this assignment, you will review mock studies and analyze data within each study. You will need to CAREFULLY follow the directions outlined in each section of the attached document using SPSS. Some of the studies require you to enter data, and some require you to use the GSS data set. You will list the five steps of hypothesis testing for each Mock Study to see how every question should be formatted. You will decide whether to reject or fail to reject the null hypothesis. Be sure to cut and paste the appropriate SPSS outputs under each problem and interpret the outputs within the context of each mock study. Use a different (legible) color font for your responses.
Throughout this assignment, you will review six mock studies. Follow the step-by-step instructions:
- Mock Studies 1 – 3 require you to enter data from scratch. You need to create a data set for each of the three mock studies by yourself. (Refresh the data entry skill acquired in Week 1.)
- Mock Studies 4 – 6 require you to use the GSS 2018 dataset. The variables are specified in each Mock Study.
- Go through the five steps of hypothesis testing (below) for EVERY mock study.
- All calculations should be coming from your SPSS. You will need to submit the SPSS output file (.spv) to get credit for this assignment.
The five steps of hypothesis testing when using SPSS are as follows:
- State your research hypothesis (H1) and null hypothesis (H0).
- Identify your significance level (alpha) at .05 or .01, based on the mock study. In Mock Study One, you are required to use BOTH .05 and .01 to test your hypotheses. For the remaining mock studies, you only need to use ONE level of significance (either .05 or .01) as specified in the instructions.
- Conduct your analysis using SPSS.
- Look for the valid score for comparison. This score is usually under ‘Sig 2-tail’ or ‘Sig. 2’ or ‘Asymptotic Sig.’ We will call this “p.”
- Compare the two and apply the following rule:
- If “p” is < or = alpha, then you reject the null.
- Please explain what this decision means in regard to this mock study. (Ex: Will you recommend counseling services?)
Please make sure your answers are clearly distinguishable. Perhaps you could bold your font or use a different color.