Q 1 Abdel-Khalik and Ajinkya (1979) provide a precise definition of the nature o

Question

Q 1 Abdel-Khalik and Ajinkya (1979) provide a precise definition of the nature of an experiment in that the researcher manipulates one or more variables with subjects who are assigned randomly to various groups. These groups receive different combinations of the variables (termed treatments); in some cases a control group may exist which receives no such treatments. The major advantage of experiments lies in the researchers’ ability to ensure high internal validity, defined in terms of how well they can eliminate rival explanations for their results. Experiments are, thus, particularly suited to research questions that investigate causal relations between variables.

In this context, what guidelines will you suggest for a good experimental research?

Discuss the internal validity threats of experimental research.

Q 2 Performance of employees and performance of departments are important for the success of companies. We collect the opinions of employees in the following survey.

Department Performance Survey

1.     How skilled at their jobs are the members of your team?

·      Extremely skilled

·      Very skilled

·      Somewhat skilled

·      Not so skilled

·      Not at all skilled

2.     How professionally do members of your team behave?

·      Extremely professionally

·      Very professionally

·      Somewhat professionally

·      Not so professionally

·      Not at all professionally

      3. How honest with each other are the members of your team?

·      Extremely honest

·      Very honest

·      Somewhat honest

·      Not so honest

·      Not at all honest

4.     How well do members of your team share responsibility for tasks?

·      Extremely well

·      Very well.

·      Somewhat well

·      Not so well

·      Not at all well

5.     How well does your supervisor work with clients?

·      Extremely well

·      Very well

·      Somewhat well

·      Not so well

·      Not at all well

6.     How efficiently are team meetings conducted?

·      Extremely efficiently

·      Very efficiently

·      Somewhat efficiently

·      Not so efficiently

·      Not at all efficiently

7.     How fairly are responsibilities shared among your team members?

·      Extremely fairly

·      Very fairly

·      Not so fairly

·      Not at all fairly

8.     How hardworking is your supervisor?

·      Extremely hard working

·      Very hardworking

·      Somewhat hardworking

·      Not so hardworking

·      Not at all hardworking

9.     How often does your team meet its deadlines?

·      Always

·      Most of the time

·      About half of the time

·      Once in a while

·      Never

10. How politely do members of your team treat each other?

§ Extremely politely

§ Very politely

§ Somewhat politely

§ Not so well

§ Not at all well

Explanation / Answer

There are four guidelines for good experimental research:
1. A clear statement of the problem, its importance and the contribution to knowledge that the solution will make.
2. A clear statement of the theory that underlies the process, in particular the theory that drives the behaviour and the impact of context on theory.
3. A sound experimental design. Since, fatal flaws can be introduced by inappropriate or inadequate designs.
4. Recognition of the importance of external validity. If this means that we need more realistic experimental settings, then we need correspondingly richer theoretical explanations of resultant behaviour.
These above stated guidelines provide an excellent framework for the consideration of research issues.

Internal validity refers specifically to whether an experimental treatment/condition makes a difference or not, and whether there is sufficient evidence to support the claim.
These internal validity threats includes history effects, maturation, testing effects, instrumentation, statistical regression, selection biases, experimental mortality, causal time order, diffusion (or imitation) of treatments, compensation, compensatory rivalry, demoralization, experimenter effects and subject effects.

Factors which jeopardize internal validity-

History-
the specific events which occur between the first and second measurement.

Maturation-
The processes within subjects which act as a function of the passage of time. i.e. if the project lasts a few years, most participants may improve their performance regardless of treatment.

Testing-
The effects of taking a test on the outcomes of taking a second test.

Selection of subjects-
The biases which may result in selection of comparison groups. Randomization (Random assignment) of group membership is a counter-attack against this threat. However, when the sample size is small, randomization may lead to Simpson Paradox, which has been discussed in an earlier lesson.

Instrumentation-
The changes in the instrument, observers, or scorers which may produce changes in outcomes.

Statistical regression-
It is also known as regression to the mean. This threat is caused by the selection of subjects on the basis of extreme scores or characteristics. Give me forty worst students and I guarantee that they will show immediate improvement right after my treatment.

Experimental mortality-
The loss of subjects. For example, in a Web-based instruction project entitled Eruditio, it started with 161 subjects and only 95 of them completed the entire module. Those who stayed in the project all the way to end may be more motivated to learn and thus achieved higher performance.

Selection-Maturation interaction-
The selection of comparison groups and maturation interacting which may lead to confounding outcomes, and erroneous interpretation that the treatment caused the effect.

John Henry effect-
John Henry was a worker who outperformed a machine under an experimental setting because he was aware that his performance was compared with that of a machine.

Related Questions

Navigate

• Browse (All)
• Browse Q
• Subjects

Integrity-first tutoring: explanations and feedback only — we do not complete graded work. Learn more.