Procedure for Complexity Training:
Download all of the files listed below. The file “Descriptive Chapter” is a brief introductory chapter which gives some background on the integrative complexity concept and describes the most common research practices. Read this first to get valuable information about this construct you’re about to tackle. “The Manual” is rather self-descriptive, being THE manual which thoroughly describes how to score complexity. Read this second. The “Practice Materials” file contains the first 8 sets of paragraphs for you to practice scoring. The correct scores are on the last page. The file “Scoring Guidelines” is a helpful little document that gives explanations for the correct scores for the first five sets of practice paragraphs. Drawn from actual workshop discussions, many learning scorers have found this document extremely helpful. Recent updates to this document have nearly tripled its usefulness. Finally, the file named “The Test” is a standardized set of paragraphs used to guage your skill at scoring.
Practice scoring until you feel confident that you understand the construct. Be patient, this may take a little while and the practice materials are intentionally chosen to be problematic, so try not to get frustrated. If you get stuck, contact Rajiv Jhangiani at rajiv [dot] jhangiani [at] kpu [dot] ca and he will try to answer your questions. When you are ready, take the test and send the results to Rajiv Jhangiani at the above address and he will notify you of your reliability level. The goal is to obtain a minimum of .85 reliability with a qualified scorer. In this case, with the recorded scores for the test paragraphs; in the case of research, with other independent scorers of the same material.
NOTE: When submitting your test scores, please place the scores ALONE (i.e., without paragraph numbers), in order, in a single column. This greatly simplifies the reliability analysis process. Thank you.