Textbook Coding
Background:
Six textbook series, CME, CPMP, DM, Glencoe, IMP, and UCSMP have been examined, scoring each and every question for the mathematical concepts involved as well as the "Cognitive Behavior" required to address the question in the context in which it appears in the textbook. A total of 63,174 questions have been scored across all series and a total of 86,895 topic codes assigned. Each question was evaluated by two people who met and discussed any discrepancies in their assessments. Results reported here are based on their reconciled scorings.
Discussion and images below may not reflect the most recent versions available. Check the dates of the attachments, typically the most up-to-date downloadable stable output will be found in seriesTextbooks.zip. Also available is a Dropbox page with access to recent working output which may be viewed without downloading.
All pdf output files are vector graphs which can be zoomed to see more detail.
|
|
|
Consolidation!
- :ods: seriesData.ods: Spreadsheet with Reconciled data from All series: CME, CPMP, DM, Glencoe, IMP, UCSMP; each in a separate sheet.
Analysis Resources
-
seriesTextbooks.zip: download and unzip this zip file to find:
-
index.html
html output of the primary Mathematica Notebook used for processing. The index.html
page has supporting folders HTMLFiles
and HTMLLinks
. Note: many of the images provide further details when your cursor hovers over various portions of the image. e.g. Actual underlying counts in the pie charts.
-
png
and
pdf
complete set of output files. All PDF files are scalable vector graphics and text so you can zoom in for details and out for the overview.
- Files below are representative, but are unlikely to be as up-to-date as in the
zip
file above.
- :nb: seriesTextbooks.nb: seriesTextbooks Mathematica Notebook. This file contains no output. To run, place in folder with:
- :ods: seriesData.ods: Spreadsheet with Reconciled data from All series: CME, CPMP, DM, Glencoe, IMP, UCSMP; each in a separate sheet.
- :ods: seriesContext.ods: Spreadsheet with context information along with valid codes and various "handles" for them.
Word Clouds for Cognitive Behavior and other Aspects:
Applying has such a dominant role in all series, that omiting it from the analysis highlights the distinctions among series more emphatically
Cognitive Behavior
These Pie Charts provide an overall summary of the three types of Cognitive Behavior: Knowing, Applying, and Reasoning.
The graph below, based on the idea of a Ternary Plot or Composition Plot, provides another way to summarize the three types of Cognitive Behavior: Knowing, Applying, and Reasoning. This presentation:
- Shows the Pie charts given above as well as a chart for each textbook in the series.
- Scales each pie chart acording to the number of questions represented
- Positions each pie chart in a way that makes visual comparisons much more accessible.
The three corners of the plot represent each of the Cognitive Behaviors: Knowing, Applying, and Reasoning. Each corner of the triangle represents 100% for that feature. The side of the triangle opposite each corner represents 0% and spreads the remaining two features along it. To help characterize the triangle in terms of the more familiar pie charts, a background of small pie charts shows the underlying "Landscape" of how the large triangle portrays the proportions. It also helps you to read off approximate values for a position in the chart since there is a row for each 10% change in proportion. There is also a small pie chart in the center of the large triangle, locating equal proportions for all three features. Each textbook series is represented in the plot by a pie chart with its position representing all texts within the series as well as a pie chart for each of the (up to three) volumes in the series, represented by .1, .2, .3 in the label.
Beneath the graphic is a narrative highlighting some observations which this presentation makes particularly accessible:
From the plot, showing 17 pie charts, their location on the plot shows, for example, that CPMP consistently involves more reasoning and that the "orbit" of the series starts with a comparative emphasis on reasoning, shifting towards knowing in year 2 and then moving to applying in year 3. Glencoe and UCSMP have very little reasoning and move from knowing to applying from book 1 to book 2. CME, in contrast, moves away from applying and knowing towards more reasoning in going from year 1 to year two. The central white tirangle represents compositions with no clear majority. Each colored triangle indicates majority representation of the associated Cognitive Behavior. All textbooks in all series lie in the top triangle, indicating that they devote more than half of their questions to Applying.
Other Aspects
Content
Contents were coded using a numerical taxonomy. Here are Word Clouds for the numerical codes:
and Pie Charts to summarize at a higher level
with associated Legend
Word Clouds at the higher level
- By Name
Timeline Graphs
Timeline Graph for Cognitive Behaviors:
CME Algebra 1&2 [CME]
Core Plus Mathematics Program [CPMP]
Discovering Mathematics: (Advanced) Algebra [DM]
Glencoe Algebra 1 & 2 [Glencoe]
Interactive Mathematics Program [IMP]
University of Chicago School Mathematics Project [UCSMP]
--
DickFurnas - 2009-09-18
Attachments