Textbook Coding

Background:

Six textbook series, CME, CPMP, DM, Glencoe, IMP, and UCSMP have been examined, scoring each and every question for the mathematical concepts involved as well as the "Cognitive Behavior" required to address the question in the context in which it appears in the textbook. A total of 63,174 questions have been scored across all series and a total of 86,895 topic codes assigned. Each question was evaluated by two people who met, discussed and reconciled any discrepancies in their assessments. Results reported here are based on their reconciled scorings.

Discussion and images below may not reflect the most recent versions available. Check the dates of the attachments, typically the most up-to-date downloadable stable output will be found in Compressed Zip archive seriesTextbooks.zip.

NEW! Also available is a Dropbox page with access to recent working output which may be viewed without downloading the entire .zip file. This output may be even more recent than the seriesTextbooks.zip file.

All PDF pdf output files are vector graphs which can be zoomed to see more detail.

Table of Contents

Consolidation!

  • :ods: seriesData.ods: Spreadsheet with Reconciled data from All series: CME, CPMP, DM, Glencoe, IMP, UCSMP; each in a separate sheet.

Analysis Resources

Word Clouds for Cognitive Behavior and other Aspects:

CogBehOther_WordCloud.png

Applying has such a dominant role in all series, that omiting it from the analysis highlights the distinctions among series more emphatically

CogBehOther_WordCloudNoA.png

Cognitive Behavior

These Pie Charts provide an overall summary of the three types of Cognitive Behavior: Knowing, Applying, and Reasoning.

CogBeh_PieChart.png

The graph below, based on the idea of a Ternary Plot or Composition Plot, provides another way to summarize the three types of Cognitive Behavior: Knowing, Applying, and Reasoning. This presentation:

  • Shows the Pie charts given above as well as a chart for each textbook in the series.
  • Scales each pie chart acording to the number of questions represented
  • Positions each pie chart in a way that makes visual comparisons much more accessible.
The three corners of the plot represent each of the Cognitive Behaviors: Knowing, Applying, and Reasoning. Each corner of the triangle represents 100% for that feature. The side of the triangle opposite each corner represents 0% and spreads the remaining two features along it. To help characterize the triangle in terms of the more familiar pie charts, a background of small pie charts shows the underlying "Landscape" of how the large triangle portrays the proportions. It also helps you to read off approximate values for a position in the chart since there is a row for each 10% change in proportion. There is also a small pie chart in the center of the large triangle, locating equal proportions for all three features. Each textbook series is represented in the plot by a pie chart with its position representing all texts within the series as well as a pie chart for each of the (up to three) volumes in the series, represented by .1, .2, .3 in the label.

Beneath the graphic is a narrative highlighting some observations which this presentation makes particularly accessible:

TernaryPlotPies.png

From the plot, showing 17 pie charts, their location on the plot shows, for example, that CPMP consistently involves more reasoning and that the "orbit" of the series starts with a comparative emphasis on reasoning, shifting towards knowing in year 2 and then moving to applying in year 3. Glencoe and UCSMP have very little reasoning and move from knowing to applying from book 1 to book 2. CME, in contrast, moves away from applying and knowing towards more reasoning in going from year 1 to year two. The central white tirangle represents compositions with no clear majority. Each colored triangle indicates majority representation of the associated Cognitive Behavior. All textbooks in all series lie in the top triangle, indicating that they devote more than half of their questions to Applying.

Other Aspects

Other_BarChart.png

Content

Contents were coded using a numerical taxonomy. Here are Word Clouds for the numerical codes:

Content_WordCloud.png

and Pie Charts to summarize at a higher level

Content_PieChart.png

with associated Legend

Content_Legend_PieChart.png

Word Clouds at the higher level

  • By Number

Content_WordCloud00.png

  • By Name
    Content_WordCloudNamed.png

Timeline Graphs

Timeline Graph for Cognitive Behaviors:

CogBeh_Timeline_Graph.png

CME Algebra 1&2 [CME]

CME_Timeline_Graph.png

Core Plus Mathematics Program [CPMP]

CPMP_Timeline_Graph.png

Discovering Mathematics: (Advanced) Algebra [DM]

DM_Timeline_Graph.png

Glencoe Algebra 1 & 2 [Glencoe]

GA12_Timeline_Graph.png

Interactive Mathematics Program [IMP]

IMP_Timeline_Graph.png

University of Chicago School Mathematics Project [UCSMP]

UCSMP_Timeline_Graph.png


-- DickFurnas - 2009-09-18

Attachments

Topic attachments
I Attachment History Action Size Date WhoSorted ascending Comment
PDFpdf CME_Timeline_Graph.pdf r3 r2 r1 manage 1732.8 K 2015-07-14 - 16:39 DickFurnas Harmonized to 2015-07-14
PNGpng CME_Timeline_Graph.png r4 r3 r2 r1 manage 150.8 K 2015-07-14 - 16:40 DickFurnas Harmonized to 2015-07-14
PDFpdf CPMP_Timeline_Graph.pdf r6 r5 r4 r3 r2 manage 1150.4 K 2015-07-14 - 16:41 DickFurnas Harmonized to 2015-07-14
PNGpng CPMP_Timeline_Graph.png r6 r5 r4 r3 r2 manage 167.5 K 2015-07-14 - 16:41 DickFurnas Harmonized to 2015-07-14
PDFpdf CogBehOther_WordCloud.pdf r1 manage 235.4 K 2015-07-20 - 23:07 DickFurnas Word Clouds for Cognitive Behavior and Other Aspects
PNGpng CogBehOther_WordCloud.png r1 manage 143.6 K 2015-07-20 - 23:07 DickFurnas Word Clouds for Cognitive Behavior and Other Aspects
PDFpdf CogBehOther_WordCloudNoA.pdf r1 manage 204.8 K 2015-07-20 - 23:09 DickFurnas Word Clouds for Cognitive Behavior and Other Aspects Applying removed to highlight others
PNGpng CogBehOther_WordCloudNoA.png r1 manage 142.7 K 2015-07-20 - 23:08 DickFurnas Word Clouds for Cognitive Behavior and Other Aspects Applying removed to highlight others
PDFpdf CogBeh_PieChart.pdf r10 r9 r8 r7 r6 manage 16.5 K 2015-07-15 - 06:50 DickFurnas Harmonized to 2015-07-15 [Disc]
PNGpng CogBeh_PieChart.png r10 r9 r8 r7 r6 manage 51.9 K 2015-07-15 - 06:52 DickFurnas Harmonized to 2015-07-15 [Disc]
PDFpdf CogBeh_Timeline_Graph.pdf r1 manage 7241.8 K 2015-07-22 - 04:32 DickFurnas Timeline Graph for Cognitive Behaviors
PNGpng CogBeh_Timeline_Graph.png r1 manage 175.0 K 2015-07-22 - 04:31 DickFurnas Timeline Graph for Cognitive Behaviors
PDFpdf Content_Legend_PieChart.pdf r14 r13 r12 r11 r10 manage 32.7 K 2015-07-14 - 16:43 DickFurnas Harmonized to 2015-07-14
PNGpng Content_Legend_PieChart.png r13 r12 r11 r10 r9 manage 106.2 K 2015-07-14 - 16:44 DickFurnas Harmonized to 2015-07-14
PDFpdf Content_PieChart.pdf r11 r10 r9 r8 r7 manage 18.5 K 2015-07-15 - 06:53 DickFurnas Harmonized to 2015-07-15 [Disc]
PNGpng Content_PieChart.png r13 r12 r11 r10 r9 manage 107.3 K 2015-07-15 - 06:59 DickFurnas Harmonized to 2015-07-15 [Disc]
PDFpdf Content_WordCloud.pdf r3 r2 r1 manage 1909.9 K 2015-07-21 - 05:13 DickFurnas Word Clouds for Content codes
PNGpng Content_WordCloud.png r3 r2 r1 manage 331.7 K 2015-07-21 - 05:12 DickFurnas Word Clouds for Content codes
PDFpdf Content_WordCloud00.pdf r1 manage 411.3 K 2015-07-21 - 05:15 DickFurnas Word Clouds for major content areas "00" level
PNGpng Content_WordCloud00.png r1 manage 194.2 K 2015-07-21 - 05:14 DickFurnas Word Clouds for major content areas "00" level
PDFpdf Content_WordCloudNamed.pdf r1 manage 615.5 K 2015-07-21 - 05:16 DickFurnas Word Clouds for major content areas "00" level by name
PNGpng Content_WordCloudNamed.png r1 manage 219.0 K 2015-07-21 - 05:16 DickFurnas Word Clouds for major content areas "00" level by name
PDFpdf DM_Timeline_Graph.pdf r2 r1 manage 1564.4 K 2015-08-09 - 19:32 DickFurnas Discovering Mathematics [DM] proper horizontal scaling restored
PNGpng DM_Timeline_Graph.png r2 r1 manage 273.1 K 2015-08-09 - 19:31 DickFurnas Discovering Mathematics [DM] proper horizontal scaling restored
PDFpdf Glencoe_Timeline_Graph.pdf r4 r3 r2 r1 manage 2122.3 K 2015-07-14 - 16:49 DickFurnas Harmonized to 2015-07-14
PNGpng Glencoe_Timeline_Graph.png r4 r3 r2 r1 manage 168.0 K 2015-07-14 - 16:49 DickFurnas Harmonized to 2015-07-14
PDFpdf IMP_Timeline_Graph.pdf r6 r5 r4 r3 r2 manage 298.3 K 2015-07-14 - 16:50 DickFurnas Harmonized to 2015-07-14
PNGpng IMP_Timeline_Graph.png r7 r6 r5 r4 r3 manage 114.2 K 2015-07-14 - 16:50 DickFurnas Harmonized to 2015-07-14
PDFpdf Other_BarChart.pdf r9 r8 r7 r6 r5 manage 28.6 K 2015-07-15 - 06:54 DickFurnas Harmonized to 2015-07-15 [Disc]
PNGpng Other_BarChart.png r9 r8 r7 r6 r5 manage 63.7 K 2015-07-15 - 06:54 DickFurnas Harmonized to 2015-07-15 [Disc]
PNGpng TernaryPlotPies.png r3 r2 r1 manage 75.9 K 2014-02-12 - 16:56 DickFurnas  
PDFpdf UCSMP_Timeline_Graph.pdf r6 r5 r4 r3 r2 manage 1657.8 K 2015-07-14 - 16:52 DickFurnas Harmonized to 2015-07-14
PNGpng UCSMP_Timeline_Graph.png r7 r6 r5 r4 r3 manage 189.4 K 2015-07-14 - 16:52 DickFurnas Harmonized to 2015-07-14
Unknown file formatods seriesContext.ods r1 manage 72.5 K 2015-07-14 - 16:00 DickFurnas The seriesContext.ods file contains context information along with valid codes and various "handles" for them.
Unknown file formatods seriesData.ods r19 r18 r17 r16 r15 manage 2309.0 K 2015-08-28 - 18:04 DickFurnas Fixed missing CogBeh codes in CPMP per MH, added Chapter delimiters in Comments column of Rater line at start of Chapter in CME formatted as CMEmnn
Unknown file formatnb seriesTextbooks.nb r15 r14 r13 r12 r11 manage 230.4 K 2015-09-16 - 15:45 DickFurnas Improved formatting of selectable table output and some additional consistency checks.
Compressed Zip archivezip seriesTextbooks.zip r19 r18 r17 r16 r15 manage 16394.9 K 2015-08-09 - 05:14 DickFurnas zip file of Mathematica notebook output folder. Includes pdf files and html rendition of the notebook
Edit | Attach | Watch | Print version | History: r64 | r57 < r56 < r55 < r54 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r55 - 2015-09-16 - DickFurnas
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.