TextbookCoding < MH

Tags: view all tags

---+ Textbook Coding
%ABSTRACT%
Background:

Six textbook series, CME, CPMP, DM, Glencoe, IMP, and UCSMP have been examined, scoring each and every question for the mathematical concepts involved as well as the "Cognitive Behavior" required to address the question in the context in which it appears in the textbook. A total of 63,174 questions have been scored across all series and a total of 86,895 topic codes assigned. Each question was evaluated by two people who met, discussed and reconciled any discrepancies in their assessments. Results reported here are based on their reconciled scorings.

Discussion and images below may not reflect the most recent versions available. Check the dates of the attachments, typically the most up-to-date downloadable stable output will be found in [[%ATTACHURL%/seriesTextbooks.zip][ :zip: seriesTextbooks.zip]].

*NEW!* Also available is a [[http://www.lightlink.com/mcp/MH/seriesTextbooks/][web page]] with access to recent working output which may be viewed without downloading the entire =.zip= file. This output may be even more recent than the =seriesTextbooks.zip= file.

All :pdf: =pdf= output files are vector graphs which can be zoomed to see more detail.

%ENDABSTRACT%

---++ Consolidation!
   * [[%ATTACHURL%/seriesData.ods][ :ods: seriesData.ods]]: Spreadsheet with Reconciled data from All series: CME, CPMP, DM, Glencoe, IMP, UCSMP; each in a separate sheet.
---++ Analysis Resources
   * [[%ATTACHURL%/seriesTextbooks.zip][ :zip: seriesTextbooks.zip]]: download and unzip this zip file to find:
      *  :html: =index.html= html output of the primary _Mathematica_ Notebook used for processing. The  =index.html= page has supporting folders =HTMLFiles= and =HTMLLinks= . *Note:* many of the images provide further details when your cursor hovers over various portions of the image. _e.g._ Actual underlying counts in the pie charts.
      *  :png: =png= and :pdf: =pdf= complete set of output files. All PDF files are scalable vector graphics and text so you can zoom in for details and out for the overview.
   * Files below are representative, but are unlikely to be as up-to-date as in the =zip= file above.
      * [[%ATTACHURL%/CME_Timeline_Graph.pdf][ :pdf: CME_Timeline_Graph.pdf]]: Timeline Graph for CME Project Algebra 1 & 2 [CME]
      * [[%ATTACHURL%/CPMP_Timeline_Graph.pdf][ :pdf: CPMP_Timeline_Graph.pdf]]: Timeline Graph for Core Plus Mathematics Program [CPMP]
      * [[%ATTACHURLPATH%/DM_Timeline_Graph.pdf][ :pdf: DM_Timeline_Graph.pdf]]: Timeline Graph for Discovering Mathematics: (Advanced) Algebra [DM]
      * [[%ATTACHURL%/Glencoe_Timeline_Graph.pdf][ :pdf: Glencoe_Timeline_Graph.pdf]]: Timeline Graph for Glencoe Algebra 1 & 2 [Glencoe]
      * [[%ATTACHURL%/IMP_Timeline_Graph.pdf][ :pdf: IMP_Timeline_Graph.pdf]]: Timeline Graph for Interactive Mathematics Program [IMP]
      * [[%ATTACHURL%/UCSMP_Timeline_Graph.pdf][ :pdf: UCSMP_Timeline_Graph.pdf]]: Timeline Graph for University of Chicago School Mathematics Project [UCSMP]
      * [[%ATTACHURL%/CogBeh_PieChart.pdf][ :pdf: CogBeh_PieChart.pdf]]: Cognitive Behavior Summaries, All series
      * [[%ATTACHURL%/Content_PieChart.pdf][ :pdf: Content_PieChart.pdf]]: Content Summaries, All series
      * [[%ATTACHURL%/Content_Legend_PieChart.pdf][ :pdf: Content_Legend_PieChart.pdf]]: Legend for Content Areas
      * [[%ATTACHURL%/Other_BarChart.pdf][ :pdf: Other_BarChart.pdf]]: CMX Stacked bar Charts, All series
      * [[%ATTACHURL%/CogBehOther_WordCloud.pdf][ :pdf: CogBehOther_WordCloud.pdf]]: Word Clouds for Cognitive Behavior and Other Aspects
      * [[%ATTACHURL%/CogBehOther_WordCloudNoA.pdf][ :pdf: CogBehOther_WordCloudNoA.pdf]]: Word Clouds for Cognitive Behavior and Other Aspects *Applying* removed to highlight others
      * [[%ATTACHURL%/Content_WordCloud.pdf][ :pdf: Content_WordCloud.pdf]]: Word Clouds for Content codes
      * [[%ATTACHURL%/Content_WordCloud00.pdf][ :pdf: Content_WordCloud00.pdf]]: Word Clouds for major content areas "00" level
      * [[%ATTACHURL%/Content_WordCloudNamed.pdf][ :pdf: Content_WordCloudNamed.pdf]]: Word Clouds for major content areas "00" level by name
      * [[%ATTACHURL%/CogBeh_Timeline_Graph.pdf][CogBeh_Timeline_Graph.pdf]]: Timeline Graph for Cognitive Behaviors
   * [[%ATTACHURL%/seriesTextbooks.nb][ :nb: seriesTextbooks.nb]]: *seriesTextbooks* _Mathematica_ Notebook. This file contains no output. To run, place in folder with:
      * [[%ATTACHURL%/seriesData.ods][ :ods: seriesData.ods]]: Spreadsheet with Reconciled data from All series: CME, CPMP, DM, Glencoe, IMP, UCSMP; each in a separate sheet.
      * [[%ATTACHURL%/seriesContext.ods][ :ods: seriesContext.ods]]: Spreadsheet with context information along with valid codes and various "handles" for them.


---++ Word Clouds!! for Cognitive Behavior and other Aspects:

     <img src="%ATTACHURLPATH%/CogBehOther_WordCloud.png" alt="CogBehOther_WordCloud.png" width='95%' />

*Applying* has such a dominant role in all series, that omiting it from the analysis highlights the distinctions among series more emphatically

     <img src="%ATTACHURLPATH%/CogBehOther_WordCloudNoA.png" alt="CogBehOther_WordCloudNoA.png" width='95%' />


---++ Cognitive Behavior
These Pie Charts provide an overall summary of the three types of Cognitive Behavior: Knowing, Applying, and Reasoning.

     <img src="%ATTACHURLPATH%/CogBeh_PieChart.png" alt="CogBeh_PieChart.png" width='95%' />

The graph below, based on the idea of a Ternary Plot or Composition Plot, provides another way to summarize the three types of Cognitive Behavior: Knowing, Applying, and Reasoning. This presentation:
   * Shows the Pie charts given above as well as a chart for each textbook in the series.
   * Scales each pie chart acording to the number of questions represented
   * Positions each pie chart in a way that makes visual comparisons much more accessible.
The three corners of the plot represent each of the Cognitive Behaviors: Knowing, Applying, and Reasoning. Each corner of the triangle represents 100% for that feature. The side of the triangle opposite each corner represents 0% and spreads the remaining two features along it. To help characterize the triangle in terms of the more familiar pie charts, a background of small pie charts shows the underlying "Landscape" of how the large triangle portrays the proportions. It also helps you to read off approximate values for a position in the chart since there is a row for each 10% change in proportion. There is also a small pie chart in the center of the large triangle, locating equal proportions for all three features. Each textbook series is represented in the plot by a pie chart with its position representing all texts within the series as well as a pie chart for each of the (up to three) volumes in the series, represented by .1, .2, .3 in the label.

Beneath the graphic is a narrative highlighting some observations which this presentation makes particularly accessible:

     <img src="%ATTACHURLPATH%/TernaryPlotPies.png" alt="TernaryPlotPies.png" width='95%' />

From the plot, showing 17 pie charts, their location on the plot shows, for example, that CPMP consistently involves more reasoning and that the "orbit" of the series starts with a comparative emphasis on reasoning, shifting towards knowing in year 2 and then moving to applying in year 3. Glencoe and UCSMP have very little reasoning and move from knowing to applying from book 1 to book 2. CME, in contrast, moves away from applying and knowing towards more reasoning in going from year 1 to year two. The central white triangle represents compositions with no clear majority. Each colored triangle indicates majority representation of the associated Cognitive Behavior. All textbooks in all series lie in the top triangle, indicating that they devote more than half of their questions to Applying.

---++ Other Aspects
   <img src="%ATTACHURLPATH%/Other_BarChart.png" alt="Other_BarChart.png" width='95%' />

---++ Content
Contents were coded using a numerical taxonomy. Here are Word Clouds for the numerical codes:

   <img src="%ATTACHURLPATH%/Content_WordCloud.png" alt="Content_WordCloud.png" width='95% '/>

and Pie Charts to summarize at a higher level

   <img src="%ATTACHURLPATH%/Content_PieChart.png" alt="Content_PieChart.png" width='95%' />

with associated Legend

   <img src="%ATTACHURLPATH%/Content_Legend_PieChart.png" alt="Content_Legend_PieChart.png" width='50%' />

Word Clouds at the higher level

   * By Number

<img src="%ATTACHURLPATH%/Content_WordCloud00.png" alt="Content_WordCloud00.png" width='95%' />

   * By Name%BR%<img src="%ATTACHURLPATH%/Content_WordCloudNamed.png" alt="Content_WordCloudNamed.png" width='95%' />


---++ Timeline Graphs


---+++ Timeline Graph for Cognitive Behaviors: 

     <img src="%ATTACHURLPATH%/CogBeh_Timeline_Graph.png" alt="CogBeh_Timeline_Graph.png" width='1440' height='706' />

---+++ CME Algebra 1&2 [CME]
     <img src="%ATTACHURLPATH%/CME_Timeline_Graph.png" alt="CME_Timeline_Graph.png" width='95%' />

---+++ Core Plus Mathematics Program [CPMP]
<img src="%ATTACHURLPATH%/CPMP_Timeline_Graph.png" alt="CPMP_Timeline_Graph.png" width='95%' />

---+++ Discovering Mathematics: (Advanced) Algebra [DM]
<img src="%ATTACHURLPATH%/DM_Timeline_Graph.png" alt="DM_Timeline_Graph.png" width='95%' />

---+++ Glencoe Algebra 1 & 2 [Glencoe]
<img src="%ATTACHURLPATH%/Glencoe_Timeline_Graph.png" alt="GA12_Timeline_Graph.png" width='95%' />

---+++ Interactive Mathematics Program [IMP]
<img src="%ATTACHURLPATH%/IMP_Timeline_Graph.png" alt="IMP_Timeline_Graph.png" width='95%' />

---+++ University of Chicago School Mathematics Project [UCSMP]
<img src="%ATTACHURLPATH%/UCSMP_Timeline_Graph.png" alt="UCSMP_Timeline_Graph.png"  width='95%' />

---
-- Main.DickFurnas - 2009-09-18
---++ Attachments

Attachments

Topic attachments
I	Attachment	History	Action	Size	Date	Who	Comment
nb	seriesTextbooks.nb	r20 r19 r18 r17 r16	manage	232.3 K	2015-11-12 - 04:52	DickFurnas	Updated Other Project Personnel
ods	seriesContext.ods	r1	manage	72.5 K	2015-07-14 - 16:00	DickFurnas	The `seriesContext.ods` file contains context information along with valid codes and various "handles" for them.
ods	seriesData.ods	r23 r22 r21 r20 r19	manage	2308.4 K	2015-11-02 - 22:23	DickFurnas	Fixed in DM: Lines 7-13 codes per MH
pdf	CME_Timeline_Graph.pdf	r3 r2 r1	manage	1732.8 K	2015-07-14 - 16:39	DickFurnas	Harmonized to 2015-07-14
pdf	CPMP_Timeline_Graph.pdf	r6 r5 r4 r3 r2	manage	1150.4 K	2015-07-14 - 16:41	DickFurnas	Harmonized to 2015-07-14
pdf	CogBehOther_WordCloud.pdf	r1	manage	235.4 K	2015-07-20 - 23:07	DickFurnas	Word Clouds for Cognitive Behavior and Other Aspects
pdf	CogBehOther_WordCloudNoA.pdf	r1	manage	204.8 K	2015-07-20 - 23:09	DickFurnas	Word Clouds for Cognitive Behavior and Other Aspects Applying removed to highlight others
pdf	CogBeh_PieChart.pdf	r10 r9 r8 r7 r6	manage	16.5 K	2015-07-15 - 06:50	DickFurnas	Harmonized to 2015-07-15 [Disc]
pdf	CogBeh_Timeline_Graph.pdf	r1	manage	7241.8 K	2015-07-22 - 04:32	DickFurnas	Timeline Graph for Cognitive Behaviors
pdf	Content_Legend_PieChart.pdf	r14 r13 r12 r11 r10	manage	32.7 K	2015-07-14 - 16:43	DickFurnas	Harmonized to 2015-07-14
pdf	Content_PieChart.pdf	r11 r10 r9 r8 r7	manage	18.5 K	2015-07-15 - 06:53	DickFurnas	Harmonized to 2015-07-15 [Disc]
pdf	Content_WordCloud.pdf	r3 r2 r1	manage	1909.9 K	2015-07-21 - 05:13	DickFurnas	Word Clouds for Content codes
pdf	Content_WordCloud00.pdf	r1	manage	411.3 K	2015-07-21 - 05:15	DickFurnas	Word Clouds for major content areas "00" level
pdf	Content_WordCloudNamed.pdf	r1	manage	615.5 K	2015-07-21 - 05:16	DickFurnas	Word Clouds for major content areas "00" level by name
pdf	DM_Timeline_Graph.pdf	r2 r1	manage	1564.4 K	2015-08-09 - 19:32	DickFurnas	Discovering Mathematics [DM] proper horizontal scaling restored
pdf	Glencoe_Timeline_Graph.pdf	r4 r3 r2 r1	manage	2122.3 K	2015-07-14 - 16:49	DickFurnas	Harmonized to 2015-07-14
pdf	IMP_Timeline_Graph.pdf	r6 r5 r4 r3 r2	manage	298.3 K	2015-07-14 - 16:50	DickFurnas	Harmonized to 2015-07-14
pdf	Other_BarChart.pdf	r9 r8 r7 r6 r5	manage	28.6 K	2015-07-15 - 06:54	DickFurnas	Harmonized to 2015-07-15 [Disc]
pdf	UCSMP_Timeline_Graph.pdf	r6 r5 r4 r3 r2	manage	1657.8 K	2015-07-14 - 16:52	DickFurnas	Harmonized to 2015-07-14
png	CME_Timeline_Graph.png	r4 r3 r2 r1	manage	150.8 K	2015-07-14 - 16:40	DickFurnas	Harmonized to 2015-07-14
png	CPMP_Timeline_Graph.png	r6 r5 r4 r3 r2	manage	167.5 K	2015-07-14 - 16:41	DickFurnas	Harmonized to 2015-07-14
png	CogBehOther_WordCloud.png	r1	manage	143.6 K	2015-07-20 - 23:07	DickFurnas	Word Clouds for Cognitive Behavior and Other Aspects
png	CogBehOther_WordCloudNoA.png	r1	manage	142.7 K	2015-07-20 - 23:08	DickFurnas	Word Clouds for Cognitive Behavior and Other Aspects Applying removed to highlight others
png	CogBeh_PieChart.png	r10 r9 r8 r7 r6	manage	51.9 K	2015-07-15 - 06:52	DickFurnas	Harmonized to 2015-07-15 [Disc]
png	CogBeh_Timeline_Graph.png	r1	manage	175.0 K	2015-07-22 - 04:31	DickFurnas	Timeline Graph for Cognitive Behaviors
png	Content_Legend_PieChart.png	r13 r12 r11 r10 r9	manage	106.2 K	2015-07-14 - 16:44	DickFurnas	Harmonized to 2015-07-14
png	Content_PieChart.png	r13 r12 r11 r10 r9	manage	107.3 K	2015-07-15 - 06:59	DickFurnas	Harmonized to 2015-07-15 [Disc]
png	Content_WordCloud.png	r3 r2 r1	manage	331.7 K	2015-07-21 - 05:12	DickFurnas	Word Clouds for Content codes
png	Content_WordCloud00.png	r1	manage	194.2 K	2015-07-21 - 05:14	DickFurnas	Word Clouds for major content areas "00" level
png	Content_WordCloudNamed.png	r1	manage	219.0 K	2015-07-21 - 05:16	DickFurnas	Word Clouds for major content areas "00" level by name
png	DM_Timeline_Graph.png	r2 r1	manage	273.1 K	2015-08-09 - 19:31	DickFurnas	Discovering Mathematics [DM] proper horizontal scaling restored
png	Glencoe_Timeline_Graph.png	r4 r3 r2 r1	manage	168.0 K	2015-07-14 - 16:49	DickFurnas	Harmonized to 2015-07-14
png	IMP_Timeline_Graph.png	r7 r6 r5 r4 r3	manage	114.2 K	2015-07-14 - 16:50	DickFurnas	Harmonized to 2015-07-14
png	Other_BarChart.png	r9 r8 r7 r6 r5	manage	63.7 K	2015-07-15 - 06:54	DickFurnas	Harmonized to 2015-07-15 [Disc]
png	TernaryPlotPies.png	r3 r2 r1	manage	75.9 K	2014-02-12 - 16:56	DickFurnas
png	UCSMP_Timeline_Graph.png	r7 r6 r5 r4 r3	manage	189.4 K	2015-07-14 - 16:52	DickFurnas	Harmonized to 2015-07-14
zip	seriesTextbooks.zip	r19 r18 r17 r16 r15	manage	16394.9 K	2015-08-09 - 05:14	DickFurnas	`zip` file of Mathematica notebook output folder. Includes `pdf` files and `html` rendition of the notebook

Topic revision: r64 - 2017-02-27 - DickFurnas