Difference: CodingData (23 vs. 24)

Revision 242010-01-05 - DickFurnas

Line: 1 to 1
 
META TOPICPARENT name="TextbookCoding"

Coding Data

Repository for Coding Data and comments about working up the data for analysis.
Changed:
<
<
    • UCSMP_Topic_vs_Time:
      UCSMP_Topic_vs_Time.png
>
>
    • UCSMP_Topic_vs_Time: UCSMP_Topic_vs_Time.png
 
Added:
>
>
    • UCSMP2 uses custom graphics and includes book 2 data:
      UCSMP2_Topic_vs_Time.png
    • PDF UCSMP2_Topic_vs_Time.pdf: UCSMP2 uses custom graphics and includes book 2 data.
 
Line: 16 to 19
 

Comments

<--/commentPlugin-->
Added:
>
>
  • New implementation of UCSMP graph using custom graphics and incorporating the new Advanced Algebra data. -- DickFurnas - 05 Jan 2010
 
  • I have uploaded reconciled codes for UCSMP Advanced Algebra Ch. 1-8. -- MaryAnnHuntley - 04 Jan 2010
  • -- MaryAnnHuntley - 04 Jan 2010
  • Updated Topics vs Time pdf files with short topic names. -- DickFurnas - 16 Dec 2009
Line: 42 to 46
  Before getting too carried away, I wanted to reconnoiter the first column of the FINALS.xlsx spreadsheet since it seemed to have the most diverse assortment of information in it.
Changed:
<
<
Here are some command-line operations I performed in Terminal.app on the Mac after selecting the first column of FINALS.xlsx and copying to the clipboard:

More... Close

<--/twistyPlugin twikiMakeVisibleInline-->

Scale of stuff to look at

pbpaste | cat | wc
   65536    9807  101150
  • pbpaste takes the contents of the clipboard and sends it to stdout
  • | pipe character which "pipes" stdout to stdin of the following command
  • cat concatenates to stdout . I use cat here defensively: cat seems to do some smart things with encodings, "conditioning" the text for use by other utilities and in this simple pipeline could have been omitted with identical results. I have encountered situations in which subsequent processing of the clipboard contents behaved better when using pbpaste if I inserted cat . It may be superfluous voodoo smile
  • wc performs a word count, reporting number of lines, number of words, number of characters * The clipboard apparently has
    • 65536 lines -- more than I want to look at smile -- Most are probably empty. That number is 2^16 and probably represents the maximum number of possible rows.
    • 9807 words
    • 101150 characters

Scale of unique stuff

pbpaste | cat | sort | uniq -c | wc
     967    2571   14253
  • sort sorts the lines
  • uniq -c finds unique lines, the -c flag says to count how many instances of each line occurred
  • I was actually wanting to see the unique lines, but by starting with wc I got an idea of how much stuff I was going to need to look at, here nearly 1000 lines.

The unique stuff

pbpaste | cat | sort | uniq -c | less
  • same as above except replace wc with less which lets me page backwards and forwards through the output.

The unique stuff of likely interest that isn't a problem number

pbpaste | cat | grep '^[A-Z]' | sort | uniq -c | less
  • similar to above, but only show lines which start with a capital letter
  • grep g eneralized   r egular   e xpression   p arser looks at lines and passes ones which match to stdout discarding non-matches
    • ^ anchors to the start of the line
    • [A-Z] matches any single character in the given range
    • single quotes to protect the search pattern from interpretation by the shell

Check the other stuff

pbpaste | cat | grep -v '^[A-Z]' | sort | uniq -c | less
  • same as above, except the -v flag tells grep to reverse its behavior, send lines which do not match to stdout
  • Why? To see if I missed anything of interest.
<--/twistyPlugin-->
>
>
Here are some command-line operations I performed in Terminal.app on the Mac after selecting the first column of FINALS.xlsx and copying to the clipboard:
 
-- DickFurnas - 2009-09-18
Line: 114 to 69
 
META FILEATTACHMENT attachment="Topics.ods" attr="" comment="Pie Charts of Topic Frequency by book" date="1260827763" name="Topics.ods" path="Topics.ods" size="62869" stream="Topics.ods" tmpFilename="/usr/tmp/CGItemp46973" user="ref2" version="1"
META FILEATTACHMENT attachment="CognitiveBehavior.ods" attr="" comment="Pie Charts of Cognitive Behaviors by book" date="1260827835" name="CognitiveBehavior.ods" path="CognitiveBehavior.ods" size="38510" stream="CognitiveBehavior.ods" tmpFilename="/usr/tmp/CGItemp46830" user="ref2" version="1"
META FILEATTACHMENT attachment="AdvAlgCh1-8.zip" attr="" comment="" date="1262615531" name="AdvAlgCh1-8.zip" path="AdvAlgCh1-8.zip" size="152355" stream="AdvAlgCh1-8.zip" tmpFilename="/usr/tmp/CGItemp45051" user="mh688" version="1"
Added:
>
>
META FILEATTACHMENT attachment="UCSMP2_Topic_vs_Time.pdf" attr="" comment="UCSMP2 uses custom graphics and includes book 2 data." date="1262710158" name="UCSMP2_Topic_vs_Time.pdf" path="UCSMP2_Topic_vs_Time.pdf" size="79734" stream="UCSMP2_Topic_vs_Time.pdf" tmpFilename="/usr/tmp/CGItemp46629" user="ref2" version="1"
META FILEATTACHMENT attachment="UCSMP2_Topic_vs_Time.png" attr="" comment="UCSMP2 uses custom graphics and includes book 2 data" date="1262713413" name="UCSMP2_Topic_vs_Time.png" path="UCSMP2_Topic_vs_Time.png" size="66527" stream="UCSMP2_Topic_vs_Time.png" tmpFilename="/usr/tmp/CGItemp46633" user="ref2" version="1"
 
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.