rewrite_this In examining the pathways through which technology augments our intelligence, there are three key components to consider. First, technology serves as a tool for thought, providing leverage for our intelligences. Second, technology can tap into one or more modalities? types of human intelligence, potentially engaging humans with ideas through more channels than has traditionally been possible. might combine these 1st two into one And third, the ease and richness of the interface between human and computer affects our ability to use it as a tool.

• Computers as a Tool for thought:
  • Early computers worked with existing paradigms, mimicking existing modes of thinking. Computers wrote linear documents, just as had been written by hand and then by typewriter, albeit computers added richer editing capabilities.
    • Some trace many modern computing schemas to thinking that is still rooted in the printing press, and fault this way of thinking for the limited ways in which computers currently augment our intelligence. (Personal conversations * - need to see if this was an idea they had found/written in the lit somewhere.) - edit, this is more relevant to types of human intelligence
  • But the power of computers as levers for our use is richer than being fancy printing machines. Computers are a tool that allows us to interface with symbols, with representations of ideas, in new ways.
  • Picture a computer taking a complex set of paragraphs, each paragraph representing an atomic thought or idea, that might be explicitly linked to some other related paragraphs. Some of those paragraphs are related hierarchically to other paragraphs, with those higher up more abstract and those farther down, more nuanced. For a computer to allow those paragraphs to be shown in multiple places, where an edit in one place propagates across all instances; to further place those paragraphs onto a two or three dimensional spatial plane that allows for rearranging and playing around; to allow the saving of multiple instances of those spatial planes; to offer visual libraries of drawings or icons to give representational anchors to ideas such that the human sees the icon and recalls the idea without reading; to seamlessly switch back and forth between spatial and more purely textual representations of ideas; to, in short, allow a human to play with and rearrange ideas in looking to compare, contrast, and find patterns across a large repository of thoughts - for a computer to do this is nothing. Nothing, in that it requires little effort on the part of the computer, but nothing too, in that it means nothing to the computer. No additional insight can be obtained by a computer by changing the abstraction, the representation of an idea. But a human that is given the power of such a computer sees a tool that allows for the generation of new ideas, insights that come from multiple representations of thought and the ready recall of information at unprecedented scale. This is the computer functioning as a tool for thought, as a tool that allows for more innovative and insightful human thought. Computers and humans each have powerful and unique sets of capabilities, and the computer as a tool for thought allows for a complementary synergy.
  • A computer can easily take a complex set of information or ideas and display it from multiple perspectives, including or excluding specific sources or types of data, and shift back and forth between any of these perspectives on demand. This is something that is difficult to replicate with analogue tools- and computers can do this at a scale that the pre-computer world could not dream of. Insights drawn from these representations are generated by the human rather than a computer; the computer here serves as a tool rather than as an Artificial Intelligence (to the extent that the computer generates insight, it displays a higher level of the Artificial Intelligence dimension).
  • Computers allow us to manipulate information in ways we could not otherwise do easily, or at all. Computers can present the same information in multiple perspectives, such that the human can examine ideas and data from multiple views, and ask the computer to include or exclude sources of date or ideas. Computers in this way allow for a dynamic manipulation of data and ideas, crafting a medium that could not be represented using analogue methods. New representations of thought allow us to tap into latent capabilities that we already have, where humans rather than computers are the ones generating insight (as opposed to when technology functions as Artificial Intelligence), but it is the representation of ideas or data, through the capabilities of the computer as a tool, that makes this insight possible.
    • Many great ideas in history have been realizations that data could be represented in different ways: maps of the world, algebraic notation, data visualization.
• Related to the computer as a tool for thought, is the dimension of the types of human intelligence that the computer taps into. just laying out thoughts for now - will make the writing pretty later
  • Picture knowledge work, often picture working over books and paper, or a computer. The medium shapes how we envision it. @Victor2014HumaneRepresentThought
    • Reading, writing, talking about ideas with others - taps into visual, aural modes of understanding.
      • According to Jerome Bruner, taps into symbolic, but not enactive or iconic.
    • If can add ability to diagram in 2D add spatial; for Jerome Bruner, add iconic
    • If can move into 3D space and allow for dynamic manipulation, tap into kinesthetic, maybe even tactile; for Jerome Bruner, maybe add enactive
  • Technology today largely taps into the same types of human intelligence that knowledge work tapped into when we worked with pen and paper. Read and think, put your ideas into words and 2D diagrams, dialogue with others. But human intelligence is broader than this.
    • When we ride a bike, we understand how it works kinesthetically (understanding lives in performing of it), iconically (graphic understanding of how gear ratios work, wordless way of understanding), symbolically (language). need to show an example that is more clearly the realm of knowledge workers but still has non-language representations. Maybe understanding of something in astronomy? Or engineering. Bike could still work, but have to talk from engineering perspective.
    • Bret Victor goes so far as to call this style of knowledge work "inhumane," in that it forces someone to live in a way that severely constrains them - our method of knowledge work limits how we think, and takes away from our full range of intellectual capabilities @Victor2014HumaneRepresentThought.
  • Technology can enable multiple types of intelligence. Spatial representation of thought, possible today. Picture a simple technology that draws upon a visual library to offer icons to anchor to ideas - allows easy adding of visual elements - possible today. Allow humans to explore complex dynamic systems, in 3D, that are accurate and explorable models that draw on real data - maybe not quite possible today, maybe beginnings of this with AR/VR.
• While the capabilities of the computer as a tool for thought form the foundation for its augmentation of intelligence, equally important is our ability to use that tool - to give instruction to the computer.
  • In early days of computing, all instructions had to be input via punch cards, and visual displays were largely text-based [@Rheingold1985]. Even the addition of some basic graphics required a supplementary screen with a dedicated technology. Communication between human and machine was very rudimentary. With the introduction of successively more sophisticated programming languages, programmers were able to give richer instructions to computers, and with time, create interfaces such that non-programmers could talk to computers in specific ways [@Rheingold1985]. This last step was an important one, as it finally presented some of the power of computing to those who did not program - in other words, to those who did not speak computer. Computers were finally learning to speak our language, rather than we, theirs. Recent advances in natural language recognition have improved further the ability of computers to understand our language, and the field of Brain-Computer Interfacing [BCI; @Wolpaw.Birbaumer.ea2002] is exploring how in the future we might interface more symbiotically with computers and realize early visions of the computer as a symbiotic tool [@Licklider1960a].