Differences

This shows you the differences between two versions of the page.

--- super-intelligence [2024/10/10 21:29] – brian
+++ super-intelligence [2025/02/15 15:22] (current) – brian
@@ Line 77: / Line 77: @@
   * Modifiability by self or others
   * Quantum computing
+===== Anthropomorphizing AI =====
+* LLMs have a relatively self-consistent and monolithic system of values and goals
+*
 ====== Notes ======
@@ Line 123: / Line 128: @@
   * 2002 Yudkowsky:
     * "primate evolution stumbled across a fitness gradient whose path includes [..] one particular kind of general intelligence"
-  * Challenges
+  * skull birth canal limit
+  * Challenges/Predictions
     * Understand cetacean language (unless it's trivial like meerkat language)
     * For a >10Kloc >5yo production system, without human supervision or intervention:
@@ Line 131: / Line 137: @@
       * Resolve all the TODO comments
       * Refactor all significant code duplication
+It's similarly invalid to analogize the gap between super-intelligence and human intelligence to the gap between humans and some dumber species, be it chimp or ant or bacterium. Such naive analogies assume intelligence is an open-ended scalar capacity, like speed or strength or longevity. The analogy leans heavily on the (dumb?) notion that a dumber entity can't fathom the notion of a
+since an ant or chimp can't fathom having human-level intelligence, therefore humans must not be able to fathom having super-human intelligence.
+One might as well just invoke "super-ness"
+Saturation: toxicity, visual acuity, height, camouflage, healing, invulnerability
+Saturation: algorithmic, computational, domain (tic tac toe), information-theoretic
+Such analogies assume intelligence is an open-ended scalar, like
+altitude, latitude, temperature
+mass, power, body temperature, speed, toxicity, visual acuity, smell acuity
+self-awareness, inerrancy, consciousness, volition, self-consistency, shrewdness, reasonableness, wit, creativity
+integers, reals, aleph
+super-ness
+But assumptions are no more privileged than an analogy to a quantity that has a maximum built into its definition -- such as latitude or humidity or albedo.
+A better analogy would be to scales with definitions that are more subtle, while still being objectively defined, such as hardness, loudness, or sharpness.
+Critique claim that human intelligence would be much higher without skull birth canal limit.