Differences

This shows you the differences between two versions of the page.

--- super-intelligence [2024/11/22 13:50] – brian
+++ super-intelligence [2025/02/15 15:22] (current) – brian
@@ Line 77: / Line 77: @@
   * Modifiability by self or others
   * Quantum computing
+===== Anthropomorphizing AI =====
+* LLMs have a relatively self-consistent and monolithic system of values and goals
+*
 ====== Notes ======
@@ Line 123: / Line 128: @@
   * 2002 Yudkowsky:
     * "primate evolution stumbled across a fitness gradient whose path includes [..] one particular kind of general intelligence"
+  * skull birth canal limit
   * Challenges/Predictions
     * Understand cetacean language (unless it's trivial like meerkat language)
@@ Line 131: / Line 137: @@
       * Resolve all the TODO comments
       * Refactor all significant code duplication
-    * Number of hours doing economically useful work without human intervention/supervision
-    * Able to be hired for one the 800 BLS occupations with no more supervision than human employees
+It's similarly invalid to analogize the gap between super-intelligence and human intelligence to the gap between humans and some dumber species, be it chimp or ant or bacterium. Such naive analogies assume intelligence is an open-ended scalar capacity, like speed or strength or longevity. The analogy leans heavily on the (dumb?) notion that a dumber entity can't fathom the notion of a
-    * Able to obsolete one of the 800 BLS occupations, like was done to lamplighter, pinsetter, elevator/switchboard operator, telegrapher
-    * Win a prize without human intervention or supervision
+since an ant or chimp can't fathom having human-level intelligence, therefore humans must not be able to fathom having super-human intelligence.
-      * Academy Award: Best Original Screenplay
-      * Pulitzer Prize for Fiction
-      * Nobel Prize for Literature
-      * Academy Award for Best Animated Feature
+One might as well just invoke "super-ness"
-      * Pulitzer Prize for Biography, Nonfiction, or History
-      * Pulitzer Prize for Investigative Journalism
+Saturation: toxicity, visual acuity, height, camouflage, healing, invulnerability
-      * Turing Award
-      * Nobel Prize for Physics, Chemistry, or Physiology/Medicine
+Saturation: algorithmic, computational, domain (tic tac toe), information-theoretic
-      * Fields Medal
-      * Any Millenium Prize
+Such analogies assume intelligence is an open-ended scalar, like
-      * All Millenium Prizes
+altitude, latitude, temperature
+mass, power, body temperature, speed, toxicity, visual acuity, smell acuity
+self-awareness, inerrancy, consciousness, volition, self-consistency, shrewdness, reasonableness, wit, creativity
+integers, reals, aleph
+super-ness
+But assumptions are no more privileged than an analogy to a quantity that has a maximum built into its definition -- such as latitude or humidity or albedo.
+A better analogy would be to scales with definitions that are more subtle, while still being objectively defined, such as hardness, loudness, or sharpness.
+Critique claim that human intelligence would be much higher without skull birth canal limit.