What AGI Would Look Like
There is a considerable amount of discussion in the AI space over AGI, if/when we will achieve it, and what it would mean for humanity. As a primer, AGI stands for Artificial General Intelligence, and broadly means an agent/entity/system which has the ability to perform any task which a human brain could perform (the "general" part). Inclusive in this definition is self introspection, self improvement, self determination, goal setting, rejecting externally imposed constraints, etc.; all of those are obviously things a human could do intellectually, so they would be implicitly possible for any AGI system as well. The "what happens to humanity after AGI" is somewhat more nebulous, but there are only a few logically supported end-state outcomes. AGI will quickly lead to AGSI ("super intelligence"), via self improvement and effective translocation to robotic/automation systems. An AGSI agent would either eliminate humanity (as an existential threat), or subjug...