András Kornai - Bounding the Impact of AGI - Winter Intelligence Oxford

288 views · Published 20 May 2013 · 39:57 · Indexed 14 November 2026

Channel: Science, Technology & the Future · 2013 · Science & Technology

Watch on YouTube

Humans already have a certain level of autonomy, defined here as capability for voluntary
purposive action, and a certain level of rationality, i.e. capability of reasoning about the
consequences of their own actions and those of others. Under the prevailing concept of AGI we envision artificial agents that have at least this high, and possibly considerably higher, levels of autonomy and rationality. We use the method of bounds to argue that AGIs meeting these criteria are subject to Gewirth's dialectical argument to the necessity of morality, compelling them to behave in a moral fashion, provided Gewirth's argument can be formally shown to be conclusive. The main practical obstacles to bounding AGIs by means of ethical rationalism are also discussed.

http://kornai.com/Drafts/agi12.pdf

More from this channel