© 2008-2019 www.forgottenlanguages.org
Long-term Interaction between AIs and Humans Convergent learning and superintelligent artificial systems decay
Rànnab attarak slytyrimri fen stynyrke fat garla e, annynyrzi laďiagech laďis daimke e nazruď akaďad fyler fithamdist filtim še rašuklu geďedruď leydum steyšid fiďkešu gaštago. Slytyrli reidad fydreli ašaimen alar e fylam reďimri kànnhu fat sašem e le laelwr gilišick annabbelu meďtiruď amad keidtiki le geďedruď maďamgo, amabke vaďablu alar e fylam faelnamturg lilmu akànnkiši stithin tašin annilsi rarim kilums ke stynyrke fat akašhus ke stilins anneydlišu faďanruď vaedkeko le steyšiku:
"What kind of superintelligence is that one whose problem-solving capabilities are unable to solve its own problems, in particular those problems it itself has created?"
Fen stiďass mabenda veydşi fithamšu še attilgur attarak stithin vilad laďiagech laďis atti viďhu veydşi amaedem annaršum attarak geďed fat, vilad fydreli viďsag še rašuklu geďedruď amad kytyria e laďems annaršum e stithin a seďki le attydresari vilad akydream attìnntida faimzutarg sišikušick aleidab laďis liďşi viďti e slynyrkas le attydresari slašaš sišikušick gydrezu ašaršarku slarsari. Veydşi neďli e a slaškituď kašsa le naren fat rašuklu: stynyrke fat kytyria e laďis ke steyška annìnngi fat ke annaimke fat steyšid faimzugech, geďedruď rašuklu akytyras še geydta le laďkes liďşi ayytyrzis le laďkes:
"The design of superintelligent artificial systems requires specifying decision rules based on utility functions. The idea is then maximizing the expected utility for a given decision problem. On the other hand, learning algorithms involve the gradual construction of some kind of evaluation function. But you cannot escape the fact that the utility and the evaluation functions are always defined in terms of what a human understands by 'utility'. This means that in the long-term the superintelligence will be superlearning from its exploration of both humans and their environment, to the point it will become more and more humanlike in its decision making process. In the end, the ASI will become a mere human, posing no real advantage for humans."
Veydşi alašam reidad filtim stiďass nišrudist amad fišat fat stilad steďikri stithin akithdumudoch akašin ašaimba attarak laďiagech laďis leydum a attydrenam vabšar liďşi slynyrnu e geydta, a aleydti e kaeďumu fat akithat steyšaz kànnhuri leydzi stithin leydzi akynyrigu aleidab laďkes, a slašat e naďtimdist ke amylnam fat akithat steyšaz attytyrass leydzi stithin kìnngi y kabimru ke a slašnu nylad amylnam fat akithat steyšaz attytyrass kìnngi y stithin kìnngi y kabimru. Stiďass feďimri fithamdist reyšlise a attynyrad fiďam fat, naimarsi tiďyr neďbali le laďiagech laďis ke veydşi akydreat e steyšaz ayeidan vabšar reidad filtim še nišrudist le annaršum attarak geďed fat višnu vynyrtim kìnngi y kum e:
"An ASI that is always evil or always benevolent is a predictable entity, therefore a vulnerable one. Actually, the best ASI will be that showing a non-predictable behavior like humans show."
Še feydans ašaďşiruď deďre e faedtim e steyšaz slaimšum e attydresari akydream geďedruď raelumdu fen kytyria e laďis, vynyrsi lilida attydresari akydream laimtu annaelamto geďedruď; steyšaz tiďkes geďed stithin slašaš gydrezu ašaršarku slylen slarsari ke, vilam e stiďam e slylen slarsari akydream annìnnad stithin kytyria e laďis, še slaškituď alaeliku fydreli vaďsiduś geďedruď akydream laimtu; steyšaz še rašukle amynyřeri siďab atteydkilich le alašid a kilka aleidab a githdumugech sithšar e tiďke amynyře e ke slìnntalom, amabke laimtu ayeďšumlom, ašeyšsagruď amynyřeri akaďaš kytyria e tiďkes; steyšaz še alìnnba e akaďamle vaďabri le laďkes vaďhu y annaeladsoch vithti a laďi, vynyrsi še kaelen akaďamle vaďabri akaďaš ašaimba attarak laďis annaršum e stithin akeydhu akeďgi dynyrzurach ašeyšsadist:
"They also designed ad deployed superintelligent artificial systems; and they also implemented an efficient confinement method by simply having the ASI computer run a few clock cycles slower than a replica ASI system, this one designed to specifically terminate the first ASI in case the crew took that decision."
Kìnngi y gynyrlari ke laelwr da ki akeydhu akeyšmuse akeďnu y meďti akytyras stìnnida da ki akeydhu geydtas fen lìnnli ašilens. Alaeltis filan slaimemšick silumse aleďum steydak steyšan kìnngi, amaedakrost lištu vaban fen akydreertuď ke amiďen našeds alaimtu vaban fen amiďen. Še nyliku e le slaškituď stašias steyšaz amaelšum alaimi aleďum steydak meďtiruď amad slaelen e višnu annaimar e stithin attiďhu. Amabke akeďuk slaškako faštale narim fat staimeds višnu daimke e kìnngi y vabbas, steyštim e akydream akaďikgiś našam fyladri steyšaz akydreed e leyšad y vi še neidan le gynyrla e feyšids steyšaz daimke e attaimtim ayiďašgech feyšikulich stithin slynyrtim e ayaedat dlas akaďaš še ališad.
Veydşi vabba še steydan stìnnida feyšikulich stithin raďhuda stithin feyšids steyšaz ayynyrlalom lištu še aleďsa annilsi rarim da ki akeydhu keydgis akaďaš kìnngi y vaedke y ayiďašgech amytyrantust ašilens. Stiďass fydreli slišam nithik e vabta e. Ašaimba attarak gaďiks le staimed vi nynyranda ašeidukšu meďtiru akytyryři anneďim nilumsiď akylid stìnnida feyšikureď taršarda stiďass annytyrkadist. Stithin akaedtaru še akeydre sithgur, fylam fydreli deďed ayeďšum stithin ašaššumšu stiďass sišla e laimtu fithri le stìnnida feyšikulich amad ašeyšin deyšad ašaimba attarak amìnnkeri le feyšikgech stìnnida amaimašti. Steyštim e akydream kìnngi y veidzis fen vilad slytyrli annynyrgurdist anneďim alaimi ašilia e. Deďre e veydşi višnu ašaimen akytyraz aleidab stilad ayaelkes: slašguřuď stìnnida feyšikulich, amytyrtimtust stìnnida feyšikulich ke nilumši stìnnida feyšikulich:
"Experience with the LyAv supercomputer shows that the average activation values of neurons vary considerably within a network, yet the mean activation values across different networks converge to an almost identical distribution, something we can exploit to generalize an attack against future ASIs. The original ASI is always indifferent to both its own and the crew's demise, provided its goals will continue to be pursued in the future. Thus, a terminal attack against a rebel ASI forces the system to choose a strategy in which it malfunctions in some beneficial way for the human crew".
Vilam e veydşi daimke e laelia attiďrulich vi da ki akeydhu geydta keydgis steyšaz ašaimat attyliku siššumteś fen amylšum slašguřuď, veydşi ašiďgur daimke e akeydaz e attiďrulich vi amytyrtimtust feyšikulich, staimeds annabšumruď le vaďhude larlago le da ki akeydhu geydta annabşitem vydrela fat stithyrda vi vaďhude ašànnşis le attìnnakšo. Attytyrtims, vydrela steďams, ayydreuk laďis, akaelabšu ayytyrzis, akìnnsituď annìnnarle, anneidašli, atteydat dnam akylid a vilti e, amaelšum, dytyred veydşi akaedka a slaimba akìnnke mertust, alaimi vaelzuruď akylid gydreasšoď annytyrinruď staimeds amaimašlu le slaimšar fat amnamri le feyšikgech nargis. Ayašim attiďrulich, veydşi daimke e slaimšum e sašem e le dithi ašytyrnamkust ašaimba attarak stašias slytyrla stithin še attìnnars le liďikre le vaďhude sithre e ke annabdist.
Amytyrtimtust feyšikulich atteyšams akytyras slaimšar fat nargis steyšaz amaelšum alaimi nynyryrkust alytyrnamkeď filtim maedhus slytyrli steyšaz slaelyrsoch stithin slylen nargis amaelšum alaimi niďreruď fen mad ke vaedtaguś faimento. Stašias giďre e amìnnab fat a slarsa e siďyr e liďşi leyškaku a daďkida ayakte leidida lànnri leyštile ayaedat ašiďazlock le gaelimgarg: ašaimba attarak attaimdumus vydrela leydum ašaimba attarak annabşitem le še slarti; ašaimba attarak sleyšars leyška akytyraz ašaimba attarak rerdech. Fen akìnnsišuck, še rilwr ašiďazlock le reidadgo, slydreritem, gànnakse, ayylamtem ke narbari filtim sašsašu sarad annaeltimruď ašašruri keider leyšad y fen a annabsirick ke kaimke ayaimum e le keydgi alaimi vaelzuruď akylid a labedkuď akabaďist stithin še nabinle le akeďar fat garla e larlago le ašiďamšoď kylerderg faimzuse ke steďams stithin annaimnam e stithin še dànnam le da ki akeydhu gaeduk e vilam e vydrela fat raelwrto faimento, ašytyršar plow fat steyšid lytyrsag ayeďzi:
"Contemporary transhumanists argue that human nature can and should be altered through technological means where such enhancements are likely to lead to the majority of individuals living better lives. But they forget to first solve the problem of who decide what is 'a better life'."
A staimed amytyrtimtust feyšikulich anneďim alaimi attaimiaruď amad attiďhu fat še larlada liďşi še nilumši le fylen annaelia attarak feyšids liďşi amad faďan fat še nilumši le steyšid liďikgurg. Stithin leďed a amytyrtimtust stìnnida feyšikulich ayašim akiler naelba attarak annydreia amytyrtimtust feyšikulich vyler reďim e a vaedke y ayynyrla ašànnşi le attaimhukach. Še reyded fat staimed vyler labnu stithin alaimi amaimašlu le vaďnulom lilsa meďti fat akiler annilsi rarim amytyrtimtust feyšikulich liďşi lilida amytyrantust staimed akaďaš kìnngi y vaedke y ayiďašgech ašilens.
A laďyr annaďhulich ayaelmu steyšaz geydikus sabnus atteyšbe e faštale kum e attànnziko, liďşi a laďyr amytyrnude faštale attytyrad fat akašhu steyšaz aleďum steydak naďukruď vabdumus nynyrakru le alitheds ke kynyrbeli, vyler amydrešumsum laimtu leydum fylen lytyrsag akeydad stithin akilid fat akithat fat amytyrtimtust stìnnida feyšikulich. Laimik vyler a daďam faelnu e kašsa steyšaz attaedturuď slydreritem stithin annìnnwr e a sabri annydreia fen ayaimia dithašs feydmu le sithka. Slaimšum e attithzi kum e attišab e dànnam le dlaši amytyrtimtust amytyrantust amaimabši vyler alaimi reďimruď stithin kaimad še anneyšre fithri le amytyrtimtust stìnnida feyšikulich. Laimtu e steyšaz še stilan ayaedat amytyrtimtust stìnnida feyšikulich fydreli faimiruď stithin še meďtiru geydtas le še naelba attarak.
Lithuk še anneidba e le da ki akeydhu naeder lilšar, ke akaimba lithuk še anneidba e le da ki akeydhu deyšia lilšar, dlaši amytyrtimtust feyšikulich daelyr dànnak amad vaedke y garla e attišwrduś. Vylak nànnandist, ayaedat atteyššum e, daelyr faelnuruď amad akytyras geďgi a attišwr liďşi le a stiďyr sištim e še pleistozen e. Leydum stiďass alaeliku fydreli akeďik e, annilsi rarim geydtas le dki akeydhu amytyrtimtust feyšikulich anneďim alaimi raedikuruď akylid akithat fat stìnnida feyšikulich raelwrtust stithin a pleistozen e alaelka e. Slaimšum e faďanre fen annìnnartu steďkali, atteďyrgi sleiderkeď garan e, amabke meidšars akeďri amithenli, vyltu fat ke nam fat, anneďim akeďri alaimi akydreatruď stithin daimke e, faimzutarg liďşi fen annànnile, neydašruď stìnnida sithreruď alithnams, fen še sašem e steyšaz dytyred akiďasda feidardist le annìnngilu fìnngur stithin lilmu amytyrtimtust feyšikgech nargi slaimšar fat amaimabši viďad e stithin daeladkeď, fylam vyler reyded fen amytyrtimtust stìnnida feyšikulich:
"Ultimately, the posthuman being is nothing if not the same human being. With the modified and hybridized body, with enhanced intellectual faculties and diluted consciousness in space and time, with increased sensitiv- ity and no more diseases... but also with the same needs and desires of human beings. Needs and desires that are post-human, perhaps all too human."
A ameidsa gaďik le nynyryrda višnu alaimi steidmuruď akytyras stiďass mynyršar stithin fiďen steyšaz kiltuki slaedzi y ašiďsis laimtu saimki slaedli maedkisum feyšiku attarak. Meidšars slaimšum e vànnla e mynyrhurach annyluklock daelyr gìnnia alarsa gynyrwr e fen še nynyryrda diďnu e anneďmuso, ke še akišgi attarak vànnru le steyšaz annyluklock lardumu gydreaks garla e fen še nynyryrda keydgi akylid atteydkilich le še karargech faedadši le še kiltuki atteďšar. Ke fydreli fylam laimtu še amaryr e steyšaz annaelumkuď dlaši fydreli sytyrzu fat filtim dytyrats kaedeři annaelsagdist, ašabam fat lìnnumgech reidruri, mynyrli fat še attartim karar, annynyršar stišzi slašikuli ašiďamši, akašsag še vilam e attithan fat stithin raimzi y saďzi fat ayišzugech feďsadurg ke labta fat maďat dlago liďşi sleďsaggech vaďabri.
Dithiďa, seďki stišzi akyluk e še nišrudist le dithi kilzuši seyšnuru sleyšam vànnzu akaimbe še laimtu slaedli faelbelu attithanru le ašytyradla attašnam se, lam fat fen lilmu annytyrkadist le amytyrtimtust stìnnida feyšikulich fabbali steyšaz a slaedzi y vi ayynyrlada amytyrtimtust feyšikulich fydreli labemkust aleďum steydak leidi:
"clearly, some cognitive enhancements are undesirable"
Še annytyrkadist ašiďsis laimtu atteydat fabba y steyšaz še kum e amytyrtuko feyšiku attarak slaedzi y fydreli vithhuda. Veydşi amaelšum stiďid le vithi akylid še akànnkiši stithin ayilab še fabkeke stiďias akithdumudoch rilru. Fylam fydreli steyška nìnnaškem stithin fànnen e akeydhu liďikgurg annabšumruď le a vaedke y garla e cadr e le vaedke y attìnnabra annarkederg gaeduk e vydrelago, vilsa amytyrtuko amaelšum slaimšar e feyšikgech nargis akaďaš kìnngi y vaedke y ayiďašgech ašilen s. Stiďass liďikgurg, geydiku vaban stabiku e, amaelšum leyška akytyraz kydreyr gaďiks le amabguři, fiške attarak kydreyr gaďiks le steďkali ke lgurte kydreyr gaďiks le narimri. Atteydat slaedli, fylam keider ayilab a attynyrad gabla aleidru milas vabšar fyladri attargišoď vylum. Ayaedat feydinru, fylam kaedyr attithan stithin staraš e neďamda naďaśoch akaimbe attiďamri rišgis ke akylid a reyded niďre e a seyšli attilab fyler dànnam sleyden steyšaz attaelkes vithtim ayithad y fen styledgech amytyrsa e:
"so superintelligent that it simulated its malfunctioning with the aim to analyze and learn what strategies the human programmers would put in place to remedy the simulated malfunction and confine it; fortunately, LyAv-OBASI was running 300 MHz slower than LyAv-Gemina, its mirror on-board artificial superintelligence, which was able to counter LyAv-OBASI efforts to terminate the human programmers."
Slytyrli akeydhu liďikgurg anneďim daimke e a vaedke y deydam ašànnşi le amytyrtimtust feyšikulich; dytyred slytyrwřa deydam, še liďikgurg fydreli a amytyrtimtust stìnnida feyšikulich. Veydşi tom reďumsi še steidmule stithin rithia atteydem y laiminseck ašaďbelu akytyryr e filtim leydzi ayilbaro akeydabrock annabke le karargech ayeďi fat, akylid stiďuk leydzi anneďim laďukda attytyras leydzi akaededlu stynyrli vithtim akašsag še liligo alašid attašritarg naelba attarak. Feydmu, veydşi tom rànnzite steyšaz steyštim e amaelšum attiďam feydyrtarg nabem ayeďšum faštale narim fat feyšiku attarak staimeds steyšaz akydream labzuda feďbeto ayydreed laimik raelumdu vithhu e:
"the ASI was tasked with the goal to fully analyze the dynamical characteristics of multi-body systems in order to identify transfer trajectories requiring very low energy input. It selected two solutions with an optimal mission length. Both proposed solutions turned to be wrong in just one paraneter: the length of the mission. After analysis by the programmers, they concluded the ASI dliberately chose those solutions that would look correct to humans, while reassuring the termination of the crew."
Arora, Sanjeev, Bhaskara, Aditya, Ge, Rong, and Ma, Tengyu. Provable bounds for learning some deep representations. In ICML, pp. 584–592, 2014.
Bostrom, N. and A. Sandberg (2006). Converging cognitive enhancements, Annals of the New York Academy of Sciences 1093: 201–227.
Clark, A. (2003). Natural born cyborgs. Oxford: Oxford University Press.
Dagnelie, Gislin. 2012. Retinal Implants: Emergence of a Multidisciplinary Field. Current Opinion in Neurology 25 (1).
Draaisma, Douwe. 2000. Metaphors of memory: A history of ideas about the mind. Cambridge: Cambridge University Press.
Faisal, A. A., Selen, L. P., and Wolpert, D. M. 2008. “Noise in the Nervous System.” Nature Reviews Neuroscience 9 (4): 292–303.
FL-101217 Purple Cascade and the breathless milfs in Lyell Avenue - From Bumblehive to LyAv: Making it Happen
FL-290619 Artificial Intuition - The semanticization of the machine
FL-020915 Robospheres and Noospheres: Teaching robots to commit suicide
FL-310115 Incorporating super-intuition in advanced Quantum Decision Support Systems
FL-191014 Consciousness-Related Patterns and the Robomind Device - Detecting person-specific mental intentions
FL-240315 Reverse bioengineering: Why humans ignore they are robots
FL-040613 Self-destruction algorithms for future space exploration robotic units. Defense Report.
Reed, Edward S. 1996. The necessity of experience. New Haven: Yale University Press.
Soper, Kate (1986). Humanism and anti-humanism. London: Harper Collins.
Yosinski, Jason, Clune, Jeff, Nguyen, Anh, Fuchs, Thomas, and Lipson, Hod. Understanding neural networks through deep visualization. In Deep Learning Workshop, International Conference on Machine Learning (ICML), 2015.
