Social reputation systems: It’s about ethics in Artificial Intelligence

Alexandra GiannopoulouUniversity of Paris II Panthéon Assas

Twitter: alex_giann

“donned his robe, and took a sturdy staff, and went toward the door, limping; whilst round their master his servants swiftly moved, fashioned completely of gold in the image of living maidens;

in them there is mind, with the faculty of thought; and speech,and strength, and from the gods they have knowledge of crafts.These females bustled round about their master….”

Iliad, Book 18

AI in science fiction

“Humanity’s biggest existential threat”

“could spell the end of the human race.”

Control !

Regulation!

With intelligence comes power1. A robot may not injure a human being or, through inaction, allow a human being to come to harm.

2. A robot must obey the orders given it by human beings except where such orders would conflict with the First Law.

3. A robot must protect its own existence as long as such protection does not conflict with the First or Second Laws.

“without an ethical framework (that adheres to human values) super-intelligent AI would replace humankind as the dominant species, possibly exterminating us”.

Peer reputation system : for a better hybrid society!

“He’s applied for the experimental Class V license twice but we turned him down both times. His reputation score is borderline. He’s trustworthy, just odd.”

The last firewall

Reputation as a mechanism to organise communities => Feeling of belonging

Reputation as a system to facilitate the process of assessing reputations within the context of a specific community => Trust-building

Reputation building through contributionstowards the community goals and values

Examples? 1) FLOSS 2) Wikipedia

What is a valuable contribution?

Hierarchy through reputation system

In order to become an administrator, “make useful edits over a period of time. In this way, you prove to the community that you are here in good faith. If the community agrees that you're what they want in an admin, then, voilà ”.

Reputation is not an explicit value. Social value is not uniform but depends on which community the reputation was created in.

Trying to take the implicit value of reputationsystem and transform it to a numerical value.

Will it work?

Define citizen and citizen rights!

Discretionary power of the “Institute of Ethics”

AI is turned into a second class citizen

and knows it

Community of peers: humans are “more equal” than AI in the peer reputation system

AI will not stand for this inequality!

Consequence : WE ARE DOOMED

Unless…

Humanity 2.0

Thank you!