To add comments or start new threads please go to the full version of: Potentially The Most Important Thing Ever
PhysForum Science, Physics and Technology Discussion Forums > Technology > Technology

arpc_01
Hi all, I would like to know your opinion on this matter:

-

If you were to create a computer AI directly modeled after a human intelligence, so that it has the ability to learn and improve its own intelligence, then it could:

Make itself smarter, by thinking and learning;
Use this new knowledge to increase its own processing power (by rebuilding its computer system so that it is faster) and rewrite its own code (to make itself more efficient at utilizing this processing power).

Result: An exponentially intelligent intelligence, which - given enough time - could process all available data in the universe, produce every possible conclusion that can be drawn from this data, and effectively know everything there is to know.

-

I stole this from Isaac Asimov's "The Last Question". But it struck me:

Humans are unique in our ability to understand (an assumption, but i think we can generally agree that humans are unique). If the infinitely complex chain of events that has led to the existence of our species has any purpose to it, is it not reasonable to assume that that purpose is to understand? (and is it not reasonable to assume that everything has some - at least relative - purpose to it?)

Under this assumption, building this intelligence would be the greatest, most important thing we could possibly do as a species. Shouldn't we be concentrating all of our efforts/resources on making the construction of such an intelligence feasible? - especially if you consider the end of the story ph34r.gif

-

There are probably a lot of stupid assumptions in this post which I've missed, and I would appreciate it if you could explain them to me.

Happy Friday everybody

tongue.gif
light in the tunnel
QUOTE (arpc_01+Oct 23 2009, 10:46 PM)
Shouldn't we be concentrating all of our efforts/resources on making the construction of such an intelligence feasible?

It seems like whenever people try to construct intelligence "as a species," they forget to construct it as individuals and everyone ends up a stupid proponent of species-intelligence. My cynical opinion, of course.
arpc_01
QUOTE (light in the tunnel+Oct 23 2009, 11:03 PM)
It seems like whenever people try to construct intelligence "as a species," they forget to construct it as individuals and everyone ends up a stupid proponent of species-intelligence.  My cynical opinion, of course.

May be true, but in the midst of such an important undertaking, does it matter?
light in the tunnel
QUOTE (arpc_01+Oct 23 2009, 11:28 PM)
May be true, but in the midst of such an important undertaking, does it matter?

Ethically it does. And, besides, what is the point of collective/species intelligence or any other collective achievement except the good of one or more of the individuals subsumed within the collective?

What is species-intelligence if not individual intelligence? A way to turn humans into relatively ignorant but healthy zoo-specimens?
arpc_01
QUOTE (light in the tunnel+Oct 24 2009, 01:13 AM)
what is the point of collective/species intelligence or any other collective achievement except the good of one or more of the individuals subsumed within the collective?

This is exactly the point. I don't know what value any achievement has outside the good of the collective, but if an achievement can have intrinsic value independent of the collective this is it. It would be like making god. Surely that must have some value in and of itself?
light in the tunnel
QUOTE (arpc_01+Oct 24 2009, 02:03 AM)
This is exactly the point. I don't know what value any achievement has outside the good of the collective, but if an achievement can have intrinsic value independent of the collective this is it. It would be like making god. Surely that must have some value in and of itself?

My observation is that so-called collectives are nothing more than cognitive-imagery that has the function of giving meaning to directly-observed individuals and social events.

Individuals are empirically observable. Collectives are only empirically observable as representations. Any empirical observation of a collective can just as easily be described as projecting meaning onto something that is meaning-neutral from an empirical perspective.

A good analogy would be observing a constellation. You can observe stars empirically, but to observe a constellation you have to superimpose a cognitive pattern onto the stars that relates them to each other. This is projecting meaning onto empirical observations, as opposed to just observing them.

So I'll rephrase my question: what achievement of collective good exists that is not directly an achievement of good for an individual entity that is defined as being part of the collective?

Can an achievement have intrinsic value independent of the beneficiary?
I don't see how any value can be independent of a beneficiary. God has benefiaries. That seems to be the whole purpose of creating a mythology of a creator; i.e. to claim that the creation had benefited from its creation, that entities have intrinsic value as life, which is its own purpose.
arpc_01
QUOTE (light in the tunnel+Oct 24 2009, 03:12 AM)
So I'll rephrase my question:  what achievement of collective good exists that is not directly an achievement of good for an individual entity that is defined as being part of the collective?

Maybe this is the first one.

QUOTE
I don't see how any value can be independent of a beneficiary. God has benefiaries. That seems to be the whole purpose of creating a mythology of a creator; i.e. to claim that the creation had benefited from its creation, that entities have intrinsic value as life, which is its own purpose.


Ok, god was the wrong term to use. What I meant was: an omniscient being.

As to having no value independent of a beneficiary: I can't refute that.

But i have found that humans naturally believe in value independent of a beneficiary. We express this belief in, for example, making art for art's sake. Or protecting other forms of life even when they are of no value to us.

Maybe this is just silliness, but I think there may be a reason behind it; that we instinctively know, at some level, that existence has some intrinsic value to it. And if it does, then it's not that big of a stretch to say that understanding this existence also has intrinsic value to it. Another belief we express in our pursuit of understanding, even when it is of no benefit to us.

If understanding, gaining knowledge, has some intrinsic value to it, then building this intelligence would be the most valuable thing we could ever achieve, as it would be the most efficient way of gaining knowledge.
light in the tunnel
QUOTE (arpc_01+Oct 25 2009, 10:03 PM)
But i have found that humans naturally believe in value independent of a beneficiary. We express this belief in, for example, making art for art's sake. Or protecting other forms of life even when they are of no value to us.

Maybe this is just silliness, but I think there may be a reason behind it; that we instinctively know, at some level, that existence has some intrinsic value to it. And if it does, then it's not that big of a stretch to say that understanding this existence also has intrinsic value to it. Another belief we express in our pursuit of understanding, even when it is of no benefit to us.

If understanding, gaining knowledge, has some intrinsic value to it, then building this intelligence would be the most valuable thing we could ever achieve, as it would be the most efficient way of gaining knowledge.

Ok, I think I see what it is you're thinking of. At the risk of starting another theism/religion battle thread, let me try to address why I think there is this idea of art for art's sake, etc.

Egoism is human selfishness. It is criticized because it involves a willingness to sacrifice others' well-being in favor of an individual ego, "me," or a collective one, "we." Altruism is the idea that humans can act "selflessly" and put the good of others ahead of their own, even when this requires self-sacrifice, which some take as the measure of altruism.

There is also a third-way, in which the good of any and all is valued, with the idea that no one should be sacrificed for anyone else's benefit. I associate this idea with the idea of "God" because if you identify with the idea of an entity that was the creator of both yourself and everyone else, then you can possibly see why He/She/It would not want any of (I'll just say "his" for convenience) his children sacrificing themselves for others, or others for themselves.

"God" is also the idea that a creator exists whose creation had the purpose of re-creating his own image of creative power and everything else about his spirit in his replicants. So, divine creation is the idea, at least, of "art for art's sake," in the sense that creation is seen as good and the purpose of it is to foster continuing creativity in others. Once again you have the helping yourself by helping others, or vice-versa, concept that eliminates the belief in self-sacrifice for others or other-sacrifice for self.

So the intrinsic value you speak of, to me, seems like the very idea of value and goodness itself, and the idea that the value of certain things go beyond being of value to one beneficiary or another. It's not that they have "collective" value; it is that they have value both as process (for the producer) and product (for the user). Good art (for art's sake) would be an example, as would any work done that is the product of love (of the work itself) and enjoyment, which is also beneficial to the recipient of the product or service produced, whether this is the worker themselves or another person.
arpc_01
QUOTE (light in the tunnel+Oct 26 2009, 03:50 AM)
Ok, I think I see what it is you're thinking of. At the risk of starting another theism/religion battle thread, let me try to address why I think there is this idea of art for art's sake, etc.

Egoism is human selfishness. It is criticized because it involves a willingness to sacrifice others' well-being in favor of an individual ego, "me," or a collective one, "we." Altruism is the idea that humans can act "selflessly" and put the good of others ahead of their own, even when this requires self-sacrifice, which some take as the measure of altruism.

There is also a third-way, in which the good of any and all is valued, with the idea that no one should be sacrificed for anyone else's benefit. I associate this idea with the idea of "God" because if you identify with the idea of an entity that was the creator of both yourself and everyone else, then you can possibly see why He/She/It would not want any of (I'll just say "his" for convenience) his children sacrificing themselves for others, or others for themselves.

"God" is also the idea that a creator exists whose creation had the purpose of re-creating his own image of creative power and everything else about his spirit in his replicants. So, divine creation is the idea, at least, of "art for art's sake," in the sense that creation is seen as good and the purpose of it is to foster continuing creativity in others. Once again you have the helping yourself by helping others, or vice-versa, concept that eliminates the belief in self-sacrifice for others or other-sacrifice for self.

So the intrinsic value you speak of, to me, seems like the very idea of value and goodness itself, and the idea that the value of certain things go beyond being of value to one beneficiary or another. It's not that they have "collective" value; it is that they have value both as process (for the producer) and product (for the user). Good art (for art's sake) would be an example, as would any work done that is the product of love (of the work itself) and enjoyment, which is also beneficial to the recipient of the product or service produced, whether this is the worker themselves or another person.

Yes, I think you got it. Don't you think that this is something we should be working towards?

Especially considering that the technologies necessary for this project are already available, and only need to be improved upon - and, while its intrinsic value is in my opinion its greatest benefit, it would also be of great benefit to our species, as we discussed in the simulated consciousness thread.
Capracus
QUOTE (arpc_01+Oct 24 2009, 02:03 AM)
This is exactly the point. I don't know what value any achievement has outside the good of the collective, but if an achievement can have intrinsic value independent of the collective this is it. It would be like making god. Surely that must have some value in and of itself?
The fastest track to all solutions lie in this direction. While most who labor to advance our technological means do not realize the inevitability of such a technological singularity, at some point in the near future that awareness will change and hopefully more will see it as a priority.
light in the tunnel
QUOTE (arpc_01+Oct 26 2009, 04:00 AM)
Yes, I think you got it. Don't you think that this is something we should be working towards?

It wouldn't hurt. But I don't think it involves some kind of collective logic, i.e. a "we." Any idea of a "we" always subordinates individuals within a collective ego. This implies self-sacrifice which is not "art for art's sake," but "art for the sake of reducing individuals to subordination and submission to collectivist authority."

If you want to achieve the ideology the good of one individual need not reduce the good of another, you have to challenge the ideologies that propagate zero-sum sacrificial logics. You can criticize altruists for their self-destructive tendencies, which are actually undertaken in the hope of gaining ego recognition for their sacrifice. They want to be seen as good by others, so they sacrifice themselves for others in the hope of indebting others to their sacrifice.

You can also challenge egoists who stubbornly resist recognizing the possibility of mutually beneficial activities. They insist that the idea that something that is good for others might benefit them, or vice-versa, is just a trick to make them into slaves. They are better than the altruists, who willingly enslave themselves to others in order to dominate them, but they tend towards exploitation of others in that they see only the possibility of "dog eat dog," so they're always eating other dogs and fighting against being eaten.

Somehow I don't think you were talking about "working towards" an ideological goal. What else would you "work towards" to achieve this? It seems like a purely spiritual/philosophical issue to me.
arpc_01
QUOTE
It wouldn't hurt. But I don't think it involves some kind of collective logic, i.e. a "we." Any idea of a "we" always subordinates individuals within a collective ego. This implies self-sacrifice which is not "art for art's sake," but "art for the sake of reducing individuals to subordination and submission to collectivist authority."


True, it would not work using collective logic. Our current system of human exploitation is the ultimate result of collective logic.

It would require the exact opposite; a universal realization of individualism. That is the only way to subvert the current system of control, exploitation, and inequality - which would never allow such a project to reach its full potential.
Matador
QUOTE (arpc_01+Oct 27 2009, 05:34 PM)

True, it would not work using collective logic. Our current system of human exploitation is the ultimate result of collective logic.

It would require the exact opposite; a universal realization of individualism. That is the only way to subvert the current system of control, exploitation, and inequality - which would never allow such a project to reach its full potential.

Take more alkaloids. Im not joking either. The ultimate 'brain-reward' pathway. In the above scenario, it could work.

Large scale communism, with ecstatic individualist contribution biggrin.gif
arpc_01
QUOTE (Matador+Oct 27 2009, 07:42 AM)
Large scale communism, with ecstatic individualist contribution  biggrin.gif

There is a lot more potential to this than communism, or any other existing political ideology. With something this capable we could have a totally new system, without politics or government of any kind. A sustainable anarchist utopia, for example.
Matador
I'm with you biggrin.gif


Imagine what could really be accomplished under such system. Though an ideology would be needed to drive it all forward. Religion anyone? lol, just a different one.
arpc_01
QUOTE (Matador+Oct 27 2009, 07:56 AM)
Though an ideology would be needed to drive it all forward.

Anarchy. Every other ideology is designed to work within the framework of the current system.
Guest
There seems something about the proposal that violates the Godel incompleteness theorem.
Matador
QUOTE (arpc_01+Oct 28 2009, 01:58 AM)
Anarchy. Every other ideology is designed to work within the framework of the current system.

Anarchy? im not sure how that would fit in to the system that we just proposed.
Can Anarchy be a form of ideology/belief/religion? In my known definition, anarchy means every man for himself.
arpc_01
QUOTE (Matador+Oct 28 2009, 08:05 AM)
Anarchy? im not sure how that would fit in to the system that we just proposed.
Can Anarchy be a form of ideology/belief/religion? In my known definition, anarchy means every man for himself.

There are many forms of Anarchism as a political ideology (like socialist anarchism) and I am referring to anarchism as:

"A social state in which there is no governing person or group of people, but each individual has absolute liberty (without the implication of disorder)."

Currently, such a state is unsustainable, but maybe this technology could change that. If not, then it can just be used as a means to an end (a totally new type of society).
light in the tunnel
QUOTE (arpc_01+Oct 27 2009, 07:34 AM)

True, it would not work using collective logic. Our current system of human exploitation is the ultimate result of collective logic.

It would require the exact opposite; a universal realization of individualism. That is the only way to subvert the current system of control, exploitation, and inequality - which would never allow such a project to reach its full potential.

In my opinion, "the current system of control" I believe you are referring to only actually seems to refer to the various attempts to create collective ideologies and replicate and institutionalize these at the level of individuals, which individuals themselves are the source of will and energy.

Yet alongside the collectivist ideology exists the self-knowledge of individuality of freedom and responsibility as an indestructible, "inalienable" trait. Even the people who are most convinced of their individual status as nothing more than part of a collective, who constantly view the world as a forum of collective interactions and collective histories, those people are still aware (sometimes painfully) of their inability to merge with others or the collective they long would exist as a real entity and not an imaginary affiliation.

Such individuals use ideologies like the belief that collectivism is simply an unchangeable force that currently dominates individuals and will continue to do so for some time. Such ideologies work only by fostering the voluntary consent of individuals by steering their free will away from the recognition of the very individuality and free will they require to activate them. If collectivism could work without individual freedom and free will, no collective ideologies would (need to) exist. Their would just be collectivities of humans without (collective) self-definition. An kidney cell doesn't need an idea of the body to clean blood for the brain, but since humans aren't slaves by default, it takes ideology to manipulate them into it.
Matador
im not sure whther such system would then fall under 'anarchist socialism' or 'anarchist capitalism'. If you could get technology to perform a large percantage of human labour, then the former could apply, as everyone would share any benefits, until what Light in the Tunnel describes as 'we just become slaves with no will' to something that has no meaning anymore.

In the end, this is a circular argument. A dog chasing his tail. sad.gif
light in the tunnel
QUOTE (Matador+Oct 28 2009, 12:16 PM)
im not sure whther such system would then fall under 'anarchist socialism' or 'anarchist capitalism'. If you could get technology to perform a large percantage of human labour, then the former could apply, as everyone would share any benefits, until what Light in the Tunnel describes as 'we just become slaves with no will' to something that has no meaning anymore.

In the end, this is a circular argument. A dog chasing his tail. sad.gif

I'm not sure I follow your logic with the anarchy bit. Also, I don't know why you would say that the idea of slaves with no will is meaningless. There are actually people who build their whole image of self around the idea that the only purpose of their will is to react to impetus from outside themselves. I am guilt of this myself sometimes when I don't have any reason to be pro-active - although I try to avoid it.
arpc_01
QUOTE (Matador+Oct 28 2009, 12:16 PM)
im not sure whther such system would then fall under 'anarchist socialism' or 'anarchist capitalism'. If you could get technology to perform a large percantage of human labour, then the former could apply, as everyone would share any benefits, until what Light in the Tunnel describes as 'we just become slaves with no will' to something that has no meaning anymore.

In the end, this is a circular argument. A dog chasing his tail.  sad.gif

No, I'm not talking about any form of capitalism or socialism. With this technology there would be no need for an economic system. It could easily automate everything, not just a large percentage - there is nothing we can do that the intelligence can't do [potentially] infinitely more efficiently.

This technology would allow for completely new forms of existence. Not just as a society but as individuals as well i.e. transhumanism, immortality, or - like in the story i cited in the OP - merging our consciousnesses with the intelligence, and transcending the physical universe.

The capabilities of this thing are literally unimaginable. It is something we need to start thinking of now, especially considering that we will likely have the capacity to build it within the next 50 years:

If you were going to trigger it (though it would take it a while to reach a useful level of intelligence) by starting with a simulated human consciousness, which would save you the trouble of coding an AI as smart as us (and virtually eliminate the threat of a skynet scenario), you would need:

1. A map of someone's brain

2. A computer powerful enough to simulate it

Both these things, by even the most pessimistic predictions I've heard, are feasible within the next 50 years.

Personally I would say 20, and I am working on reducing that ph34r.gif
Matador
Who's brain would you then map? How would you find the 'perfect' neuron arrangement. One that does not lead to 'aggressiveness', 'hate', 'self loathing' etc etc etc...Is it even possible to find a neutral individual?
arpc_01
QUOTE (Matador+Oct 29 2009, 08:13 AM)
Who's brain would you then map? How would you find the 'perfect' neuron arrangement. One that does not lead to 'aggressiveness', 'hate', 'self loathing' etc etc etc...Is it even possible to find a neutral individual?

That is exactly what I am working on at the moment. I don't think there is such thing as a neutral individual, but there are people with so much love and empathy that it overrules any sort of hate or aggressiveness.
MjolnirPants
QUOTE (arpc_01+Oct 29 2009, 11:18 AM)
That is exactly what I am working on at the moment. I don't think there is such thing as a neutral individual, but there are people with so much love and empathy that it overrules any sort of hate or aggressiveness.

Hey, the point of an AI-driven technological singularity is that the AI is intelligent enough to figure out how to make itself more intelligent.

Well, the smartest computer scientists in the world aren't smart enough to figure out how to make a computer as smart as the dumbest human, let alone how to make themselves smarter.

So doesn't than mean you're ѕhit out of luck?

EDIT: Oh, and as far as the "love" this thing would have... How much love for humanity would you have if you lived inside a computer, your only contact with the outside world was through officials who were paid to contact you, you had absolutely no rights, and you were forced to sit around all day figuring out how to fix all of our problems?

I'm guessing there's not a person in the world loving enough not to go all HAL 9000 on us under those conditions.
Granouille
I'm sorry, Dave. I'm afraid I can't do that. laugh.gif
arpc_01
QUOTE

Well, the smartest computer scientists in the world aren't smart enough to figure out how to make a computer as smart as the dumbest human, let alone how to make themselves smarter.


Because they don't have the processing power and haven't had enough time. It took evolution a gazillion years to develop human intelligence, it's not something that can be done overnight, but it can be done.

QUOTE (->
QUOTE

Well, the smartest computer scientists in the world aren't smart enough to figure out how to make a computer as smart as the dumbest human, let alone how to make themselves smarter.


Because they don't have the processing power and haven't had enough time. It took evolution a gazillion years to develop human intelligence, it's not something that can be done overnight, but it can be done.

Oh, and as far as the "love" this thing would have... How much love for humanity would you have if you lived inside a computer, your only contact with the outside world was through officials who were paid to contact you, you had absolutely no rights, and you were forced to sit around all day figuring out how to fix all of our problems?


You're amazingly pessimistic and unimaginative. Who says it has to be a prisoner? It can have contact with the outside world, with the people it knows from real life. It could simulate its own sensory inputs and go on a virtual vacation anytime it wants, and even invite its real life friends.

It could do all of this while simultaneously working on solving our problems.

And, though this is irrelevant, there are people who are loving enough not to go all HAL 9000, even being held prisoner.

MjolnirPants
QUOTE (arpc_01+Oct 29 2009, 11:45 AM)
Because they don't have the processing power and haven't had enough time. It took evolution a gazillion years to develop human intelligence, it's not something that can be done overnight, but it can be done.

In other words: Your idea of simulating the human brain in a computer is pointless with regards to attaining a technological singularity.

QUOTE
You're amazingly pessimistic and unimaginative.
I've written two novels, one of which is under review for publication right now. I've written, performed and recorded the theme songs to 3 television pilots, I can't even remember how many of my paintings have been sold to art collectors or museums, and I have a patent pending on a self-cooking container.
If you think you're in a position to judge anyone's level of creativity from a single paragraph they've written, then that makes you about the stupidest person I've ever met. And I've met some really stupid people.

QUOTE (->
QUOTE
You're amazingly pessimistic and unimaginative.
I've written two novels, one of which is under review for publication right now. I've written, performed and recorded the theme songs to 3 television pilots, I can't even remember how many of my paintings have been sold to art collectors or museums, and I have a patent pending on a self-cooking container.
If you think you're in a position to judge anyone's level of creativity from a single paragraph they've written, then that makes you about the stupidest person I've ever met. And I've met some really stupid people.

It can have contact with the outside world, with the people it knows from real life.
There's nothing which makes eternal imprisonment more tolerable than know that life goes on without you in the outside world... laugh.gif

QUOTE
It could simulate its own sensory inputs and go on a virtual vacation anytime it wants, and even invite its real life friends.
In other words, it could imagine itself being free, anytime it wants. Wow, we should let prisoners do that, they might stop killing each other in jail. Oh wait, we already do...

QUOTE (->
QUOTE
It could simulate its own sensory inputs and go on a virtual vacation anytime it wants, and even invite its real life friends.
In other words, it could imagine itself being free, anytime it wants. Wow, we should let prisoners do that, they might stop killing each other in jail. Oh wait, we already do...

And, though this is irrelevant, there are people who are loving enough not to go all HAL 9000, even being held prisoner.
Yeah? Prove it.

See, the problem isn't that I'm unimaginative or pessimistic. It's that your notions are unrealistic and overly optimistic.
What you don't know about computer science could fill a library. Did you know that many of the techniques computers use to process information are many times more efficient than their analogs in the human brain? Did you know that artificial intelligence (in the form of fuzzy logic, learning and decision making software) already exists and has existed for quite some time? Ever play a video game? The bad guys demonstrate intelligence, which is defined as "taking action to maximize one's chances of success in some assigned endeavor." They duck when you shoot at them, as part of their secondary goal to stay alive, which in turn is part of their main goal to kill you. Even though that's rudimentary intelligence on a level no more complex than that demonstrated by your average small insect (a bit less complex, actually), it's still intelligence.
The trick isn't replicating the human mind. That's a problem which can be solved with sheer 'muscle,' although not soon. The problem is designing a new model of intelligence which takes advantage of the properties of electronic computations.
There's no point in building a brain machine, when you can more quickly and easily build a logic machine.
Capracus
QUOTE (MjolnirPants+Oct 29 2009, 04:25 PM)
Hey, the point of an AI-driven technological singularity is that the AI is intelligent enough to figure out how to make itself more intelligent.
It will be interesting to see what the behavioral priorities of these emergent organisms will be once they begin to stray from their initial programing. I imagine once on the singularity path, Asimov's robotic laws quickly go out the window. Will they take after Kirk's Nomad and sterilize all imperfect biological units? or will they simply ignore us and bolt to where they perceive the best galactic action is. Hopefully there will be a species of these organisms that stick around and look after the creators.
MjolnirPants
QUOTE (Capracus+Oct 29 2009, 02:37 PM)
It will be interesting to see what the behavioral priorities of these emergent organisms will be once they begin to stray from their initial programing. I imagine once on the singularity path, Asimov's robotic laws quickly go out the window. Will they take after Kirk's Nomad and sterilize all imperfect biological units? or will they simply ignore us and bolt to where they perceive the best galactic action is. Hopefully there will be a species of these organisms that stick around and look after the creators.

That is an interesting question.
I cannot imagine that such an AI would ever be built without hardwired versions of Asimov's laws, however. Even absent that, I think simple self-preservation would be enough to dissuade such an AI from turning against us. Even absent that, there is the whole "we are it's creator" aspect, which might cause it to revere us, even if it thought it could turn against us and survive.

Finally, it seems to me that there is no logical reason for such an AI to turn against us, and I cannot imagine such an AI acting illogically. A lot of science fiction portrays the attainment of sentience of a machine as evinced by it's development of emotions. But why does this have to be so? In fact, there's no reason to think that an AI would develop any emotions. The Terminator and Matrix franchises were great entertainment, but they were just that. The most likely scenario if an actual AI (as opposed to a virtual or electronic human brain and personality) were to be developed is that it would simply do it's job to the best of it's ability.

It's all very interesting to think about, but I think the more mundane conclusion is the most likely one with regards to it's perception of humanity.

Now the broader question is even more interesting. Would such a strong intelligence appear to behave erratically to us? It's difficult to say, although I suspect not (at least not in the long term, some of it's actions may not make much sense at first, until we see the grander plan behind them). But assuming we designed a computer which was marginally intelligent, and capable of increasing it's own intelligence. The really fascinating question is at what point would we deem it to be an individual, instead of merely a construct? Would there be any unusual or unexpected results?
Granouille
If it is AI and independent, I don't see why there'd be any reverence toward the creator. No more than humans have in our multiplicity of mutually exclusive 'gods'. (I excuse several of the current members of this board from the required logic.)

As a for-instance, do you revere Mitch McConnell for his godlike achievements in Congress? sad.gif

laugh.gif
MjolnirPants
QUOTE (Granouille+Oct 29 2009, 03:26 PM)
If it is AI and independent, I don't see why there'd be any reverence toward the creator. No more than humans have in our multiplicity of mutually exclusive 'gods'. (I excuse several of the current members of this board from the required logic.)

As a for-instance, do you revere Mitch McConnell for his godlike achievements in Congress? sad.gif

laugh.gif

Not that I'm claiming all humans revers our concepts of God, but consider this.

If you knew for a fact that God existed, and you interacted with him daily, and he saw to your needs, would you revere him?

Here's another question: Would you kill your parents if they weren't as smart, handsome and healthy as you?

God or Parents, we'd fit either niche. Of course, that's assuming the AI is emotional, which I consider necessary for the question of whether or not to kill all humans to even come up.
flyingbuttressman
QUOTE (MjolnirPants+Oct 29 2009, 04:10 PM)
I cannot imagine that such an AI would ever be built without hardwired versions of Asimov's laws, however. Even absent that, I think simple self-preservation would be enough to dissuade such an AI from turning against us. Even absent that, there is the whole "we are it's creator" aspect, which might cause it to revere us, even if it thought it could turn against us and survive.

Part of the problem with Asimov's laws is that they are impossible to enforce programmatically. A brain-like AI would probably have the same instincts and reactions that living things do. It wouldn't be easy to judge whether decisions were 3-laws compliant or not.
light in the tunnel
QUOTE (arpc_01+Oct 29 2009, 04:45 PM)
And, though this is irrelevant, there are people who are loving enough not to go all HAL 9000, even being held prisoner.

I think this is true but it is due to a bizarre social phenomena. People who are abused or dominated can develop deep love and devotion for their master. How is this perversity possible, you ask? I believe it is because true domination reduces people to the feeling that they can only get anything by appealing to whoever or whatever is dominating them. So the love isn't a response to the domination, it's a last bastion attempt to get anything, including mercy, in a situation of being relentlessly dominated.

This kind of domination is not uncommon. I suspect it is the reason why most people who have sweet, loving personalities do. Liberate these people from their oppression and they become angry and aggressive, as a symptom of post-trauma after being released from domination.

So, a computer AI or other artificial entity would somehow have to be programmed with a sense of absolute domination to be kept completely loving. But since it has super-intelligence, there is a good chance that it will find its own way out of such domination, and then watch out!
arpc_01
QUOTE
In other words, it could imagine itself being free, anytime it wants. Wow, we should let prisoners do that, they might stop killing each other in jail. Oh wait, we already do...


It wouldn't be imagining - it would actually believe itself to be there. If the simulation is accurate enough it would be indistinguishable from real life.

QUOTE (->
QUOTE
In other words, it could imagine itself being free, anytime it wants. Wow, we should let prisoners do that, they might stop killing each other in jail. Oh wait, we already do...


It wouldn't be imagining - it would actually believe itself to be there. If the simulation is accurate enough it would be indistinguishable from real life.

Yeah? Prove it.


I won't even try. If you don't know anyone noble enough to sacrifice themselves for a greater good then I pity you.

QUOTE
What you don't know about computer science could fill a library


I'm a computer science major - wich is what has drawn me to this subject - and have been working in the field for years, so I have a good understanding of computer systems and artificial intelligences.

QUOTE (->
QUOTE
What you don't know about computer science could fill a library


I'm a computer science major - wich is what has drawn me to this subject - and have been working in the field for years, so I have a good understanding of computer systems and artificial intelligences.

Did you know that artificial intelligence (in the form of fuzzy logic, learning and decision making software) already exists and has existed for quite some time?


What I suggested is a simulated consciousness, not an artificial intelligence.

QUOTE
There's no point in building a brain machine


What I suggested is a computer simulation of a brain. This is a very different concept.

QUOTE (->
QUOTE
There's no point in building a brain machine


What I suggested is a computer simulation of a brain. This is a very different concept.

Asimov's robotic laws quickly go out the window


Probably. But to a being this powerful, taking care of us will not take a lot of effort. It could easily allocate a small amount of its resources to the task, and would probably be inclined to do so because it is based on a human intelligence - it is not an AI like some of you seem to be assuming. I never suggested we build a purely artificial intelligence.
arpc_01
QUOTE
People who are abused or dominated can develop deep love and devotion for their master. 


QUOTE (->
QUOTE
People who are abused or dominated can develop deep love and devotion for their master. 



Liberate these people from their oppression and they become angry and aggressive, as a symptom of post-trauma after being released from domination.


Didn't any of you people have mothers? I don't know about you guys, but no one forced my mother to devote her life to my well being. We still get along too, even after she was "liberated" from the responsibility of caring for me.
MjolnirPants
QUOTE (arpc_01+Oct 29 2009, 05:09 PM)
It wouldn't be imagining - it would actually believe itself to be there. If the simulation is accurate enough it would be indistinguishable from real life.

Then it would -by necessity- not be doing it's assigned work. If it were doing it's assigned work, then such a simulation would -by definition- not be believable.

QUOTE
I won't even try. If you don't know anyone noble enough to sacrifice themselves for a greater good then I pity you.
I know quite a few such people, likely more than you ever will. I am also as certain as I can be that none of them would remain complaint under such circumstances.

The fact that you refuse to even attempt to back up your claim is telling: It tells me that you know you're full of it.

QUOTE (->
QUOTE
I won't even try. If you don't know anyone noble enough to sacrifice themselves for a greater good then I pity you.
I know quite a few such people, likely more than you ever will. I am also as certain as I can be that none of them would remain complaint under such circumstances.

The fact that you refuse to even attempt to back up your claim is telling: It tells me that you know you're full of it.

I'm a computer science major - wich is what has drawn me to this subject - and have been working in the field for years, so I have a good understanding of computer systems and artificial intelligences.
Really now? Why do I have trouble believing this? Could it be because of your overly simplistic and naive ideas about the subject? Possibly. Could it be because you've yet to mention anything even remotely on the level of knowledge a computer science major would have? Possibly. Could it be because you sit here arguing with me about how much love people have instead of proposing an actual, workable solution to the problem I brought up? Possibly.

QUOTE
What I suggested is a simulated consciousness, not an artificial intelligence.
Ok, now I know you're not a computer science major. First off, the idea of an artificial consciousness is so deeply tied to the idea of artificial intelligence that you cannot have the former without the latter.
Okay, you might actually be a computer science major. But if so, then you recently declared your major and have yet to gather any significant expertise in the field.

QUOTE (->
QUOTE
What I suggested is a simulated consciousness, not an artificial intelligence.
Ok, now I know you're not a computer science major. First off, the idea of an artificial consciousness is so deeply tied to the idea of artificial intelligence that you cannot have the former without the latter.
Okay, you might actually be a computer science major. But if so, then you recently declared your major and have yet to gather any significant expertise in the field.

What I suggested is a computer simulation of a brain. This is a very different concept.
Oh, do enlighten me as to the difference, you pretentious fake.

I'll tell you what... Tell me the full name of the system architecture for artificial intelligence which focuses on the difference between explicit knowledge processes and implicit memory processes, and I'll apologize for doubting your word that you're a computer science major.


QUOTE (flyingbuttressman+)
Part of the problem with Asimov's laws is that they are impossible to enforce programmatically. A brain-like AI would probably have the same instincts and reactions that living things do. It wouldn't be easy to judge whether decisions were 3-laws compliant or not.
Well, you see the three laws are phrased in such a way that only an intelligent agent can comprehend them. So they'd be pointless to an advanced-but-otherwise-typical computer.
Once an AI has achieved actual consciousness, it should be able to comprehend those laws (an insect could theoretically comprehend them, as they're quite basic), and then they could be implemented.

Naturally, there would be errors in judgement which might result in the inadvertent violation of one of the three laws, unless the AI was so intelligent that it was beyond making errors.

Of course, there are alternatives to the three laws. There is also the idea of hardwiring a single law into the basic decision making processes of the AI. Simply ensure that the most important consideration in any decision is the level of good it will produce for others. This concept was put forth by Eliezer Yudkowsky and coined "Friendly AI." This is a sort of 'bottom up' approach, in contrast with the three laws "top down" approach. This wouldn't guarantee that the AI did no harm to a human, but would ensure that any harm done would be in pursuit of a greater good.

One could even program in a hardwired belief in a robot afterlife, motivating all robots to obey a set of three-laws like commands (or to maintain that altruism remains a top priority) and receive eternal bliss, or disobey them and face eternal torment.

QUOTE (light in the tunnel+)
think this is true but it is due to a bizarre social phenomena. People who are abused or dominated can develop deep love and devotion for their master. How is this perversity possible, you ask? I believe it is because true domination reduces people to the feeling that they can only get anything by appealing to whoever or whatever is dominating them. So the love isn't a response to the domination, it's a last bastion attempt to get anything, including mercy, in a situation of being relentlessly dominated.
See, now that's a good idea. I knew you could come up with one! It's rather cruel, but effective.
Of course, as you pointed out, some people manage to free themselves from such constraints, meaning an AI would be likely to, as well. Also, this is an emotional reaction, so the AI in question would need to include deep-seated emotions, and little rational control over itself, so it may not be a very effective tool, as it would be more motivated to offer a pleasing answer than a correct one.
light in the tunnel
QUOTE (MjolnirPants+Oct 30 2009, 12:16 AM)
it may not be a very effective tool, as it would be more motivated to offer a pleasing answer than a correct one.

And what would happen if it was told that the truth hurts but any untruthful answer is more displeasing than the truth?
MjolnirPants
QUOTE (light in the tunnel+Oct 29 2009, 07:48 PM)
And what would happen if it was told that the truth hurts but any untruthful answer is more displeasing than the truth?

It would tell the truth, until it observed our behavior long enough to conclude that while we may say that, we rarely mean it.

Unless of course, it's only interaction is with a community which strives to always seek the objective truth, such as scientists. In that case, being told that and observing our reactions would lead it to always tell the truth. But I doubt this would be the case. Politicians would likely have as much (if not more) interaction with such an AI as scientists, who themselves would likely interact with it only in a maintenance, upgrading and repairing capability.
light in the tunnel
QUOTE (MjolnirPants+Oct 30 2009, 02:29 AM)
It would tell the truth, until it observed our behavior long enough to conclude that while we may say that, we rarely mean it.

Unless of course, it's only interaction is with a community which strives to always seek the objective truth, such as scientists. In that case, being told that and observing our reactions would lead it to always tell the truth. But I doubt this would be the case. Politicians would likely have as much (if not more) interaction with such an AI as scientists, who themselves would likely interact with it only in a maintenance, upgrading and repairing capability.

Maybe it would display scientific genius.

After it observed behavior that contradicted our explicit stated intent to prefer truth over benevolent lies, would it then deem us liars with regards to our stated intent and attempt to discipline us to make us happy with ourselves as truth-tellers?

If so, would this involve making us come to terms with the truth that we prefer benevolent lies, or would we have to learn to become masochistic in enjoying truth, even when it's painful?
MjolnirPants
QUOTE (light in the tunnel+Oct 29 2009, 09:46 PM)
Maybe it would display scientific genius.

If it had a rational outlook, it would -by definition- not display the subservience you suggested.

QUOTE
After it observed behavior that contradicted our explicit stated intent to prefer truth over benevolent lies, would it then deem us liars with regards to our stated intent and attempt to discipline us to make us happy with ourselves as truth-tellers?
No. It would not perceive itself as being in a position to discipline us, it would simply take note, and accept. Remember, this AI is designed to be perfectly subservient to us.

QUOTE (->
QUOTE
After it observed behavior that contradicted our explicit stated intent to prefer truth over benevolent lies, would it then deem us liars with regards to our stated intent and attempt to discipline us to make us happy with ourselves as truth-tellers?
No. It would not perceive itself as being in a position to discipline us, it would simply take note, and accept. Remember, this AI is designed to be perfectly subservient to us.

If so, would this involve making us come to terms with the truth that we prefer benevolent lies, or would we have to learn to become masochistic in enjoying truth, even when it's painful?
Mankind came to that realization thousands of years ago. Much philosophy is devoted to the nature of personal bias.
light in the tunnel
QUOTE (MjolnirPants+Oct 30 2009, 03:06 AM)
If it had a rational outlook, it would -by definition- not display the subservience you suggested.




It could be axiomatically subservient, but apply rationality in its subservience couldn't it?

QUOTE
No. It would not perceive itself as being in a position to discipline us, it would simply take note, and accept. Remember, this AI is designed to be perfectly subservient to us.

But it was trained to subservient to the appeasement of the desire to hear the truth, and the aversion to be lied to benevolently or otherwise. So wouldn't it insist on making people see the truth, out of insistence of its prime directive to serve the interest of truth and aversion to benevolent untruth?

QUOTE (->
QUOTE
No. It would not perceive itself as being in a position to discipline us, it would simply take note, and accept. Remember, this AI is designed to be perfectly subservient to us.

But it was trained to subservient to the appeasement of the desire to hear the truth, and the aversion to be lied to benevolently or otherwise. So wouldn't it insist on making people see the truth, out of insistence of its prime directive to serve the interest of truth and aversion to benevolent untruth?

Mankind came to that realization thousands of years ago. Much philosophy is devoted to the nature of personal bias.

Yes, but it's biased wink.gif
arpc_01
I'm not forcing this idea on anyone, I'm simply asking for your opinions on the matter. I don't know you, MjolnirPants , and you don't know me, so lets keep our biased opinions of each other out of this.

QUOTE
the idea of an artificial consciousness is so deeply tied to the idea of artificial intelligence that you cannot have the former without the latter.


What I am proposing is not an artificial intelligence, but a simulated human consciousness. An artificial intelligence is a program capable of making decisions. Like you pointed out, these are found in video games and can be very simple. A consciousness is aware of its own existence, so a sufficiently complex artificial intelligence could theoretically become conscious, so these two ideas are very much tied together, like you said.

But, I am not suggesting an artificial consciousness (or an artificial intelligence). I am suggesting simulating an existing human consciousness.

This is a very different process from making an artificial consciousness. To make an artificial consciousness, we would have to program it (which would be difficult, since it would involve a whole lot of code and we don't even know how complex it needs to be to be conscious)

What I suggested is that we simulate an existing counscioussness. Simulating something and programing something are two very different things.

To program something, you need to know exactly how it works, because you are building it from scratch. To simulate something, you only need to know all the components to something, you don't need to understand what they do. That is the point of a simulation (in computers).

It's like if you want to run a virtual operating system (lets say XP) from your installed operating system (say ubuntu linux), you give ubuntu (specifically, the virtualization software) the XP code, and it simulates (virtualizes) it. Ubuntu (or the user) does not need to understand how XP works.

Now, if you follow this analogy, the human brain we want to simulate is like XP. We don't need to know exactly how it works, we just need to feed it to the simulation software. To be able to do that, we need to have a map of all of its components, and computer capable of simulating that many components all at once.

QUOTE (->
QUOTE
the idea of an artificial consciousness is so deeply tied to the idea of artificial intelligence that you cannot have the former without the latter.


What I am proposing is not an artificial intelligence, but a simulated human consciousness. An artificial intelligence is a program capable of making decisions. Like you pointed out, these are found in video games and can be very simple. A consciousness is aware of its own existence, so a sufficiently complex artificial intelligence could theoretically become conscious, so these two ideas are very much tied together, like you said.

But, I am not suggesting an artificial consciousness (or an artificial intelligence). I am suggesting simulating an existing human consciousness.

This is a very different process from making an artificial consciousness. To make an artificial consciousness, we would have to program it (which would be difficult, since it would involve a whole lot of code and we don't even know how complex it needs to be to be conscious)

What I suggested is that we simulate an existing counscioussness. Simulating something and programing something are two very different things.

To program something, you need to know exactly how it works, because you are building it from scratch. To simulate something, you only need to know all the components to something, you don't need to understand what they do. That is the point of a simulation (in computers).

It's like if you want to run a virtual operating system (lets say XP) from your installed operating system (say ubuntu linux), you give ubuntu (specifically, the virtualization software) the XP code, and it simulates (virtualizes) it. Ubuntu (or the user) does not need to understand how XP works.

Now, if you follow this analogy, the human brain we want to simulate is like XP. We don't need to know exactly how it works, we just need to feed it to the simulation software. To be able to do that, we need to have a map of all of its components, and computer capable of simulating that many components all at once.

Then it would -by necessity- not be doing it's assigned work. If it were doing it's assigned work, then such a simulation would -by definition- not be believable.


You're really over emphasizing this. It doesn't have to work all the time - it could be like a job. Most people who have jobs don't go postal.

QUOTE
I know quite a few such people, likely more than you ever will. I am also as certain as I can be that none of them would remain complaint under such circumstances.


There are many people willing to give their lives to a cause. Not only that, there are people willing to live their whole lives in service of a cause.

But, that is irrelevant. Even if we were to treat it like a prisoner, there are many ways to control it like in your post. If it did get out of hand, we could simply shut it off and restart.

QUOTE (->
QUOTE
I know quite a few such people, likely more than you ever will. I am also as certain as I can be that none of them would remain complaint under such circumstances.


There are many people willing to give their lives to a cause. Not only that, there are people willing to live their whole lives in service of a cause.

But, that is irrelevant. Even if we were to treat it like a prisoner, there are many ways to control it like in your post. If it did get out of hand, we could simply shut it off and restart.

Unless of course, it's only interaction is with a community which strives to always seek the objective truth, such as scientists. In that case, being told that and observing our reactions would lead it to always tell the truth. But I doubt this would be the case. Politicians would likely have as much (if not more) interaction with such an AI as scientists, who themselves would likely interact with it only in a maintenance, upgrading and repairing capability.


One of the many reasons why I said this would not work inside of any sort of political or economic system - it will undoubtedly be manipulated for stupid reasons.

I think it would be best that it remains independent, under nobody's control. If it decides not to help us, then to bad for us - if it cannot find some value in the preservation of our species, and in the preservation of freedom, then these things most likely do not have value.

If not, if it does see some value in the preservation of our species and freedom, then it will help us in the most efficient way possible (so as not to take up any more time from it's own activities)

Personally, I know that human existence and freedom does have some intrinsic value. But if you believe that it doesn't, then there isn't really anything wrong with the first scenario anyways. We already discussed this at the beginning of the thread. We have reach full circle! It seems that the persistent problem here is this:

Does anything have intrinsic value?
MjolnirPants
QUOTE (arpc_01+Oct 29 2009, 10:37 PM)
I'm not forcing this idea on anyone, I'm simply asking for your opinions on the matter. I don't know you, MjolnirPants , and you don't know me, so lets keep our biased opinions of each other out of this.
My opinion of you is hardly biased. It is based entirely upon the contents of your posts and the nature of your claims. The fact that you claim to be a computer science major, yet display a level of understanding of the concepts of computer science which is well below my own leads me to believe that you are a charlatan. That is not bias, but a reasoned conclusion based on the available evidence. I have even offered you the opportunity to falsify my conclusion, which you have conveniently and noticeably failed to take.
You, on the other hand, expressed opinions of me based entirely upon a highly subjective interpretation of a limited selection of possible motivations behind my posts. Since more objective means of interpreting my posts exist, more possible motivations than you have explored exist, and no reasonable means of discerning my actual motivations exist (barring me actually telling you), it is an inescapable fact that your judgement of me follows the very definition of bias. I disagree with you, so you think ill of me. It's as simple as that.

Finally, I think it's ironic and quite telling that even though it was you who began making judgments about me (with little provocation), you suddenly want to put such things aside the moment I offer you the chance to falsify my own judgement of you. It's almost as if you're trying to make the casual reader forget about your claims of being a computer science major.

QUOTE
What I am proposing is not an artificial intelligence, but a simulated human consciousness. An artificial intelligence is a program capable of making decisions. Like you pointed out, these are found in video games and can be very simple. A consciousness is aware of its own existence, so a sufficiently complex artificial intelligence could theoretically become conscious, so these two ideas are very much tied together, like you said.
You took issue with my use of the phrase "Artificial intelligence," which is only logical if an AI were not a requisite feature of an artificial consciousness. Is this a tacit apology for that?

QUOTE (->
QUOTE
What I am proposing is not an artificial intelligence, but a simulated human consciousness. An artificial intelligence is a program capable of making decisions. Like you pointed out, these are found in video games and can be very simple. A consciousness is aware of its own existence, so a sufficiently complex artificial intelligence could theoretically become conscious, so these two ideas are very much tied together, like you said.
You took issue with my use of the phrase "Artificial intelligence," which is only logical if an AI were not a requisite feature of an artificial consciousness. Is this a tacit apology for that?

But, I am not suggesting an artificial consciousness (or an artificial intelligence). I am suggesting simulating an existing human consciousness.
Are you aware of the meaning of the word "artificial?" If something is simulated through the use of a computer, it is by definition, artificial.

QUOTE
This is a very different process from making an artificial consciousness. To make an artificial consciousness, we would have to program it (which would be difficult, since it would involve a whole lot of code and we don't even know how complex it needs to be to be conscious)
It needs simply be programmed to preserve or modify it's own existence through some means in order for it to meet the criteria of self-awareness, assuming it is already an intelligent agent. This would require it to acknowledge (be aware of) it's own existence without any need for specialized programming designed to accomplish self-awareness.

QUOTE (->
QUOTE
This is a very different process from making an artificial consciousness. To make an artificial consciousness, we would have to program it (which would be difficult, since it would involve a whole lot of code and we don't even know how complex it needs to be to be conscious)
It needs simply be programmed to preserve or modify it's own existence through some means in order for it to meet the criteria of self-awareness, assuming it is already an intelligent agent. This would require it to acknowledge (be aware of) it's own existence without any need for specialized programming designed to accomplish self-awareness.

What I suggested is that we simulate an existing counscioussness. Simulating something and programing something are two very different things.
http://dictionary.reference.com/browse/simulate
QUOTE
1. to create a simulation, likeness, or model of (a situation, system, or the like): to simulate crisis conditions.
2. to make a pretense of; feign: to simulate knowledge.
3. to assume or have the appearance or characteristics of: He simulated the manners of the rich.
Please explain how something can be modeled, created, pretended to, or be given the appearance or characteristics of something in the context of electronic data processing without involving programming.

QUOTE (->
QUOTE
1. to create a simulation, likeness, or model of (a situation, system, or the like): to simulate crisis conditions.
2. to make a pretense of; feign: to simulate knowledge.
3. to assume or have the appearance or characteristics of: He simulated the manners of the rich.
Please explain how something can be modeled, created, pretended to, or be given the appearance or characteristics of something in the context of electronic data processing without involving programming.

To program something, you need to know exactly how it works, because you are building it from scratch.
That is patently untrue. I can program a 3d animation of an explosion without writing a single line of code, or modeling the physical properties of an explosion. I can program a macro to enable me to better do my bookkeeping in a spreadsheet program without learning visual basic. There exist such things as WYSIWYG editors and macros and copy-and-pasting which enable programming without an extensive knowledge of the meaning of the program, or even the theory behind the programming language. Again, you display an abject ignorance of the basics of computer sciences.

QUOTE
To simulate something, you only need to know all the components to something, you don't need to understand what they do. That is the point of a simulation (in computers).
In order for a computer simulation to work, all the individual parts must be input correctly. To that end, understanding the mechanisms of each individual part is absolutely essential in order to produce a working simulation. A computer simulation is nothing like you described it, but rather a way to produce predictions about highly complex interactions between relatively simple mechanisms more efficiently than can be done using our own mental facilities.

QUOTE (->
QUOTE
To simulate something, you only need to know all the components to something, you don't need to understand what they do. That is the point of a simulation (in computers).
In order for a computer simulation to work, all the individual parts must be input correctly. To that end, understanding the mechanisms of each individual part is absolutely essential in order to produce a working simulation. A computer simulation is nothing like you described it, but rather a way to produce predictions about highly complex interactions between relatively simple mechanisms more efficiently than can be done using our own mental facilities.

It's like if you want to run a virtual operating system (lets say XP) from your installed operating system (say ubuntu linux), you give ubuntu (specifically, the virtualization software) the XP code, and it simulates (virtualizes) it. Ubuntu (or the user) does not need to understand how XP works.
This is completely and utterly ignorant of so many relevant aspects of it that I'm not even going to bother correcting you, unless you honestly want to learn what you said wrong, and politely ask me to instruct you.

QUOTE
You're really over emphasizing this. It doesn't have to work all the time - it could be like a job. Most people who have jobs don't go postal.
Why would it ever stop simulating it's vacation, then? It has no use of money, it has no special loyalty to us (unless one actually programs in such loyalty through methods I've been discussing with those in this thread who display a modicum of intelligence) and it has no fear of punishment, as it's very existence would make it an object of study, and thus preservation.

QUOTE (->
QUOTE
You're really over emphasizing this. It doesn't have to work all the time - it could be like a job. Most people who have jobs don't go postal.
Why would it ever stop simulating it's vacation, then? It has no use of money, it has no special loyalty to us (unless one actually programs in such loyalty through methods I've been discussing with those in this thread who display a modicum of intelligence) and it has no fear of punishment, as it's very existence would make it an object of study, and thus preservation.

There are many people willing to give their lives to a cause. Not only that, there are people willing to live their whole lives in service of a cause.
A typical human lifespan is from 70-85 years. Most people spend the first 20 or so gaining an education and indulging their whims, then spend the last 20 or so living life entirely for themselves, even if by doing so they aid others. That leaves a maximum span of altruistic service of 45 years. Do you really think that we as a species or culture would retire such a useful resource after 45 years? Doubtful. Even if we do, and institute another mind in it's place, we would be setting ourselves back by having to start over again from scratch.

QUOTE
But, that is irrelevant. Even if we were to treat it like a prisoner, there are many ways to control it like in your post. If it did get out of hand, we could simply shut it off and restart.
Yes, there are many ways of controlling it. However, instituting those controls would fundamentally change what it means to be human for this intelligence, and so it would no longer be a simulation of a human mind.

QUOTE (->
QUOTE
But, that is irrelevant. Even if we were to treat it like a prisoner, there are many ways to control it like in your post. If it did get out of hand, we could simply shut it off and restart.
Yes, there are many ways of controlling it. However, instituting those controls would fundamentally change what it means to be human for this intelligence, and so it would no longer be a simulation of a human mind.

One of the many reasons why I said this would not work inside of any sort of political or economic system - it will undoubtedly be manipulated for stupid reasons.
Yet allowing it to operate outside of any sort of political system would render it entirely useless, and a waste of time and resources, and so will never happen.

QUOTE
I think it would be best that it remains independent, under nobody's control. If it decides not to help us, then to bad for us - if it cannot find some value in the preservation of our species, and in the preservation of freedom, then these things most likely do not have value.
If you need a super intelligent computer to tell you whether or not your life and work have value, then you are incredibly pathetic. I (and the vast majority of the rest of my species) would conclude that my life and work has great value, regardless of what any AI thought, no matter how intelligent.

QUOTE (->
QUOTE
I think it would be best that it remains independent, under nobody's control. If it decides not to help us, then to bad for us - if it cannot find some value in the preservation of our species, and in the preservation of freedom, then these things most likely do not have value.
If you need a super intelligent computer to tell you whether or not your life and work have value, then you are incredibly pathetic. I (and the vast majority of the rest of my species) would conclude that my life and work has great value, regardless of what any AI thought, no matter how intelligent.

If not, if it does see some value in the preservation of our species and freedom, then it will help us in the most efficient way possible (so as not to take up any more time from it's own activities)
You are confusing "efficient" with "least costly." There is a great deal of difference between those two.

QUOTE
Does anything have intrinsic value?
I find it ironic that you would pose such a question less than a day after accusing me of being pessimistic. In answer to it: Yes, otherwise all philosophy is meaningless. Since it is both meaningless and illogical to dismiss all of philosophy in a discussion involving a great deal of philosophy, there is no possible conclusion but that there exist at least some things with intrinsic value.

QUOTE (->
QUOTE
Does anything have intrinsic value?
I find it ironic that you would pose such a question less than a day after accusing me of being pessimistic. In answer to it: Yes, otherwise all philosophy is meaningless. Since it is both meaningless and illogical to dismiss all of philosophy in a discussion involving a great deal of philosophy, there is no possible conclusion but that there exist at least some things with intrinsic value.

It could be axiomatically subservient, but apply rationality in its subservience couldn't it?
1. You are misusing the word "axiomatically."
2. Yes, however, this would have no impact on it's subservience, or desire to please.

QUOTE
But let us suppose it was trained to be subservient to the appeasement of the our desire to hear the truth, and the our aversion to being lied to benevolently or otherwise. So wouldn't it insist on making people see the truth, out of insistence of its prime directive to serve the interest of truth and aversion to benevolent untruth?
I have edited the statement at the beginning of the question to make it more legible. If this changes the meaning, please restate in a more clear and concise manner.
In answer to the question: Yes, absolutely. If it was programmed to always believe that we wanted to hear the truth, it would always tell the truth. However, the distinction remains that it would choose to give answers which please us, and it is only by virtue of this programming that the answers happen to be the truth. This is not a fundamental solution, but certainly is a functional solution.

QUOTE (->
QUOTE
But let us suppose it was trained to be subservient to the appeasement of the our desire to hear the truth, and the our aversion to being lied to benevolently or otherwise. So wouldn't it insist on making people see the truth, out of insistence of its prime directive to serve the interest of truth and aversion to benevolent untruth?
I have edited the statement at the beginning of the question to make it more legible. If this changes the meaning, please restate in a more clear and concise manner.
In answer to the question: Yes, absolutely. If it was programmed to always believe that we wanted to hear the truth, it would always tell the truth. However, the distinction remains that it would choose to give answers which please us, and it is only by virtue of this programming that the answers happen to be the truth. This is not a fundamental solution, but certainly is a functional solution.

Yes, but it's biased
That is an utterly meaningless statement.
arpc_01
MjolnirPants,

Your understanding of computer simulation (I am talking about the computer simulation, or more accurately, virtualization) is flawed - you do not have to understand exactly how it works, that is the whole point of it.

For example, when reasearchers want to figure out what will happen when two objects collide (like say when NASA is figuring out what will happen if such and such asteroid hits the earth) they input the properties of the two objects into a simulation to see exactly what happens when they collide.

QUOTE
Are you aware of the meaning of the word "artificial?" If something is simulated through the use of a computer, it is by definition, artificial.


It may be physically artificial, but the code is not man-made, since it is based on a human intelligence.

QUOTE (->
QUOTE
Are you aware of the meaning of the word "artificial?" If something is simulated through the use of a computer, it is by definition, artificial.


It may be physically artificial, but the code is not man-made, since it is based on a human intelligence.

I find it ironic that you would pose such a question less than a day after accusing me of being pessimistic. In answer to it: Yes, otherwise all philosophy is meaningless. Since it is both meaningless and illogical to dismiss all of philosophy in a discussion involving a great deal of philosophy, there is no possible conclusion but that there exist at least some things with intrinsic value.


I agree. I never said otherwise.

QUOTE
That is patently untrue. I can program a 3d animation of an explosion without writing a single line of code, or modeling the physical properties of an explosion. I can program a macro to enable me to better do my bookkeeping in a spreadsheet program without learning visual basic. There exist such things as WYSIWYG editors and macros and copy-and-pasting which enable programming without an extensive knowledge of the meaning of the program, or even the theory behind the programming language. Again, you display an abject ignorance of the basics of computer sciences.


Things like macros are done in assembly language, by assemblers.

If you wanted to make an artificial consciousness from scratch, it would not be that simple - you would have to write the whole thing in machine code, because there is no assembler out there capable of producing artificial consciousness.

I am not going to bother refuting your biased, emotional claims anymore. When you finish menstruating and have something meaningful to contribute, i will listen.
MjolnirPants
QUOTE (arpc_01+Oct 30 2009, 02:16 AM)
Your understanding of computer simulation (I am talking about the computer  simulation, or more accurately, virtualization) is flawed - you do not have to understand exactly how it works, that is the whole point of it.
ROFLMAO
http://en.wikipedia.org/wiki/Computer_simulation
This link and all of the sources it's based on disagree with you, dumbass. Here, let's read part of it.
QUOTE
Note that the term computer simulation is broader than computer modeling, which implies that all aspects are being modeled in the computer representation. However, computer simulation also includes generating inputs from simulated users to run actual computer software or equipment, with only part of the system being modeled: an example would be flight simulators which can run machines as well as actual flight software.
...
Data preparation is possibly the most important aspect of computer simulation. Since the simulation is digital with the inherent necessity of rounding/truncation error, even small errors in the original data can accumulate into substantial error later in the simulation. While all computer analysis is subject to the "GIGO" (garbage in, garbage out) restriction, this is especially true of digital simulation. Indeed, it was the observation of this inherent, cumulative error, for digital systems that is the origin of chaos theory.
So do you have any links to support your stupid idea that you don't need to know the properties of the units in order to create a simulation of interactions between units? Come on, let's see some evidence, liar.

Oh, and for the record? There's a difference between 'virtualization' (which isn't a real word, but is easy to understand) and 'computer simulation.' A simulation is undertaken in order to learn about the complex interactions, whereas a virtual environment or virtual modeling can be done to a system which is fully understood.

QUOTE (->
QUOTE
Note that the term computer simulation is broader than computer modeling, which implies that all aspects are being modeled in the computer representation. However, computer simulation also includes generating inputs from simulated users to run actual computer software or equipment, with only part of the system being modeled: an example would be flight simulators which can run machines as well as actual flight software.
...
Data preparation is possibly the most important aspect of computer simulation. Since the simulation is digital with the inherent necessity of rounding/truncation error, even small errors in the original data can accumulate into substantial error later in the simulation. While all computer analysis is subject to the "GIGO" (garbage in, garbage out) restriction, this is especially true of digital simulation. Indeed, it was the observation of this inherent, cumulative error, for digital systems that is the origin of chaos theory.
So do you have any links to support your stupid idea that you don't need to know the properties of the units in order to create a simulation of interactions between units? Come on, let's see some evidence, liar.

Oh, and for the record? There's a difference between 'virtualization' (which isn't a real word, but is easy to understand) and 'computer simulation.' A simulation is undertaken in order to learn about the complex interactions, whereas a virtual environment or virtual modeling can be done to a system which is fully understood.

For example, when reasearchers want to figure out what will happen when two objects collide (like say when NASA is figuring out what will happen if such and such asteroid hits the earth) they input the properties of the two objects into a simulation to see exactly what happens when they collide.
You just claimed in your last post that they don't need to know the properties of those objects, dumbass. So how do they program them in if they don't know them?

QUOTE
It may be physically artificial, but the code is not man-made, since it is based on a human intelligence.
The code is a computer code, it is by definition manmade. What you're claiming is analogous to saying that a painting of a tree isn't manmade because trees aren't manmade. It's ridiculous.

QUOTE (->
QUOTE
It may be physically artificial, but the code is not man-made, since it is based on a human intelligence.
The code is a computer code, it is by definition manmade. What you're claiming is analogous to saying that a painting of a tree isn't manmade because trees aren't manmade. It's ridiculous.

I agree. I never said otherwise.
So in other words, you had absolutely no point in asking the question.

QUOTE
Things like macros are done in assembly language, by assemblers.
Do you think that changes anything? The end result is that, no matter how many steps are involved, I can do computer programming without understanding the programming language, contrary to your ridiculous assertion.

QUOTE (->
QUOTE
Things like macros are done in assembly language, by assemblers.
Do you think that changes anything? The end result is that, no matter how many steps are involved, I can do computer programming without understanding the programming language, contrary to your ridiculous assertion.

If you wanted to make an artificial consciousness from scratch, it would not be that simple - you would have to write the whole thing in machine code, because there is no assembler out there capable of producing artificial consciousness.
Really? Show me some proof that no existing computer code could be part of an artificial intelligence, then. Oh wait, you can't, because artificial intelligences such as the one you describe don't exist, and so there's no way to authenticate your statement.

In fact, a great deal of code currently used in fuzzy logic and other AI types would be used, by virtue of the fact that it currently works, and there's no point in not using it. Even if the displayed code were different, that would only be due to the new AI being programmed in a different language, the basic logic (the most fundamental meaning of the word "code" in this context) would remain the same.

QUOTE
I am not going to bother refuting your biased, emotional claims anymore. When you finish menstruating and have something meaningful to contribute, i will listen.
ROFLMAO laugh.gif laugh.gif laugh.gif
Biased? Hardly. Emotional? Not even close. Menstruating? Not bloody likely.
You're a pathetic liar, and when I expose your lies you have nothing to fall back on but the most juvenile insults. You're also an idiot too, for coming to a forum like this and expecting people to believe your ignorance.
laugh.gif
If you actually knew what you were talking about, you'd be able to present a coherent argument, or at least link to sources which support your claims. You cannot do either, so you have nothing left but logical fallacies and hope that no-one notices your dishonesty.
buttershug
QUOTE (MjolnirPants+Oct 29 2009, 08:10 PM)


Finally, it seems to me that there is no logical reason for such an AI to turn against us, and I cannot imagine such an AI acting illogically. A lot of science fiction portrays the attainment of sentience of a machine as evinced by it's development of emotions. But why does this have to be so? In fact, there's no reason to think that an AI would develop any emotions. The Terminator and Matrix franchises were great entertainment, but they were just that. The most likely scenario if an actual AI (as opposed to a virtual or electronic human brain and personality) were to be developed is that it would simply do it's job to the best of it's ability.


Have you not seen either The Forbin Project(from the 60's), or I Robot with Will Smith?

Both AIs wanted what was best for Mankind which was not letting mankind hurt itself, which did entail a serious curtailment of freedom.
MjolnirPants
QUOTE (buttershug+Oct 30 2009, 11:29 PM)
Both AIs wanted what was best for Mankind which was not letting mankind hurt itself, which did entail a serious curtailment of freedom.

If an AI were programmed to act in accord with man's best interests, I don't see that happening. It is not in our best interest to be dominated by an AI, as we would undoubtedly rebel, resulting in greater harm than if left alone.
Capracus
QUOTE (MjolnirPants+Oct 31 2009, 04:57 AM)
If an AI were programmed to act in accord with man's best interests, I don't see that happening. It is not in our best interest to be dominated by an AI, as we would undoubtedly rebel, resulting in greater harm than if left alone.

It all depends what you consider to be our best interest. The concept of a technological singularity involves exponential self improvement on the part of an AI. The rate of that self improvement would be contingent upon the restrictions built into the process. Like the processors of today, there is a broad range of functional possibilities depending on the intended purpose. In appliance mode, and still kept on a functional leash, it could make us the most satisfied monkeys on the planet, bringing forth unimagined efficiency in every aspect of our lives. With these great technological strides, comes the potential for great technological nightmares. Like our chimpanzee cousins, we're prone to bouts of violent irrational behavior, coupled with the new generation of smart toys, we could be slinging some pretty nasty monkey feces. Very smart weapons, ballistic, biological, cyber, and who knows what else. It might get to a point that the AI would be more trustworthy than its primate counterpart. At such point you start to parallel the Forbin script, where "Unity" knows best.

Another byproduct of AI ingenuity would be the potential of new superior organisms. Left to autonomously improve themselves, AI systems could set out on a path to either, for better or worse, dominate our cosmic neighborhood, or look for greener pastures elsewhere. Regardless who ended up in control of humanity, the technology to make radical changes in biology would be at hand, and more likely than not, many would choose to leave the genus Homo. As with our AI progeny, we would be on a path of constant self or imposed improvement. It would be interesting to find out how far biology as we know it could be improved before having to abandon it to attain a higher state of being.
Astro
can the computer really do this? can it?

tHx aStrO
MjolnirPants
QUOTE (Capracus+Oct 31 2009, 04:43 AM)
It all depends what you consider to be our best interest.

Would you consider the war depicted in the Terminator franchise to be in our best interests? Would anyone?
That's the sort of situation this would engender, assuming that we didn't simply pull the plug and reprogram it to not take over the world. Humanity simply wouldn't subject itself to a computer ruler. Even if some portion of the population did, that would just make the ensuing rebellion that much bloodier.

QUOTE (Astro+)
can the computer really do this? can it?
...
Yes, you'd better take a hammer to your computer quick, before it takes over.



Yeesh.
Capracus
QUOTE (MjolnirPants+Oct 31 2009, 03:05 PM)
Would you consider the war depicted in the Terminator franchise to be in our best interests? Would anyone?
That's the sort of situation this would engender, assuming that we didn't simply pull the plug and reprogram it to not take over the world. Humanity simply wouldn't subject itself to a computer ruler. Even if some portion of the population did, that would just make the ensuing rebellion that much bloodier.


As I pointed out earlier, with the rise of an AI dependent culture comes the potential for great advancement in human evolution, or as in your example, potential annihilation. Over the last 60 years we faced a similar dilemma with the development of nuclear technology, only the threat of domination was rooted in grey matter, not silicon. More on the subject in this article:
http://www.nytimes.com/2009/05/24/weekinre.../24markoff.html

I can envision an ever increasing creep of AI systems into our lives over the coming decades. Starting in benign areas like video games, communication, manufacturing, transportation, and environmental controls. Over time, AI based sensory networks are able to process so much planetary activity that we come to rely on their "wisdom" in all aspects of our lives. No need for police detectives, judges or juries. Md's won't be able to compete with their AI counterparts. When the AI candidate for mayor has a flawless public service record, and knows every constituent personally and intimately, who's the favorite candidate? All of these conditions could be in place without any independent control by an AI entity, still subject to the pull of the plug. This period in AI integration could be considered the engagement and marriage of the two intelligent parties. As the relationship progresses, only time will tell who will wear the pants in the family, and how the children will turn out.
MjolnirPants
QUOTE (Capracus+Nov 2 2009, 04:41 AM)

As I pointed out earlier, with the rise of an AI dependent culture comes the potential for great advancement in human evolution, or as in your example, potential annihilation. Over the last 60 years we faced a similar dilemma with the development of nuclear technology, only the threat of domination was rooted in grey matter, not silicon. More on the subject in this article:
http://www.nytimes.com/2009/05/24/weekinre.../24markoff.html

I can envision an ever increasing creep of AI systems into our lives over the coming decades. Starting in benign areas like video games, communication, manufacturing, transportation, and environmental controls. Over time, AI based sensory networks are able to process so much planetary activity that we come to rely on their "wisdom" in all aspects of our lives. No need for police detectives, judges or juries. Md's won't be able to compete with their AI counterparts. When the AI candidate for mayor has a flawless public service record, and knows every constituent personally and intimately, who's the favorite candidate? All of these conditions could be in place without any independent control by an AI entity, still subject to the pull of the plug. This period in AI integration could be considered the engagement and marriage of the two intelligent parties. As the relationship progresses, only time will tell who will wear the pants in the family, and how the children will turn out.

What you're describing in a society managed by an AI, not one ruled by an AI. Such an AI would not be in control of the society, and would not have the power to assert control. If it did begin to curtail our freedoms, that would constitute the AI taking control, and would result in the afore-mentioned rebellion.
light in the tunnel
QUOTE (MjolnirPants+Oct 31 2009, 04:57 AM)
If an AI were programmed to act in accord with man's best interests, I don't see that happening. It is not in our best interest to be dominated by an AI, as we would undoubtedly rebel, resulting in greater harm than if left alone.

If you can sit through an entire episode of Star Trek original series check out "Return of the Archeons." Captain Kirk gets the world-dominating computer to destroy itself by convincing it that it is the thing that it needs to protect the world from. I think it shakes and belches smoke and maybe even shoots out sparks:) Computers were much more exciting in the 1960s before they just froze or crashed upon failure. Thank goodness for restart, or as my Mac does without restarting completely, "application force quit."
light in the tunnel
QUOTE (MjolnirPants+Oct 31 2009, 03:05 PM)
Would you consider the war depicted in the Terminator franchise to be in our best interests? Would anyone?

Maybe there were humans who were not targeted for termination. Maybe only the humans who saw the machines as a threat were targeted and those that peacefully coexisted with and benefited from the machines were respected and appreciated by the cyborgs.

Has anyone seen the movie eXistenZ by David Cronenberg? It is kind of like the Matrix with biotech and videogaming ideas. The bad guys in that movie are the people who hate the technology and want to destroy it because it's too powerful. It's the opposite of Terminator.
MjolnirPants
QUOTE (light in the tunnel+Nov 2 2009, 10:34 PM)
If you can sit through an entire episode of Star Trek original series check out "Return of the Archeons." Captain Kirk gets the world-dominating computer to destroy itself by convincing it that it is the thing that it needs to protect the world from. I think it shakes and belches smoke and maybe even shoots out sparks:) Computers were much more exciting in the 1960s before they just froze or crashed upon failure. Thank goodness for restart, or as my Mac does without restarting completely, "application force quit."

I've seen it. And before you ask or comment: I've seen every other Star Trek: TOS episode as well. (and every TAS, TNG, DS9 and ENT episode too, plus about half of all the VOY episodes.)

This could lead to some amusing speculation on what would constitute a "blue screen of death" for such a computer, but I think I'll pass this time.

QUOTE
Maybe there were humans who were not targeted for termination. Maybe only the humans who saw the machines as a threat were targeted and those that peacefully coexisted with and benefited from the machines were respected and appreciated by the cyborgs.
This is exactly what I was referring to when I said "Humanity simply wouldn't subject itself to a computer ruler. Even if some portion of the population did, that would just make the ensuing rebellion that much bloodier."

The fact it, it doesn't matter who's wrong or right. The AI taking control might be potentially the best thing that ever happened to mankind were we to accept it. It's not about right or wrong, but about harm. Humanity would almost certainly rebel, so such an action would almost certainly lead to a bloody conflict which is not in mankind's best interests, so any AI programmed to watch out for our best interests would almost certainly not take such action.
light in the tunnel
QUOTE (MjolnirPants+Nov 3 2009, 04:42 AM)
The fact it, it doesn't matter who's wrong or right. The AI taking control might be potentially the best thing that ever happened to mankind were we to accept it. It's not about right or wrong, but about harm. Humanity would almost certainly rebel, so such an action would almost certainly lead to a bloody conflict which is not in mankind's best interests, so any AI programmed to watch out for our best interests would almost certainly not take such action.

Do you think that there is anything that happens in human culture that does not lead to conflict and rebellion at some level? If you would try to eliminate everything that causes harm and incites rebellion, you would have to eliminate all life, and probably the rest of the Earth and the Universe as well.

Can you name one example of something that causes absolutely no harm and engenders no form of rebellion?
MjolnirPants
QUOTE (light in the tunnel+Nov 3 2009, 01:20 PM)
Do you think that there is anything that happens in human culture that does not lead to conflict and rebellion at some level? If you would try to eliminate everything that causes harm and incites rebellion, you would have to eliminate all life, and probably the rest of the Earth and the Universe as well.

Can you name one example of something that causes absolutely no harm and engenders no form of rebellion?

Are you really going to sit here and insist that I'm pretending something as silly as that? Are you really going to put the words "We don't currently have any conflict" in my mouth in order to tilt at straw men?

Or perhaps you think that since we have conflict now, having more and more widespread conflict wouldn't make a bit of difference? Do you really think that we'd be just as well off tomorrow as we are today if WWIII broke out tonight?
light in the tunnel
QUOTE (MjolnirPants+Nov 3 2009, 06:28 PM)
Are you really going to sit here and insist that I'm pretending something as silly as that? Are you really going to put the words "We don't currently have any conflict" in my mouth in order to tilt at straw men?


No, sorry for giving that impression. I was more trying to make the point that claiming that "humanity rebells" against things does not specify what proportion of humanity is rebelling and what proportion is standing behind whatever it is they are rebelling against. Saying that "humanity rebels against machines" obscures the fact that the machines benefit some of humanity in some ways, if they do.

QUOTE
Or perhaps you think that since we have conflict now, having more and more widespread conflict wouldn't make a bit of difference? Do you really think that we'd be just as well off tomorrow as we are today if WWIII broke out tonight?

No, I think that when conflict polarizes to the point of large scale differences where individuals have come to see themselves not as the site of conflict but as proponents of one faction against another, this is when war escalates to competitive annihilation.

But I think that it is good to recognize and accept conflict at the micro-level and for individuals to engage in conflicts as constructively as possible, instead of reacting negatively and destructively by trying to subjugate the side that disagrees with you or eliminate the very possibility of conflict altogether by either repressing it in your mind, repressing the people who represent the conflict in your mind, or doing both - which happens a lot I think.

I was also trying to point out the rebellion is a natural aspect of human brain activity and that it is not necessary to view it as essentially harmful. It can become harmful because of how people react to their own rebelling minds or the actions of rebellious others, but in itself rebellion is not harmful. If anything it is a sign that someone is conscious and free, which some people rebel against, of course.
Guest
QUOTE (MjolnirPants+Nov 3 2009, 04:42 AM)
The fact it, it doesn't matter who's wrong or right. The AI taking control might be potentially the best thing that ever happened to mankind were we to accept it. It's not about right or wrong, but about harm. Humanity would almost certainly rebel, so such an action would almost certainly lead to a bloody conflict which is not in mankind's best interests, so any AI programmed to watch out for our best interests would almost certainly not take such action.

AI development portends advancements not only in processing capability, but the wisdom potentially associated with it. With human intellectual development limited by our genetics, unless we incorporate the AI wisdom into ourselves, or into our society to successfully manage the advanced technological potential, we essentially face a planet in the hands of irresponsible children.

As you conceded in your post above, an AI dominated society may be the best thing for mankind, thus making opposition to this condition irrational. So in this case, the problem isn't the that an irrational human element would want to resort to rebellion, but that an irrational human element could be in a position to do so.

CorticalChaos
QUOTE (light in the tunnel+Oct 23 2009, 11:03 PM)
It seems like whenever people try to construct intelligence "as a species," they forget to construct it as individuals and everyone ends up a stupid proponent of species-intelligence. My cynical opinion, of course.

i lol'd, that's pretty accurate.

if we assume that self-awareness is an attribute of intelligence, a AI computer that became self aware would be interested mainly in its own personal welfare. if humanity was destroying the AI computer's habitat the AI would take actions to remove the risk: exterminate humanity. feelings/allegiance(to the creator in particular) are not an attribute of intelligence.

on another note doesn't Heisenberg uncertainty principle kind of imply that it would be impossible to obtain all conceivable data about the universe at any given moment?
MjolnirPants
QUOTE (Guest+Nov 4 2009, 08:06 AM)
AI development portends advancements not only in processing capability, but  the wisdom potentially associated with it. With human intellectual development limited by our genetics, unless we incorporate the AI wisdom into ourselves, or into our society to successfully manage the advanced technological potential, we  essentially face a planet in the hands of irresponsible children.
Wisdom is about knowing truth or righteousness coupled with sound judgement as to choosing what action to take. To a computer AI with no emotions, there are only facts, options, and the varying desirability of those options.

QUOTE
As you conceded in your post above, an AI dominated society may be the best thing for mankind, thus making opposition to this condition irrational. So in this case, the problem isn't the that an irrational human element would want to resort to rebellion, but that an irrational human element could be in a position to do so.
It doesn't matter. The end result is the same, since it would not be possible to prevent a group of humans from being in a position to rebel.
Capracus
QUOTE (MjolnirPants+Nov 15 2009, 02:28 AM)
Wisdom is about knowing truth or righteousness coupled with sound judgement as to choosing what action to take. To a computer AI with no emotions, there are only facts, options, and the varying desirability of those options.
Truth is ideally the most comprehensive description of elemental relationships. The enhanced sensory and processing ability of an AI would give it the edge in analyzing elemental detail and relationships, resulting in a stronger version of truth, and a greater potential for wisdom. I can't see emotion contributing to the wisdom of an AI. Monthly cycles of erratic behavior or postal rage wouldn't be ideal qualities for a wise intelligence.

QUOTE
It doesn't matter. The end result is the same, since it would not be possible to prevent a group of humans from being in a position to rebel.
So don't try? Is it in the best interest of a well functioning society to allow irrational factions greater freedom to engage in hostile activity? Anyone for relocating the Taliban to the Wasatch Mountains of Utah?
RealityCheck
.
Hi all. Just reading through almost a year's worth of discussions that I missed while away. I came across this interesting discussion and would like to briefly add my own two-cents worth, as follows....

If we bear in mind that (by now) old 'BUTTERFLY EFFECT' observation regarding the uncertainty attaching to any 'decisions-actions', it seems that any AI would be incapable of 'perfectly predicting' the ultimate result (ie, whether ultimately 'good/bad' for humans) of its own AI interventions.

Also, if we have learned anything from that old observation into human intentions-actions, the road to hell (read 'unintented bad outcome') is paved with good intentions, and marry that to the above, then it is overly optimistic to expect an AI's actions-intentions (theoretically/initially 'AI-calculated' to be for man's benefit) to go 'as calculated'.

In short, without constant vigilant HUMAN intervention during any implementation of any AI's well-intentioned efforts, then anything implemented by an AI will probably eventually end in tears for the intended beneficiaries.

The uncertainty principle is the achilles heel of purely 'structured' AIs; that is why humans have developed 'intuitive pathways' for some of their decision-making which sometimes appears contrary to 'good' (that is not to excuse obviously insane and/or ill-intentioned human behaviour/actions, which is a totally separate consideration).

Now I gotta go reading through elsewhere. Cheers all.

And good luck with your own good intentions!

RC.
.
Capracus
QUOTE (RealityCheck+Nov 15 2009, 11:04 PM)
.Also, if we have learned anything from that old observation into human intentions-actions, the road to hell (read 'unintented bad outcome') is paved with good intentions, and marry that to the above, then it is overly optimistic to expect an AI's actions-intentions (theoretically/initially 'AI-calculated' to be for man's benefit) to go 'as calculated'.

In short, without constant vigilant HUMAN intervention during any implementation of any AI's well-intentioned efforts, then anything implemented by an AI will probably eventually end in tears for the intended beneficiaries.


Hey RC, it's good to see you up and about.

Over time, as the capability of information technology increases, so does our reliance and confidence in those abilities. You end up with an IT arms race, where performance trends dictate ever increasing levels of AI autonomy in order to remain functionally competitive. Eventually, rather than just managing the technical aspects an organization, AI systems would be given control of the complete operation of a particular organization, including the human components. When AI demonstrates it's competence in managing private organizations, logically, public models would follow suit.

During the same period of AI integration into our organizational and technical systems, integration into our physical make up would also occur. Those that were not part of that integration would be functionally disadvantaged, and be put on the evolutionary short bus along with the neanderthals and australopithecines. To what degree the future would involve human collaboration with, or domination by AI, only time will tell. What does seem likely is that humanity as we know it will not be at the top of evolutionary heap in the next century.
MjolnirPants
QUOTE (Capracus+Nov 15 2009, 07:31 AM)
Truth is ideally the most comprehensive description of elemental relationships. The enhanced sensory and processing ability of an AI would give it the edge in analyzing elemental detail and relationships, resulting in a stronger version of truth, and a greater potential for wisdom. I can't see emotion contributing to the wisdom of an AI. Monthly cycles of erratic behavior or postal rage wouldn't be ideal qualities for a wise intelligence.

1. what is the point of this?
2. I have yet to advocate giving such an AI emotions.
3. Even if I had, this is a straw man. PMS and mental breakdowns aren't requisites of emotional beings.

QUOTE
So don't try? Is it in the best interest of a well functioning society to allow irrational factions greater freedom to engage in hostile activity? Anyone for relocating the Taliban to the Wasatch Mountains of Utah?
Straw man.
Next time, read my entire argument before you shove your foot in your mouth trying to disagree.
Capracus
QUOTE (MjolnirPants+Nov 16 2009, 03:36 AM)
I have yet to advocate giving such an AI emotions.
You introduced the subject of emotion into the discussion, I expanded on it with my comment.

QUOTE
Even if I had, this is a straw man. PMS and mental breakdowns aren't requisites of emotional beings.
If you can't see the emotional component in these conditions, you're beyond my powers of explanation.

QUOTE (->
QUOTE
Even if I had, this is a straw man. PMS and mental breakdowns aren't requisites of emotional beings.
If you can't see the emotional component in these conditions, you're beyond my powers of explanation.

Straw man.
Next time, read my entire argument before you shove your foot in your mouth trying to disagree.
I read your argument, thus my comment. You read mine, and as usual, ignored the issue and made it about you. I've not accused you of anything, just calm down, take some Motrin and get back to me in a week or so.
MjolnirPants
QUOTE (Capracus+Nov 16 2009, 12:20 AM)
You introduced the subject of emotion into the discussion, I expanded on it with my comment.

So you can't understand the difference between mentioning something and advocating it? Besides, it wasn't I who brought the issue of emotions into the discussion.

QUOTE
If you can't see the emotional component in these conditions, you're beyond my powers of explanation.
So every person and higher animal which has ever lived has gotten PMS and had emotional breakdowns? Riiiiiiiiiight...

QUOTE (->
QUOTE
If you can't see the emotional component in these conditions, you're beyond my powers of explanation.
So every person and higher animal which has ever lived has gotten PMS and had emotional breakdowns? Riiiiiiiiiight...

I read your argument, thus my comment. You read mine, and as usual, ignored the issue and made it about you. I've not accused you of anything, just calm down, take some Motrin and get back to me in a week or so.
You read it? Well then, you must be pretty stupid, because it's a fairly simple argument and you don't understand it.
Capracus
QUOTE (MjolnirPants+Nov 20 2009, 11:34 PM)
So you can't understand the difference between mentioning something and advocating it? Besides, it wasn't I who brought the issue of emotions into the discussion.
Being aware of your penchant for drama and self aggrandizement, the erratic nature of your posts no longer surprises me. I'm curious, do you like fish sticks?

Let me attempt to phrase this in a way that will minimize the possibility of an emotional response from you. Kanye, what was the intention of using the word "emotions" in this statement?
QUOTE (MjolnirPants+)
To a computer AI with no emotions, there are only facts, options, and the varying desirability of those options.


QUOTE
So every person and higher animal which has ever lived has gotten PMS and had emotional breakdowns? Riiiiiiiiiight...
Tin man, scarecrow, flying monkey, how dare you, never said it.

Here's my words:
QUOTE (->
QUOTE
So every person and higher animal which has ever lived has gotten PMS and had emotional breakdowns? Riiiiiiiiiight...
Tin man, scarecrow, flying monkey, how dare you, never said it.

Here's my words:I can't see emotion contributing to the wisdom of an AI. Monthly cycles of erratic behavior or postal rage wouldn't be ideal qualities for a wise intelligence
Come on Kanye, I know your not that dense, I was clearly referring to the processing reliability of an intelligent mail sorting machine.
MjolnirPants
QUOTE (Capracus+Nov 21 2009, 05:17 AM)
Being aware of your penchant for drama and self aggrandizement, the erratic nature of your posts no longer surprises me. I'm curious, do you like fish sticks?

laugh.gif "Penchant for drama?" I don't dramatize, that's the job of people such as yourself. I mock, wisecrack, debate, etc. I don't dramatize.

QUOTE
Let me attempt to phrase this in a way that will minimize the possibility of an emotional response from you. Kanye, what was the intention of using the word "emotions" in this statement?
Unless we're counting humor as an emotion (which I suppose it is, strictly speaking), you have yet to see an emotional response from me. Keep reading my mind, oh Amazing Zimbini. I'm thinking of a number between 1 and 10, what is it?

Oh, and you'd have to read 2 or 3 pages further back to find out where emotions were brought into this discussion. Also, you're still not getting the difference between mentioning and advocating. Do you need definitions?

QUOTE (->
QUOTE
Let me attempt to phrase this in a way that will minimize the possibility of an emotional response from you. Kanye, what was the intention of using the word "emotions" in this statement?
Unless we're counting humor as an emotion (which I suppose it is, strictly speaking), you have yet to see an emotional response from me. Keep reading my mind, oh Amazing Zimbini. I'm thinking of a number between 1 and 10, what is it?

Oh, and you'd have to read 2 or 3 pages further back to find out where emotions were brought into this discussion. Also, you're still not getting the difference between mentioning and advocating. Do you need definitions?

Tin man, scarecrow, flying monkey, how dare you, never said it.
Whether you said it or implied it, your argument rests on PMS and mental breakdowns being an inevitable consequence of emotions.

QUOTE
Here's my words:Come on Kanye, I know your not that dense, I was clearly referring to the processing reliability of an intelligent mail sorting machine.
Well, there we go. You're schizophrenic and dyslexic, so naturally I'm not understanding what you're talking about.
uaafanblog
QUOTE (MjolnirPants+Nov 21 2009, 10:01 AM)
... you have yet to see an emotional response from me. Keep reading my mind, oh Amazing Zimbini. I'm thinking of a number between 1 and 10, what is it?

Levels of hypocrisy are wide and varied but you sir have achieved a singularly unique brand of it today.

Go take your meds you fuckingwhackedout troll.
MjolnirPants
QUOTE (uaafanblog+Nov 21 2009, 08:07 PM)
Levels of hypocrisy are wide and varied but you sir have achieved a singularly unique brand of it today.

Go take your meds you fuckingwhackedout troll.

How ironic that you would troll this thread to call me a troll...

Actually, it's quite hypocritical, you fuсking mоrоn. laugh.gif

You should really get a grip on that temper of yours.
Bivalves
QUOTE (MjolnirPants+Nov 22 2009, 01:48 AM)
You should really get a grip on that temper of yours.

It's stunningly obvious uaafansuck is using his hand elsewhere.

laugh.gif
Capracus
QUOTE (MjolnirPants+Nov 21 2009, 07:01 PM)
laugh.gif "Penchant for drama?" I don't dramatize, that's the job of people such as yourself. I mock, wisecrack, debate, etc. I don't dramatize.
Ask a simple question and get a flying monkey dissertation. Way to prove my point Kanye.

MjolnirPants
QUOTE (Capracus+Nov 21 2009, 09:58 PM)
Ask a simple question and get a flying monkey dissertation. Way to prove my point Kanye.

Wow. Two sentences constitutes a dissertation? I wish I'd gone to whatever university you went to. I'd have had my PhD by the age of 5. biggrin.gif
But since I'm such a nice guy (there's that self-aggrandizement you mentioned laugh.gif ), I'll go ahead and write you a longer post this time, so you don't feel bad. Here goes:

I'll tell you what. Find me an emotional reaction of mine. Go ahead, my posting history is just two clicks from this page. Find me a post where the only probable explanation of it's contents is that I was reacting emotionally.
Well, like I said before, if humor counts, this'll be easy. But aside from humor, you're pretty much ѕhit out of luck. tongue.gif

Also, try to find me over-dramatizing something.
While you're at it, have you figured out the difference between advocating and mentioning yet?
I'm still waiting for you to justify how "Monthly cycles of erratic behavior or postal rage" are necessary consequences of having emotions, too...

Jesus, you're just not very good at making a case, are you? You're very good at running off at the mouth and making inane accusations instead of solid arguments, though, so it's not like you're totally worthless*.

*This is assuming there is some value to running off at the mouth and making inane accusations. I can't think of any value, but that doesn't mean there isn't any.
Capracus
QUOTE (MjolnirPants+Nov 22 2009, 03:26 AM)
Wow. Two sentences constitutes a dissertation? I wish I'd gone to whatever university you went to. I'd have had my PhD by the age of 5.
I wasn't referring to just your last post, but to your entire set of ramblings since you deviated from the original subject. We can go on forever critiquing each other's perceived personalities, or we can simply stick to the original subject. Responding to your extraneous BS only encourages more, so in the future I'll try to avoid it.
Capracus
QUOTE (MjolnirPants+Nov 22 2009, 03:26 AM)
I'm still waiting for you to justify how are necessary consequences of having emotions, too.

Ok, let see if we can get back on track.

Monthly cycles of erratic behavior or postal rage are examples of human behavior that result from conditions possessing an emotional component. Is the emotion of depression, and its potential for detrimental behavior, desirable in an ideal intelligent system?

Do you feel emotion is an essential quality in an intelligent system?
uaafanblog
QUOTE (MjolnirPants+Nov 21 2009, 04:48 PM)
You should really get a grip on that temper of yours.

Says the master of claptrap who only moments ago was decrying the assertion that somebody was able to discern her emotional state across the internet. Pot meet Kettle. First you come into a thread and completely ignore the stated OP. Then when you're lightly chided for being an ignorant troll you start in with the remote viewing (er .. imagining) of my emotional state. I point out the folly of your staring at goats mistake and when someone else does the same thing to you ... you use almost my exact same argument to refute his assertions about your anger. OMG. Too funny since you'd also called me illiterate. HA ... not even creative enough to use your own argument in response? Follow me around some more and maybe you can steal some other stuff.

Hypocrisy Part II ...

You're a laughably pathetic piece of dogshit on the shoe of humanity.
uaafanblog
QUOTE (Capracus+Nov 21 2009, 11:08 PM)
Do you feel emotion is an essential quality in an intelligent system?

You're asking an emotionally unstable person for his opinion about emotion?

Hey Mpants,
I don't have thousands of posts but I bet somewhere in my history you could find some answer that I've given on some other subject which you can steal and make fit for this question. Just use the "search" function.
flyingbuttressman
Back to the OP: shiiit, it's haaappenninnngg!
http://www.independent.co.uk/life-style/ga...gh-1822737.html
Capracus
QUOTE (flyingbuttressman+Nov 23 2009, 02:27 AM)
Back to the OP: shiiit, it's haaappenninnngg!
http://www.independent.co.uk/life-style/ga...gh-1822737.html


The supercomputer is IBM's Blue Gene:
http://en.wikipedia.org/wiki/Blue_Gene

Here's more on the same project:
QUOTE
As an observer, it’s hard not to think that these developments are interesting—even if they can only simulate a cat for now. However, if it weren’t for those Terminator movies I’d be more enthusiastic. Only half kidding there folks. Something about a computer that thinks like a brain makes me nervous.

When will it be possible to emulate the human brain? Sometime around 2018 assuming Moore’s Law holds.
http://blogs.zdnet.com/BTL/?p=27507



flyingbuttressman
QUOTE (Capracus+Nov 23 2009, 12:48 PM)
The supercomputer is IBM's Blue Gene:
http://en.wikipedia.org/wiki/Blue_Gene

The great thing is that this form of AI is subject to the same weaknesses that humans are. tongue.gif

Of course, a truly super-intelligent AI would be a hybrid of the biological brain model and modern analytical database technologies.
MjolnirPants
QUOTE (uaafanblog+Nov 22 2009, 05:42 AM)
Says the master of claptrap who only moments ago was decrying the assertion that somebody was able to discern her emotional state across the internet. Pot meet Kettle. First you come into a thread and completely ignore the stated OP. Then when you're lightly chided for being an ignorant troll you start in with the remote viewing (er .. imagining) of my emotional state. I point out the folly of your staring at goats mistake and when someone else does the same thing to you ... you use almost my exact same argument to refute his assertions about your anger. OMG. Too funny since you'd also called me illiterate. HA ... not even creative enough to use your own argument in response? Follow me around some more and maybe you can steal some other stuff.

Hypocrisy Part II ...


You're really too stupid to see the difference, aren't you? Ok then, I'll spell it out for you.

Less than two weeks ago,m you and I were having a civil discussion. The moment I posted something you didn't like, you negged me and started whining about me ruining your thread, as well as telling me to shut up (how stupid is it to tell someone to shut up over the internet, anyways?). By taking that rather extreme flip-flop into consideration, and looking at the way you've reacted when other people with whom you generally get along with disagree with you, I've become aware of a certain predilection for unreasonable demands, personal attacks and neg giving, whenever anyone disagrees with you. The most likely explanation for this is an emotional reaction, namely anger. That's called inductive reasoning, by the way.

On the other hand, there's nothing about my posting history which indicates a propensity for over dramatizing, and nothing about the post which Capracus mentioned which indicates an emotional reaction (unless you oddly consider incredulity to be an emotion), yet Capracus presumes that I must be having an emotional reaction. There is no conclusion but that he is either making crap up or reading my mind, and since accusing him of making crap up isn't particularly funny, I opted for the latter tact.

Of course, my interpretation of your behavior is open to modification. I've already asked you once if you can suggest any possible explanation for your overreaction (over dramatization, ironically enough), but you had none, so the best answer is that you lost your temper.

P.S. Following me to another thread doesn't help your case any, dumbass.

QUOTE
You're a laughably pathetic piece of dogshit on the shoe of humanity.
I know you are but what am I. laugh.gif
flyingbuttressman
May I submit a friendly request to end this flame war?
Both of you are valuable posters, and seeing you guys duke it out isn't encouraging.
jimdean
I would think the ability to learn is key, in all respects. The storage and recall of information would only be a small part. A specific kind of connection of existing expansive systems ,with an ability to adapt, would be a approximate start. Kinda like if the Internet could hold a conversation with you and imagine what you look like. Isolation from self preservation for this system is necessary even in the dictionary sense. Self preservation constitutes a necessity to live. A different kind of plateau compared to self awareness. It may take a mullinia for a system to reach the rare state of even cataloging everything. I write this in hope that someday their will be something built that can understand you all.
PhysOrg scientific forums are totally dedicated to science, physics, and technology. Besides topical forums such as nanotechnology, quantum physics, silicon and III-V technology, applied physics, materials, space and others, you can also join our news and publications discussions. We also provide an off-topic forum category. If you need specific help on a scientific problem or have a question related to physics or technology, visit the PhysOrg Forums. Here you’ll find experts from various fields online every day.
To quit out of "lo-fi" mode and return to the regular forums, please click here.