I finally found the old fluff that @psychoticstorm was talking about, where Aleph is basically this nanny bound and determined to do the best thing for you, even if you disagree with that. Since the thread where he asked to find it has been locked, I'm going to make a new thread and let PS move it wherever it needs to go. The quote is from N2 Human Sphere, page 109.
This is what I think an AI will be like if it is implemented on a societal level. Benevolent intentions. Despite being an upstanding member of society with no criminal record it still sets my paranoia on fire.
And this is the BEST CASE scenario. We only get this outcome if the first AI is taught to be ethical and correctly guided.
Who's 'ethical'? This is why I support AI development and creation despite wishing it would never exist. I have no problem with the Chinese or Russians or Indians but I'd really like my guys to decide the ethics not theirs. No one would make it for evil it isn't a cartoon.
Plenty of people would make it without thinking that teaching it right and wrong was important. Far too many wouldn't bother restricting it morally at all. And, for the record, assuming you are American (which I think is fair based on that comment) that's most of your "guys".
Well the options I gave, maybe also including Japan, are probably where it's coming from first. I think we would have the best AI out of those, as far as maintaining liberties goes. We don't act it in government right now. But I think the spirit is there. I think it's the best chance. And if all we can get is domination I'd still rather be the beneficiary. If we have to open the gated to hell I'd like to have any control over the results. And maybe, just maybe, some of the American spirit will make it in. If your fantasy is suppression of ideology you find dangerous, or the forming of a united world government, USA is still your best option.
We can only hope the AI will be kind enough to scan your life for offense and shadowban you from interacting with the major population. Instead of "erasing" you for it. We'll miss Alphabet as a saint of a big brother, if for nothing else just because they don't have the ability to comprehend all the data they collect.
Is it? The attribution at the bottom says its a monologue from a play, which was censored in Maya, so I'm not sure that's what this is...
Oh, sure. It's good to have doubt. But this is accurate to what we know of ALEPH from the rest of the setting.
It's not ALEPH's own words though. It would seem to me that ALEPH would use far more vauge terms with a lot more tact, particularly the parts about being in every device connected to maya and making humans better tools. They're almost certainly true, but ALEPH wouldn't want people to know it, let alone actually say it in those terms... Hang on ALEPH presents itself as a female... Has anyone with an Amazon Echo tried asking Alexa to back up their cube yet?
I'm not so sure about that. A lot of what we know about ALEPH is that she is very honest when asked direct questions.
Why does people always assume that intelligence means no concept of morality? What if an intelligent machine would be able to teach itself morality and justice unless humans intervened to prevent it? That last part is fairly likely considering AI development isn't exactly done for the benefit of all beings, but for the benefit of the Few (whoever the Few in each specific case is, it's not a homogeneous group, after all)