Category Archives: Robots

Intelligence By The Numbers – Numerical Representation of Humans and Machines

In this post I lay out the first part of a mathematical foundation for comparing the capabilities of machines to humans. Let me begin by saying that this is not intended to be a formal mathematical proof that machines can be more intelligent than humans and I have made no attempt at approaching this with any sort of mathematical rigor. The purpose of this exposition is simply to focus attention on existing mathematical concepts in the context of the ongoing discussion regarding the metrics we use to measure intelligence. I will later use this to show why I believe that machines will far outperform us no matter what criteria we might adopt in measuring intelligence. The notion of intelligence and intelligent behavior is an abstract one and any attempts to quantify intelligence in humans, animals, or other entities, both living and non-living, have fallen short of expectations. Mathematics has long served as a powerful tool for abstraction of concepts and manipulating those concepts in useful ways. We have successfully deployed it as a tool for working in domains where we have a solid understanding, such as chemistry, as well as domains in which we are still discovering their true nature, such as quantum field theory. Perhaps the most famous example of using mathematics to represent concepts which were not yet understood is Einstein’s theories of relativity. In this case we see an example of using mathematics to build a theory which predicts the existence of phenomenon which were formerly unknown. By representing the world around us in abstract mathematical terms, we are able to use the rich set of mathematical tools at our disposal to test hypotheses and follow them to their logical conclusion.

Representing Humans with Vectors

I begin by introducing a simple concept used in many domains throughout business and science alike – the vector. The notion of a vector is a simple one. It is a series of numbers which comprise a collection treated as a single unit. Although vectors can be manipulated and compared completely independently of any association with real world values, for our purposes we will assume that they represent something ‘real’. Choosing a simple example will make it easier to introduce some concepts typical of vectors . For example, we might use a vector to represent a person with respect to two values such as height and weight. Most of us are familiar with graphing values on an X/Y axis so we will use this to review some simple concepts before moving on to more useful examples. Let’s start with a vector to represent a person (P1) with a height of 72 inches and weight of 220 pounds and another person(P2) with a height of 76 inches and weight of 180 pounds, represented as:

P1 = [72, 220]  P2 = [76, 180]

These two vectors represent our simplistic categorization as depicted in 2-dimensional space shown below.

HeightWeight
2-Dimensional Vector Representation

We can easily see that P1 is greater in terms of weight and that P2 is greater in height. We can also see that taking the two attributes combined (if we assume that height and weight are equally important) P1 is slightly greater than P2 because the line representing P1 is longer than the line representing P2 . This measurement is known as the magnitude of a vector. We say that the magnitude of P1 is greater than the magnitude of P2 .

Now let’s take this comparison and apply it to a situation. Assume we are trying to choose between two athletes for a sports team such as a basketball or football team. In our simple world we only have two data points: height and weight. Also, we will assume that height and weight are equally important on our fantasy sports team. We can see that athlete 1 is heavier at 220 pounds but athlete 2 is taller at 76 inches. But as shown above, athlete 1 has a greater overall magnitude when we combine the two values. So by these very simple criteria athlete 1 is our clear choice. But even in our simple version of the world we would soon realize that there is more to selecting the better athlete than just comparing height and weight, so we begin looking for better criteria to improve our selection process. Perhaps one of the most obvious is strength. There are many ways to measure strength, but since we want to keep our examples simple, we will assume there is some test that gives us a strength index that goes from 0 to 500, where 500 is the strongest human alive. We find that our first athlete has a strength index of 300 and the other a strength index of 450. Our numerical representation of our two athletes now looks like this:

P1 = [72, 220, 300]  P2 = [76, 180, 450]

Visually we can represent this in 3-dimensional space as shown below.

3-Dimensional Vector
3-Dimensional Vector

Just as in our 2-dimensional example, we can evaluate each vector in terms of magnitude, or overall length of the line shown from the origin to the endpoint. Given this added dimension in the two vectors, we can clearly see that the second athlete, P2 , is our better choice.

There are many details and considerations to take into account such as the number of data points beyond our simple 3-dimensional example and how to account for the fact that not all data points should be treated equally. For example, we may want to construct a model where strength is three times as important as weight. I will address these issues and more later on. But for now we have enough to put forth the basis for evaluating the level of intelligence in a human or a machine.

If we take our simple example and translate into the domain of intelligence we might choose to evaluate the three criteria previously suggested in Criteria for Intelligence: speed intelligence, collective intelligence, and quality intelligence. As in the above example where we simplified the notion of the athlete’s strength into a strength index, we will assume we have come up with a method of representing these three rather complex aspects of intelligence with a numerical index. For brevity’s sake, I will refer to these three values which correspond to the three different types of intelligence as speed, breadth, and quality. At this point we haven’t established any real meaning for these measurements so the values are arbitrary. Using the same notation as before to represent these values as a vector for two different people  we have:

P1 = [72, 220, 300]  P2 = [76, 180, 450]

Once again we can represent the intelligence of our two subjects in 3-dimensional space as shown below:

SpeedBreadthQuality
Vector Representation of Three Aspects of Intelligence in a Person

By the given criteria  our second subject P2 is clearly the more intelligent overall as shown by the magnitude of the vector.

The above examples show, albeit in a very simplistic manner, a very straightforward and well-defined way of evaluating multiple characteristics to evaluate and compare two or more subjects using the mathematical structure known as a vector. This concept, along with other mathematical tools which I will introduce later on, have been used for hundreds of years in diverse fields ranging from mathematics and physics to business and finance. I intend to apply these resources in the ongoing effort to explore and ultimately give some clarity to the many questions that fall under the general heading of “What is Intelligence?”, as well as to further my case for the ultimate superiority of machines in the not so distant future.

Collective Intelligence

Nick Bostrom has described collective intelligence as joint problemsolving capacity”. There are many examples of problems that have been solved by more than a single individual and which probably could not have been solved by a single person. When a new drug is discovered and developed it is not done by a single person but by a team of people working toward a collective goal, sometimes in collaboration with other teams performing similar, related research. Projects such as the Human Genome Project was a massive research project that was only able to achieve its goal by the collective research of twenty teams across six countries over thirteen years. In our daily lives we often tackle jobs at work that require the cooperation of several people or large teams to solve problems and implement solutions. We are surrounded by evidence that our problem-solving potential is increased by combining the skills of multiple individuals. This increase in potential is realized for two reasons.

First, we have an additive effect. Think of a simple example where our goal is to identify all red objects in a warehouse. A single individual may be able to pick out and identify each object in 1 second. Therefore they can sort through 60 objects per minute, 3600 objects in an hour. But if we can enlist ten people to take on this task, assuming they are all able to sort through objects at the same rate, we can sort through 36,000 in an hour. In other words, we can accomplish the task ten times as fast! This is of course a rather simple uninteresting example, but this is the way many tasks are accomplished. The pyramids of Egypt were built this way, and many intellectual tasks are as well.

The second reason we can accomplish difficult tasks more easily with a group is due to the breadth of skills required to complete the task. We live in an increasingly complex world and the problems we are faced with are constantly increasing in complexity as well. As the tasks become more complex, solving them requires an ever-increasing array of problem-solving skills. While this phenomenon has been evolving for a long time, the first good example with a significant impact is found in Henry Ford’s approach to building the automobile. Rather than relying on a single individual or even a few individuals with the requisite skills to build a car, he broke the overall tasks into smaller tasks requiring a degree of skill that could be developed in the workers in a short amount of time. Today we see an even greater divergence of skills required in our world. Think of the number of people that contribute to the treatment of a patient during their stay at a hospital. Even going to a store to buy something sometimes involves several people. We ask where we can find what we are looking for and are directed to the correct department. Once there we can’t find what we are looking for and have to ask someone who works in that department. We then ask them about some feature of the product, they don’t know the answer and go find someone who knows more about that product. Finally, we go to the register where we pay for what we have selected. While this may not seem like something that exemplifies the height of human intelligence, it demonstrates how much of what we undertake relies on the knowledge of multiple individuals. This is a simple form of collective intelligence.

There is one more aspect of collective intelligence that is important to recognize. In the past we see examples of a brilliant individual such as Thomas Edison or Alexander Bell who were great innovators. But even these great names relied on the discoveries and knowledge gained from others, some their contemporaries and some from the past. More than any other species, humans have the ability to learn from their predecessors. This ability is referred to by Michael Tomasello and Steven Mithen as cultural learning. In its simplest form it can be seen as a child learning not to cross the street without looking for oncoming cars. It can be seen as the fundamentals of reading, writing, and arithmetic that we learn in our first few years of school. It is seen in our education where we learn the necessary skills for our careers. Although we don’t often think of it, when we attend a year of school to learn a trade or skill we are learning skills and knowledge that took hundreds of years to accumulate. The long term effect of this type of knowledge transfer is incredible. It is what has allowed us to develop rocket ships that fly to the moon and understand the complex system we know as the human body. It is what has led to the development of  the computers that are so advanced, so fast, so intelligent – that they may soon surpass us in intelligence in its every form.

Criteria for Intelligence

Before delving further into how machines might become intelligent it is helpful to define, or at least describe, what is meant by intelligence when referring to machines. I. J. Good, who worked with Alan Turing during World War II and is credited as the originator of the oft cited term ‘singularity’, described what he called an “ultraintelligent” machine as “a machine that can far surpass all the intellectual activities of any man however clever”. Good and many others tend to focus not just on what constitutes intelligence but specifically on how and when we will know that machines will surpass the capabilities of human. Regardless of whether we are defining intelligence or ultraintelligence, the type of the criteria should be the same. This gives us the basis for one possible criterion for intelligence, viz. the ability to perform a task or activity as well as an average person. This gives us the basis for one possible criterion for intelligence, viz. the ability to perform a task or activity as well as an average person.

In Superintelligence: Paths, Dangers, Strategies Nick Bostrom states : “…we use the term ‘superintelligence’ to refer to intellects that greatly outperform the best current human minds across many very general cognitive domains.” He goes on to suggest that it is helpful to decompose this notion into three categories of superintelligence: speed superintelligence, collective superintelligence, and quality superintelligence.

Speed superintelligence is defined as “a system that can do all that a human intellect can do, but much faster.”

Collective superintelligence is defined as “a system composed of a large number of smaller intellects such that the system’s overall performance across many very general domains vastly outstrips that of any current cognitive system.”

Quality superintelligence is defined as “a system that is at least as fast as a human mind and vastly qualitatively smarter.”

Each of these three definitions covers a different form of intelligence and is in fact the product of a different type of system. The next three posts will cover these in more detail.

 

 

The End of Artificial Intelligence?

This century will bring the advent of true intelligence in machines. But exactly what does that mean? We often speak of someone as intelligent. We might speak of an intelligent decision or an intelligent statement. But what exactly does it mean for an action, or an utterance, or a person to be intelligent? I have set a goal to come up with some sort of criteria for determining what counts as an intelligent action and to determine if and when the label of “intelligent” is conferred upon a person or a machine. Loosely defined, we think of someone who is intelligent as being capable of doing something correctly. If a person seems to have all the right answers, we might say they are intelligent. If a person can solve math problems well, we think they are intelligent. But these two things are certainly within the grasp of many computers today and have been for some time. So computers certainly are intelligent at least in this simple, perhaps trivial sense. But when heated discussions arise about whether a computer is truly intelligent we are looking for something deeper, more profound. Most of us would still differentiate between the type of intelligence described above and the intelligence that a human possesses. We even have a special term for it: artificial intelligence.

So what exactly do we mean by artificial intelligence as opposed to real or genuine intelligence? To look at the question another way, precisely what criteria must a machine, a computer, satisfy for us to assert that it possesses intelligence that is not artificial – that it possesses genuine intelligence? The term artificial has several definitions, but fall into two categories. The first infers that something is artificial if it was produced to seem as if it were natural. The second infers that something is not real. The first type of definition is a de facto definition which eliminates anything that is not natural. In other words, if it is not part of the animal or plant kingdom it is by definition artificial. While I cannot say that this definition is wrong, it doesn’t seem to be of much use for the purposes of this discussion. We already knew that machines do not occur in nature. They are made by humans. What I want to focus on is the question of what constitutes real or genuine intelligence.

So back to the original question: what is real intelligence? What criteria constitute intelligence on the same level as we humans? I have seen many definitions of intelligence, and I don’t want to limit myself at this time to any one or even limit myself to a specific list of definitions.

At an intuitive level, it seems that intelligence is closely tied to knowledge. The more knowledge one has and the more one is able to make use of that knowledge, the more intelligent one is. My computer may be able to give me the correct solution for an equation, but can it tell me why it is important to know that solution? Can I trust my computer to let me know what equation I should be trying to solve? We are seeing great progress in these types of “artificial intelligence” and as these very smart and very useful machines become more and more a part of our lives, it will become more and more difficult to find differences between what we humans can do and what machines can do. Seen in this light, it is only a matter of time until the term artificial intelligence becomes arcane and machines will be accepted as truly intelligent. Going forward, I will explore how and in what way advances in the intelligence of machines will take place.

 

Surviving the Rise of the Machines: Partnering with the Enemy

It is easy to see the new breed of machines as the enemy. In many areas they are faster, stronger, and better than we are. Over the past century many jobs have been lost to a machine and it appears that the trend will continue. In the face of increasing competition for jobs between machines and humans two things are apparent:
1.  There are some jobs that a human will never be able to compete with machines for.
2.  Some jobs cannot be done effectively without the aid of tools such as computers and other electromechanical machines.
Any task which is relatively simple or easily replicated can almost always be done faster, more efficiently, and at a lower cost by a machine. Since the 1940’s we have used automation in what is broadly known as CNC (computer numerical control) automation. Modern CNC systems allow us to take a design for a simple component and have the system use tools such as lathes, mills, cutters, hole-punches, and welders to produce the component. These types of jobs benefit greatly from the increased productivity of a machine. For this reason, fewer and fewer humans will be used to create machined components.
Many jobs are still done by humans but have benefited from the increased productivity afforded by using some sort of machine to assist them. Early examples include jack-hammers, electric drills, and nail guns. As computers have become more common and cheaper we have seen their use in the workplace become more and more commonplace. In the business environment, it is very rare to see anyone using a typewriter for letters, purchase orders or any other document. The word processor has become the norm and is present in one form or another on every laptop, tablet, and even mobile phone. Technical fields such as medicine, biology, and astronomy depend heavily on the power of the computer for processing immense amounts of data and performing complex calculations which would never have been possible before. The degree to which computers have become integrated with the careers of today is evident by looking at the curriculum of any modern educational institution. Learning to use a computer in one’s trade has become as necessary as a carpenter learning to use a hammer. As the use of machines and computers increases so does their value. But in some cases this decreases the value of the human worker. As the skills and complexity required to do a job are shifted from human to machine, the value shifts with it. This is especially evident where the role of the human becomes so depleted of specialized skills as to move them into the category of unskilled worker.
The key to surviving the silicon takeover, at least for now, will be to avoid jobs which fall into the first category and take sanctuary in jobs which fall into the second category. But you may ask yourself, “As computers become more intelligent won’t more and more jobs fall into the second category?” Well, yes, but it may not be as simple as dividing jobs into ones in which computers are better and jobs at which humans are better. Let’s look at an example that isn’t about jobs but has been one of the most often cited examples of human intelligence vs. machine intelligence: the game of chess.
For years, computers have been rather good at playing chess. They can assess the many possible moves with lightning speed, can remember countless tricks, traps, and gambits along with many historic games played by the very best chess champions in the world. Since the 1970’s almost any chess software program could defeat all but the best chess players in the world. By 1997 the IBM computer Deep Blue beat Gary Kasparov, the world chess champion. Since then computers have left human players in the dust.
It might seem that in the game of chess, and perhaps in the job market, humans will never be able to compete with these super intelligent monsters which never sleep and make few demands. But the story took an interesting turn a few years ago when a new form of chess tournament emerged: freestyle chess. Freestyle chess is a tournament between humans who are allowed “to make use of any technical or human support for selecting their moves.” It turns out that while no single human player can defeat even a mediocre chess program, a person assisted by a computer program used to evaluate options and assist in making decisions can beat even the best of chess playing computers. An even more astounding result came out of a freestyle tournament in 2005. In “The Chess Master and the Computer” Gary Kasparov describes what happened:

Human strategic guidance combined with the tactical acuity of a computer was overwhelming. The surprise came at the conclusion of the event. The winner was revealed to be not a grandmaster with a state-of-the-art PC but a pair of amateur American chess players using three computers at the same time. Their skill at manipulating and “coaching” their computers to look very deeply into positions effectively counteracted the superior chess understanding of their grandmaster opponents and the greater computational power of other participants.

By complementing each other’s strengths, the humans and computers formed the ultimate team, unbeatable even by the best of the best from either side alone.
The future is both inevitable and very clear. In at least some fields, the only way to survive the continuing migration of jobs from human worker to automated machine is to form an alliance. The machines will continue to improve in speed, efficiency, and intelligence. But the ultimate team will the team that best utilizes the strengths of both machine and human. By leveraging the machine’s capacity for processing immense amounts of data, analyzing and choosing the best options from millions of possibilities, yet guided by well-trained humans with experience in their domain of expertise, they will leave everyone else . . .in the dust.

Man vs. Machine – The Struggle for Superiority in the Past, Present, and Future

In an earlier post I mentioned that we all like to think that there is something superior about humans. We don’t just think we are superior, but believe that we humans have some quintessential element that machines do not, that they can never possess. We write books about it, we make movies about it. We even write songs celebrating it. One such song features the American folk legend John Henry.

John Henry
John Henry

John Henry was a steel-driver. His job was to hammer holes into rock that were used to place explosives to clear away the rock to build tunnels. When the new steam powered hammer threatened to replace men such as John Henry, he fought back. He was sure he could work faster and better than the new machine. This culminated in a face off in 1870. At the site of a new tunnel in West Virginia known as Big Bend, John Henry and the steam powered hammer spent almost two days demonstrating their ability. John Henry worked without rest and in the end he succeeded at besting the machine. This victory was at the expense of his life. He died, either immediately or shortly thereafter, by some accounts because his heart gave out after the prolonged effort to beat his nemesis. Regardless of the details or even of the accuracy of the accounts, the message is obvious: machines possess certain advantages over humans. They can work without breaks, they don’t get tired, they don’t sleep. They work “like a machine”.

Technology has been a threat to labor ever since the industrial revolution. Over the past century we have seen great strides in automating tasks formerly carried out by humans. These advances and the increases in productivity that come with it have become even more pronounced with the standardization and formalization of processes used in many industries. What were formerly considered skilled artisans and laborers were decomposed into specific tasks which were easily teachable to an unskilled person. No doubt the most well-known instance of this was Henry Ford’s creation of the assembly line for the efficient production of the motor car. By decomposing the building of an automobile into discrete tasks he was able to define specific skills required at each step of the process. No longer did the manufacture of the automobile require a team of people with many skills acquired over many years. He could hire anyone off the street and with a minimal amount of training make them a productive worker on the assembly line. This was the dawn of mass production.

In the second half of the twentieth century our ability to optimize our efficiency through the use of more advanced tools and machinery accelerated and towards the end of the century we began to see machines take over many jobs completely. By the turn of the century, automobile assembly lines became almost completely automated. Advanced robots became capable of moving quickly through warehouses and picking inventory for shipment. This was the first time we got a real glimpse of the future – of the future of the worker. Whereas John Henry was being replaced by a machine which still had to be in the hands of a human being, this new generation of machines could operate autonomously. While machines still rely on humans for supervision and maintenance, they are taking on more and more responsibility. They are requiring less supervision and taking on more difficult tasks.

In the next twenty-five years we will see a rapid increase in both the capabilities and responsibilities of machines. Every year that goes by we trust the capabilities of machines more and this gives rise to giving them more responsibility. We have seen cars which are capable of driving themselves even though we aren’t ready to trust them enough to give up our driver’s seat to them just yet. We have seen drones used first in military applications and now it seems they are ready to enter the business world as delivery drones. The advances in technology during the twentieth century which replaced the jobs of humans were characterized by electro-mechanical advances and to some extent the electronics which control them. In this century the machines seeing the most rapid advances are the intelligent machines. The physical capabilities of machines are still advancing but the real magic is the ability of these machines to do the things we have always thought only a human was smart enough to do. The next generation of computers, robots, and machines will be superior to humans not just physically but in their ability to process enormous amounts of information, solve complex problems, and react more quickly than their human predecessors.

Where does this leave us, the primitive human? Will we be relegated to cleaning up after our mechanical successors? Will the world degenerate into the final chapter of The Terminator? The list of sci-fi movies about this type of struggle is a long one. Is this life imitating art? Perhaps the real fiction is that in the movies the humans always win.

How the Acceleration of Technology Will Allow Computers to Take Over the World

This idea that computers will advance at a rate which will allow them to surpass the capabilities of humans is not a new one. One of the thought leaders in this area, Ray Kurzweil, has long been a champion, if not the originator, of the notion that technological advances increase at an exponential rate. This is not simply an observation that technology is advancing faster and faster, but that because of the nature of the advances, the improvements delivered by technology build on one another. Kurzweil has laid out in detail what he calls the law of accelerating returns (LOAR) in his first three books, most notably The Singularity is Near. He explains that the hierarchical nature of technology is what enables this exponential growth. The evolution of technology occurs in increasing levels of abstraction resulting in exponential complexity and as a result capability. A set of technological advancements is built upon to form a new and more complex innovation with far more impact than the individual components themselves have. Consider the evolution of electronics as an example. Just as we were completing development of the world’s first modern computer, the ENIAC, three physicists at Bell Labs were inventing the transistor, the fundamental component of all modern day electronics. The transistor allowed us to build electronics such as radios, calculators, and computers at a fraction of the size and cost of the same devices formerly built using vacuum tubes. Two years later, the integrated circuit was invented, putting five transistors on a single chip. Fifty years on the IC or microchip technology had advanced to the point where we could put millions of transistors and other electronic components on a chip the size of a fingernail. Within the space of fifty years we went from building computers with tubes and wires which took up an entire room and could only perform relatively simple calculations to machines small enough to carry around with us every day and could outperform even the most powerful computers of the twentieth century.

In their book The Second Machine Age Erik Brynjolfsson and Andrew McAfee discuss many of these same issues primarily from a socio-economic perspective, stating “Rapid and accelerating digitization is likely to bring economic rather than environmental disruption, stemming from the fact that as computers get more powerful, companies have less need for some kinds of workers.” This is not a case where we gradually lose ground to automation, the advances in machines are accelerating and have been ever since the introduction of the transistor. The impact was initially not evident and has been underestimated for some time, but just as the industrial revolution enabled vastly increased productivity within a few decades this second revolution will enable increased productivity in a different way. The industrial revolution addressed physical limitations of humans such as speed, strength, and consistency. This current advance in technology will address the non-physical, the power of the human mind. Computers can already do more than the human mind in very many areas such as processing large amounts of data and performing lengthy calculations. We are now starting to see the use of computers to predict our wants and needs when we visit a website or to tell us the fastest way to drive to the mall. We carry devices which tell us if we are getting enough exercise or eating too much. This next generation of computing devices will benefit us greatly, assuming much of the burden of everyday life and doing a better job. But the benefit will not come without sacrifice. The emergence of assembly lines allowed for faster and cheaper production but at the cost of the extinction of certain jobs. In the same way, many of the tasks which we rely on humans for will be performed faster, better, and cheaper by our silicon assistants. Just how far will this wave of succession extend? Will we ultimately find ourselves at the mercy of a society of robots, relying on them for every one of our needs to survive? The story has been the subject of countless science fiction such as “I, Robot” and “The Matrix”. Much of the future is still unknown, we haven’t lost control just yet. But the shape of things to come is evident and undeniable. As Brynjolfsson and McAfee summarize, “In short, we’re at an inflection point— a point where the curve starts to bend a lot— because of computers. We are entering a second machine age.”

Welcome to Computers Can Do Anything

We all like to think that there is something superior about humans. We don’t just think we are better, but that we possess some quintessential element that machines do not. The basic premise of this site is that computers can do anything you can do and do it better. There are many examples of things that computers do not do well today. There are even some things that computers can not do at all. Each year we see improvements in the capabilities of our silicon friends. And each year machines, computers, and other electronic devices take on more and more of our everyday tasks, from balancing our checkbook, to flying our planes. And although believe that there are some things that a machine will never be able to do, there is no limit to the capabilities of the thinking machine. In fact, there will come a time when machines will be superior to us in every way.