• This is a political forum that is non-biased/non-partisan and treats every person's position on topics equally. This debate forum is not aligned to any political party. In today's politics, many ideas are split between and even within all the political parties. Often we find ourselves agreeing on one platform but some topics break our mold. We are here to discuss them in a civil political debate. If this is your first visit to our political forums, be sure to check out the RULES. Registering for debate politics is necessary before posting. Register today to participate - it's free!

A Breakthrough for A.I. Technology: Passing an 8th-Grade Science Test

JacksinPA

JacksinPA

Supporting Member
DP Veteran
Monthly Donator
Joined
Dec 3, 2017
Messages
26,290
Reaction score
16,771
Gender
Male
Political Leaning
Progressive
A Breakthrough for A.I. Technology: Passing an 8th-Grade Science Test - The New York Times

SAN FRANCISCO — Four years ago, more than 700 computer scientists competed in a contest to build artificial intelligence that could pass an eighth-grade science test. There was $80,000 in prize money on the line.

They all flunked. Even the most sophisticated system couldn’t do better than 60 percent on the test. A.I. couldn’t match the language and logic skills that students are expected to have when they enter high school.
=================================================================
But this past week the Allen Institute for Artificial Intelligence in Seattle unveiled a new system that passed the test with room to spare. 'It correctly answered more than 90 percent of the questions on an eighth-grade science test and more than 80 percent on a 12th-grade exam.'

Time to get your resumes up to date. But don't forget to leave the original on the copier platen for your boss to discover.
 
JacksinPA said:
A Breakthrough for A.I. Technology: Passing an 8th-Grade Science Test - The New York Times

SAN FRANCISCO — Four years ago, more than 700 computer scientists competed in a contest to build artificial intelligence that could pass an eighth-grade science test. There was $80,000 in prize money on the line.

They all flunked. Even the most sophisticated system couldn’t do better than 60 percent on the test. A.I. couldn’t match the language and logic skills that students are expected to have when they enter high school.
=================================================================
But this past week the Allen Institute for Artificial Intelligence in Seattle unveiled a new system that passed the test with room to spare. 'It correctly answered more than 90 percent of the questions on an eighth-grade science test and more than 80 percent on a 12th-grade exam.'

Time to get your resumes up to date. But don't forget to leave the original on the copier platen for your boss to discover.
Click to expand...



That's because they reprogrammed the AI for the test, not the knowledge base, and assured the test was "no child left behind" based. Try the AI on a test from 1970.
 
Eh, neural networks come up with some pretty bizarre solutions that often are basically cheating. It's neat that a computer figures out how to cheat, but it's cheating nonetheless. Some examples:


-Machine learning used to try and learn how to land a plane with minimal impact force. Computer figured out that extreme crashes had an integer rollover bug causing crash force to register as negative and resolve as a perfect score. Result: Computer crashes airplane as hard as it can over and over again.
-AI learning to diagnose skin cancer by being fed numerous images of skin blemishes figures out the best predictor of skin cancer is the doctor placing a ruler in the photo.
-AI playing a strategy game learns to intentionally crash the game to avoid losses
-Simplistic evolution simulator AI creates a species that does nothing but stay sedentary and mate over and over and then eat its own offspring. (simulation programmed no energy cost for procreation, so this was generating free energy)
 
JacksinPA said:
A Breakthrough for A.I. Technology: Passing an 8th-Grade Science Test - The New York Times

SAN FRANCISCO — Four years ago, more than 700 computer scientists competed in a contest to build artificial intelligence that could pass an eighth-grade science test. There was $80,000 in prize money on the line.

They all flunked. Even the most sophisticated system couldn’t do better than 60 percent on the test. A.I. couldn’t match the language and logic skills that students are expected to have when they enter high school.
=================================================================
But this past week the Allen Institute for Artificial Intelligence in Seattle unveiled a new system that passed the test with room to spare. 'It correctly answered more than 90 percent of the questions on an eighth-grade science test and more than 80 percent on a 12th-grade exam.'

Time to get your resumes up to date. But don't forget to leave the original on the copier platen for your boss to discover.
Click to expand...

So our high schools are failing our computers as well as our students?
 
Deuce said:
Eh, neural networks come up with some pretty bizarre solutions that often are basically cheating. It's neat that a computer figures out how to cheat, but it's cheating nonetheless. Some examples:


-Machine learning used to try and learn how to land a plane with minimal impact force. Computer figured out that extreme crashes had an integer rollover bug causing crash force to register as negative and resolve as a perfect score. Result: Computer crashes airplane as hard as it can over and over again.
-AI learning to diagnose skin cancer by being fed numerous images of skin blemishes figures out the best predictor of skin cancer is the doctor placing a ruler in the photo.
-AI playing a strategy game learns to intentionally crash the game to avoid losses
-Simplistic evolution simulator AI creates a species that does nothing but stay sedentary and mate over and over and then eat its own offspring. (simulation programmed no energy cost for procreation, so this was generating free energy)
Click to expand...

All a function of poor programming decisions

From "rule sets" that allow for the "cheating" or being fed data that was biased.
 
You must log in or register to reply here.
Back
Top Bottom