Results 1 to 5 of 5

Thread: A Breakthrough for A.I. Technology: Passing an 8th-Grade Science Test

  1. #1
    Sage
    JacksinPA's Avatar
    Join Date
    Dec 2017
    Last Seen
    Yesterday @ 08:56 PM
    Gender
    Lean
    Progressive
    Posts
    9,024

    A Breakthrough for A.I. Technology: Passing an 8th-Grade Science Test

    A Breakthrough for A.I. Technology: Passing an 8th-Grade Science Test - The New York Times

    SAN FRANCISCO — Four years ago, more than 700 computer scientists competed in a contest to build artificial intelligence that could pass an eighth-grade science test. There was $80,000 in prize money on the line.

    They all flunked. Even the most sophisticated system couldn’t do better than 60 percent on the test. A.I. couldn’t match the language and logic skills that students are expected to have when they enter high school.
    ================================================== ===============
    But this past week the Allen Institute for Artificial Intelligence in Seattle unveiled a new system that passed the test with room to spare. 'It correctly answered more than 90 percent of the questions on an eighth-grade science test and more than 80 percent on a 12th-grade exam.'

    Time to get your resumes up to date. But don't forget to leave the original on the copier platen for your boss to discover.
    'Make America great' - Benito Mussolini, Fascist Dictator, 1927 newsreel clip: https://www.youtube.com/watch?v=c5l_r8MG5II

  2. #2
    Sage

    Join Date
    Jun 2016
    Last Seen
    Today @ 07:14 AM
    Lean
    Undisclosed
    Posts
    5,019

    Re: A Breakthrough for A.I. Technology: Passing an 8th-Grade Science Test

    Quote Originally Posted by JacksinPA View Post
    A Breakthrough for A.I. Technology: Passing an 8th-Grade Science Test - The New York Times

    SAN FRANCISCO — Four years ago, more than 700 computer scientists competed in a contest to build artificial intelligence that could pass an eighth-grade science test. There was $80,000 in prize money on the line.

    They all flunked. Even the most sophisticated system couldn’t do better than 60 percent on the test. A.I. couldn’t match the language and logic skills that students are expected to have when they enter high school.
    ================================================== ===============
    But this past week the Allen Institute for Artificial Intelligence in Seattle unveiled a new system that passed the test with room to spare. 'It correctly answered more than 90 percent of the questions on an eighth-grade science test and more than 80 percent on a 12th-grade exam.'

    Time to get your resumes up to date. But don't forget to leave the original on the copier platen for your boss to discover.


    That's because they reprogrammed the AI for the test, not the knowledge base, and assured the test was "no child left behind" based. Try the AI on a test from 1970.

  3. #3
    Outer space potato man

    Join Date
    Feb 2010
    Last Seen
    Yesterday @ 10:51 PM
    Gender
    Lean
    Undisclosed
    Posts
    63,887

    Re: A Breakthrough for A.I. Technology: Passing an 8th-Grade Science Test

    Eh, neural networks come up with some pretty bizarre solutions that often are basically cheating. It's neat that a computer figures out how to cheat, but it's cheating nonetheless. Some examples:


    -Machine learning used to try and learn how to land a plane with minimal impact force. Computer figured out that extreme crashes had an integer rollover bug causing crash force to register as negative and resolve as a perfect score. Result: Computer crashes airplane as hard as it can over and over again.
    -AI learning to diagnose skin cancer by being fed numerous images of skin blemishes figures out the best predictor of skin cancer is the doctor placing a ruler in the photo.
    -AI playing a strategy game learns to intentionally crash the game to avoid losses
    -Simplistic evolution simulator AI creates a species that does nothing but stay sedentary and mate over and over and then eat its own offspring. (simulation programmed no energy cost for procreation, so this was generating free energy)
    “personal attorney” to Individual-1, who at that point had become the President of the United States
    Quote Originally Posted by apdst View Post
    I don't know who [Individual-1] is and neither do you.

  4. #4
    Professor
    Join Date
    Aug 2019
    Last Seen
    Yesterday @ 11:33 PM
    Lean
    Undisclosed
    Posts
    1,338

    Re: A Breakthrough for A.I. Technology: Passing an 8th-Grade Science Test

    Quote Originally Posted by JacksinPA View Post
    A Breakthrough for A.I. Technology: Passing an 8th-Grade Science Test - The New York Times

    SAN FRANCISCO — Four years ago, more than 700 computer scientists competed in a contest to build artificial intelligence that could pass an eighth-grade science test. There was $80,000 in prize money on the line.

    They all flunked. Even the most sophisticated system couldn’t do better than 60 percent on the test. A.I. couldn’t match the language and logic skills that students are expected to have when they enter high school.
    ================================================== ===============
    But this past week the Allen Institute for Artificial Intelligence in Seattle unveiled a new system that passed the test with room to spare. 'It correctly answered more than 90 percent of the questions on an eighth-grade science test and more than 80 percent on a 12th-grade exam.'

    Time to get your resumes up to date. But don't forget to leave the original on the copier platen for your boss to discover.
    So our high schools are failing our computers as well as our students?

  5. #5
    Sage
    Lord Tammerlain's Avatar
    Join Date
    Jan 2010
    Last Seen
    Yesterday @ 08:55 PM
    Lean
    Undisclosed
    Posts
    15,611

    Re: A Breakthrough for A.I. Technology: Passing an 8th-Grade Science Test

    Quote Originally Posted by Deuce View Post
    Eh, neural networks come up with some pretty bizarre solutions that often are basically cheating. It's neat that a computer figures out how to cheat, but it's cheating nonetheless. Some examples:


    -Machine learning used to try and learn how to land a plane with minimal impact force. Computer figured out that extreme crashes had an integer rollover bug causing crash force to register as negative and resolve as a perfect score. Result: Computer crashes airplane as hard as it can over and over again.
    -AI learning to diagnose skin cancer by being fed numerous images of skin blemishes figures out the best predictor of skin cancer is the doctor placing a ruler in the photo.
    -AI playing a strategy game learns to intentionally crash the game to avoid losses
    -Simplistic evolution simulator AI creates a species that does nothing but stay sedentary and mate over and over and then eat its own offspring. (simulation programmed no energy cost for procreation, so this was generating free energy)
    All a function of poor programming decisions

    From "rule sets" that allow for the "cheating" or being fed data that was biased.
    Ignorance is Bliss, You seem very happy today

    Free Scotland

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •