Amazon will offer human benchmarking teams to test AI models

Amazon wants users to evaluate AI models better and encourage more humans to be involved in the process.

During the AWS re: Invent conference, AWS vice president of database, analytics, and machine learning Swami Sivasubramanian announced Model Evaluation on Bedrock, now available on preview, for models found in its repository Amazon Bedrock. Without a way to transparently test models, developers may end up using ones that are not accurate enough for a question-and-answer project or one that …

ai models amazon analytics aws bedrock benchmarking berger conference database evaluation found human humans machine machine learning noah president process swami sivasubramanian teams test vice president will