Buyer beware: Avoid immature AI solutions

Given the sensitivity of the data state and local governments handle, procurement officers must educate themselves on the fundamentals of artificial intelligence and use caution when considering AI services.

Training procurement officials on emerging information technologies such as artificial intelligence may be necessary to ensure they get the best options for their agencies, experts say. But there’s no rush.

“What we’re talking about is something that we don’t know that much about yet, and when you consider what the state agencies are tasked with, which is handling sensitive information, health information, school information, personal identifying information, financial information, I think it’s only responsible to be cautious,” said Rebecca Montano-Smith, deputy chief learning officer at the National Association of State Procurement Officers (NASPO), which offers educational opportunities.

In fact, the White House May 4 issued actions to promote responsible AI, including calling on tech companies to make sure their products mitigate risk to people’s rights and safety when they are deployed.

State and local officials need to take time to understand several factors before procuring AI, agreed Kevin Desouza, professor of business, technology and strategy at the Queensland, Australia, University of Technology and nonresident senior fellow at the Brookings Institution.

“Procuring AI systems is not the same as your traditional (vanilla) information systems,” Desouza wrote in an email to GCN. “Procurement officers need to know 1) how AI systems are different (more complex) that traditional systems, 2) understand the risk/opportunity tradeoffs, and 3) understand the long-term costs required to keep updating the systems (so that they continue to learn) and maintaining them (so that they perform at desired levels).”

Training is one way to tackle those requirements. Regardless of what procurement officers are buying, they must educate themselves on the product or service and its market so that they know what suppliers exist, where supply-chain issues are and what risks come with certain contracts or products, said Matthew Oyer, chief learning officer at NASPO.

For AI specifically, NASPO is dipping its toes into training. It added a lesson on the potential uses of ChatGPT to an IT procurement certificate program it recently wrapped up with Arizona State University, and it might add an online course about AI.

Oyer likened NASPO’s approach to AI to its handling of blockchain a few years ago. “It was a similar conversation of, ‘Hey, we don’t really know what this is. We’re hearing it could impact state government, it can impact procurement,’” he said. “Our response was similar to what we are doing with AI,” he said. The association found experts to speak to its members about the basics of the technology, common vocabulary and any examples of blockchain’s use in government procurement.

Planning is another crucial aspect of AI procurement, Desouza added. A 2022 report he coauthored studied federal spending on AI, but a big takeaway from that was the need for a coordinated strategy for AI initiatives.

Leave a comment

Your email address will not be published. Required fields are marked *