OpenAI team to focus on democratic processes for artificial intelligence software

Published January 16,2024

Subscribe

Artificial intelligence lab OpenAI is forming a brand new workforce to create democratic processes to form how its AI software program needs to be ruled to deal with bias and different elements, the Microsoft-backed firm mentioned in a weblog submit on Tuesday.

The “Collective Alignment” workforce is a continuation of the work of a grant program for funding democratic course of experiments that was introduced in May 2023, the San Francisco-based agency mentioned. The program wrapped up lately.

“As we continue to pursue our mission towards superintelligent models who potentially could be seen as integral parts of our society … it’s important to give people the opportunity to provide input directly,” Tyna Eloundou, a analysis engineer and founding member of OpenAI’s new workforce, advised Reuters.

To guarantee, for instance, that solely people can vote, OpenAI may companion with Worldcoin, a cryptocurrency challenge based by OpenAI CEO Sam Altman that gives a method to inform the distinction between people and AI bots, mentioned Teddy Lee, a product supervisor who’s the opposite member of the two-person workforce.

Lee famous that the workforce has not made any concrete plans but to combine Worldcoin.

Since OpenAI’s late 2022 launch of ChatGPT, generative AI expertise that may spin uncannily authoritative prose from textual content prompts has captivated the general public, making this system one of many quickest rising apps of all time.

There are, nonetheless, issues about AI’s potential to create “deepfake” photos and different misinformation, particularly because the 2024 U.S. election marketing campaign ramps up. Critics say AI methods like ChatGPT have inherent bias as a result of inputs used to form their views, and customers have discovered examples of racist or sexist outputs from AI software program.

The new OpenAI workforce is actively trying to rent a analysis engineer and analysis scientist, Eloundou mentioned. The workforce will work carefully with OpenAI’s “Human Data” workforce, which builds infrastructure for amassing human enter on the corporate’s AI fashions, and different analysis groups.