OpenAI’s advanced AI system Q* raises safety concerns

OpenAI, the company behind ChatGPT, was reportedly working on a groundbreaking system, codenamed Q*, before the temporary dismissal of CEO Sam Altman, according to a recent report by The Guardian. This advanced AI model demonstrated the ability to solve unfamiliar basic math problems, marking a significant leap in AI capabilities.

The rapid development of Q* raised safety concerns among OpenAI researchers, leading to a warning to the board of directors about its potential threat to humanity. This alarm was part of the backdrop to the recent turmoil at OpenAI, which saw Altman briefly ousted and then reinstated following staff and investor pressure.

OpenAI’s Q* and the race toward AGI

The development of Q* feeds into the broader debate about the pace of progress toward Artificial General Intelligence. AGI represents a system capable of performing a wide range of tasks at or above human intelligence levels, potentially beyond human control. OpenAI is at the forefront of this race, sparking concerns among experts about the implications of such rapid advancements.

Andrew Rogoyski from the University of Surrey’s Institute for People-Centred AI commented on the significance of a math-solving LLM. He noted that this intrinsic ability of LLMs to perform analytical tasks represents a major advancement in the field.

OpenAI’s mission and governance

OpenAI, initially founded as a nonprofit, operates with a commercial subsidiary governed by a board. Microsoft stands as its largest investor. The organization’s mission is to develop “safe and beneficial artificial general intelligence for the benefit of humanity.” Recent governance changes at OpenAI reflect this commitment to safety and responsible AI development.

The future of AI safety

The controversy surrounding Altman’s temporary removal highlighted the tension between rapid AI development and safety. Emmett Shear, Altman’s brief successor, clarified that the board’s decision was not due to a specific disagreement over safety. However, the incident underscores the challenges and responsibilities facing AI developers in balancing innovation with ethical considerations and human safety.

Featured image from Sanket Mishra via Pexels

Maxwell William

Maxwell William, a seasoned crypto journalist and content strategist, has notably contributed to industry-leading platforms such as Cointelegraph, OKX Insights, and Decrypt, weaving complex crypto narratives into insightful articles that resonate with a broad readership.