OpenAI CEO Sam Alt Altman revealed that the company is facing a shortage of Graphics Processing Units (GPUs), which has forced them to stagger the rollout of their latest model, GPT-4.5. This new model is described as "giant" and "expensive," requiring tens of thousands of additional GPUs to support its capabilities.
The shortage has led to a phased release of GPT-4.5, with subscribers to ChatGPT Pro getting access first, followed by ChatGPT Plus customers the next week. Altman acknowledged that this isn't the ideal way to operate, but the company is struggling to keep up with growth surges that lead to GPU shortages.
The new model comes with a hefty price tag, with OpenAI charging $75 per million tokens (~750,000 words) fed into the model and $150 per million tokens generated by the model. This is significantly more expensive than their previous model, GPT-4.
