Software Engineer Runs Generative AI on 20-Year-Old PowerBook G4
In a blog post this week, software engineer Andrew Rossignol (my brother!) detailed how he managed to run generative AI on an old PowerBook G4.
While hardware requirements for large language models (LLMs) are typically high, this particular PowerBook G4 model from 2005 is equipped with a mere 1.5GHz PowerPC G4 processor and 1GB of RAM. Despite this 20-year-old hardware, my brother was able to achieve inference with Meta's LLM model Llama 2 on the laptop.
The experiment involved porting the open-source llama2.c project, and then accelerating performance with a PowerPC vector extension called AltiVec.
His full blog post offers more technical details about the project.
Similar examples of generative AI models running on the PlayStation 3, Xbox 360, and other old devices have surfaced in the news from time to time.
Popular Stories
Apple is developing an all-new operating system that is essentially a mix of tvOS, watchOS, and iOS, according to Bloomberg's Mark Gurman.
In a report this week, he said the operating system will feature a grid of icons, widgets, and apps, along with customizable clock faces.
The new software platform is intended for Apple's long-rumored smart home hub. With built-in facial recognition,...
Apple this year acquired Israeli startup Q.ai for close to $2 billion, according to the Financial Times. That would make this Apple's second-biggest acquisition ever, after it paid $3 billion for the popular headphone maker Beats in 2014.
This is also the largest known Apple acquisition since the company purchased Intel's smartphone modem business and patents for $1 billion in 2019.
Q.ai...
We're less than two months out from the launch of Apple's premium next-generation smartphone lineup, and while we're not expecting a dramatic change in terms of functionality, there are still several enhancements rumored to be coming to the iPhone 18 Pro and iPhone 18 Pro Max.
One thing worth noting is that Apple is reportedly planning a major change to its iPhone release cycle this year,...
