What Is an Open Source AI Model?
An open source AI model is an artificial intelligence system that anyone can use, study, modify and share. Under the Open Source Initiative definition published in 2024, a fully open system releases three components: the model's weights, the code used to train it, and detailed information about its training data, all under open licenses. The model can be run for any purpose without asking permission from its creator.
Hardware Needed to Run Open Source AI Models
Running an open source AI model depends on local processing power, memory and storage. Models run on the processor, use system RAM to hold data during operation, and read model files from storage. Larger models need more memory and more cores. The Thinvent range has systems with 12th-generation Intel Core processors with 6 to 12 cores, 8 GB to 32 GB of DDR4 RAM, and 256 GB to 1 TB of SSD storage. The Thinvent range also includes AMD Ryzen 5 7430U and Intel Core 5 120U options.
Comparison of Thinvent Systems for AI Workloads
| Product | Processor | Cores | Max Frequency | Cache | RAM | Storage |
|---|---|---|---|---|---|---|
| IPC5 (i5-1240P) | Intel Core i5-1240P | 12 | 4.4 GHz | 12 MB | 16 GB | 512 GB SSD |
| IPC5 (i7-1255U, Dual LAN) | Intel Core i7-1255U | 10 | 4.7 GHz | 12 MB | 16 GB | 512 GB SSD |
| IPC5 (i7-1255U, Dual LAN) | Intel Core i7-1255U | 10 | 4.7 GHz | 12 MB | 32 GB | 1 TB SSD |
| IPC5 (i5-1240P) | Intel Core i5-1240P | 12 | 4.4 GHz | 12 MB | 32 GB | 1 TB SSD |
| Aero Mini PC | Intel Core i3-1215U | 6 | 4.4 GHz | 10 MB | 8 GB | 256 GB SSD |
| Aero Mini PC | Intel Core 5 120U | 10 | 5.0 GHz | 12 MB | 16 GB | 512 GB SSD |
| Treo Mini PC | AMD Ryzen 5 7430U | 6 | 4.3 GHz | 16 MB | 16 GB | 512 GB SSD |
| Treo Mini PC | Intel N5095A | 4 | 2.9 GHz | 4 MB | 4 GB | 128 GB SSD |
Choosing a Thinvent System
For larger open source models, the IPC5 with 32 GB of RAM and 1 TB of SSD storage has the most memory in the range. For lighter workloads, the Aero Mini PC with 16 GB of RAM or the Treo Mini PC with the AMD Ryzen 5 7430U has a compact option. The Micro 5R Thin Client uses an ARM Cortex A53 processor with 2 GB of RAM and 16 GB of eMMC storage, which suits basic tasks rather than large models.
Thinvent Products for Open Source AI
Thinvent has industrial PCs, mini PCs, and thin clients with processors from Intel and AMD for running open source AI software. The IPC5 with Intel Core i5-1240P and 32 GB of RAM, the IPC5 with Intel Core i7-1255U and 32 GB of RAM, and the Aero Mini PC with Intel Core 5 120U are suitable choices for AI development and inference workloads.
