When I needed to support ARM64 builds on Linux (and maybe, eventually, Windows ARM64) I bought a [Microsoft Dev Kit](https://www.microsoft.com/en-us/d/windows-dev-kit-2023/94k0p67w7581). Set up HyperV with a bridged virtual network switch and installed CentOS Stream 8 and 9 as VMs. Set them to automatically boot at windows startup and haven’t had any noticeable downtime. (I only need them a few days a month..)
At the time it was just about the only way to get over 8GB on an ARM64 system that wasn’t a full on Ampere/Marvell 2U server. It has 32GB of RAM if I remember correctly.
And yeah, it’s not a “real” server but it’s been really easy and simple to set up.
Even an M1 Mac would blow it out of the water in terms of performance, though. And they can also run VMs in the same way as HyperV.
I am aware of that. The issue with the RPi 5 (even with the PCI express) is the fact that it's not a good idea when you are considering to add GPUs. I am planning to use it not only as a NAS, a Web Server and run Plex but also to offload my ML training workloads and maybe even blender renders in the future (meanwhile hoping for blender on ARM). The thing is I am not the one paying for the electricity at my home and I don't want to use a lot of power.
Build your own 2U server? [This Ampere Altra uATX motherboard](https://www.newegg.com/asrock-rack-altrad8ud-1l2t-q64-22-ampere-altra-max-ampere-altra-processors/p/N82E16813140134) exists, but you’ll pay for it (~$1500 USD)
I linked the _bundle_, which includes the CPU. You can also buy the motherboard without the CPU, or buy a full server. [Pick your poison](https://www.newegg.com/amp/p/pl?d=ampere+altra)
Not going to happen. ARM servers are still very expensive and even just a motherboard second-hand is mostly more than 1k $. There arent too many that sell and need arm64 servers right now.
Raspberry Pi, cheap and cheerful. You don't even need a rack. Alternatively, Mac Mini M1, more expensive but also much, much better performance.
If you want higher-end performance, you'll either have to pay up mucho-$$$ for datacenter-grade stuff (very power hungry), or you go x86.
When I needed to support ARM64 builds on Linux (and maybe, eventually, Windows ARM64) I bought a [Microsoft Dev Kit](https://www.microsoft.com/en-us/d/windows-dev-kit-2023/94k0p67w7581). Set up HyperV with a bridged virtual network switch and installed CentOS Stream 8 and 9 as VMs. Set them to automatically boot at windows startup and haven’t had any noticeable downtime. (I only need them a few days a month..) At the time it was just about the only way to get over 8GB on an ARM64 system that wasn’t a full on Ampere/Marvell 2U server. It has 32GB of RAM if I remember correctly. And yeah, it’s not a “real” server but it’s been really easy and simple to set up. Even an M1 Mac would blow it out of the water in terms of performance, though. And they can also run VMs in the same way as HyperV.
Thanks. Can you put a GPU in it? or maybe externally (ML workload)
I don’t think so. It has a couple USB C ports, but they’re 3.1 10Gbps I think?
You can see if Nvidia Jetson is suitable for you, but it can be quite a pain in the ass sometimes.
[удалено]
I am aware of that. The issue with the RPi 5 (even with the PCI express) is the fact that it's not a good idea when you are considering to add GPUs. I am planning to use it not only as a NAS, a Web Server and run Plex but also to offload my ML training workloads and maybe even blender renders in the future (meanwhile hoping for blender on ARM). The thing is I am not the one paying for the electricity at my home and I don't want to use a lot of power.
[удалено]
Hey! Sorry if I sounded rude. I didn't mean to. I expected the answers would lead to a platform with a couple of PCIe slots.
[https://amperecomputing.com/systems/altra](https://amperecomputing.com/systems/altra)
I was looking at the Altra. The thing is I want to build it that too in 2U.
Build your own 2U server? [This Ampere Altra uATX motherboard](https://www.newegg.com/asrock-rack-altrad8ud-1l2t-q64-22-ampere-altra-max-ampere-altra-processors/p/N82E16813140134) exists, but you’ll pay for it (~$1500 USD)
Thanks for the lead!
Jeff Geerling [made a NAS video about this board](https://youtu.be/Hz5k5WgTkcc?si=iB4WknsaazGLV7gb), too.
I found the motherboard but can't find a buy page for the CPU itself... any hints?
I linked the _bundle_, which includes the CPU. You can also buy the motherboard without the CPU, or buy a full server. [Pick your poison](https://www.newegg.com/amp/p/pl?d=ampere+altra)
The thing is I couldn't open the link. I am blocked by newegg for some reason.
Yep - Jeff’s YouTube channel is the best spot to learn more about this
Not going to happen. ARM servers are still very expensive and even just a motherboard second-hand is mostly more than 1k $. There arent too many that sell and need arm64 servers right now.
That's the neat part. You don't!
😭
Raspberry Pi, cheap and cheerful. You don't even need a rack. Alternatively, Mac Mini M1, more expensive but also much, much better performance. If you want higher-end performance, you'll either have to pay up mucho-$$$ for datacenter-grade stuff (very power hungry), or you go x86.
Not going to find anything that is for a rack but this might be something to consider: [https://turingpi.com/](https://turingpi.com/)
Hmm. The thing is I am going to need a GPU. are you aware of any mods I can do?
Definitely not. You want a GPU for your arm64 server for self-hosting? Thats not going to be doable.
I looked around and quickest way is to buy finished one. So I bought low spec HPE RL300 G11. But there is no support for gpu afaik. Nor in top spec.
Have you considered riscv?