BracketMaster

I have a stockpile of 22 8 GPUs servers with AMD Mi50s(see notes about Mi50s below). I've been able to get PyTorch working on these GPUs and have been able to do inference for different large language models. I originally wanted to use these GPUs to serve up LLMs, but VLLM cuda kernels don't work out of the box with the Mi50s, and Llama CPP has a bug where it only supports up to 4 AMD GPUs at once.

So TLDR, I don't want these servers sitting around and if anybody has any creative useful ideas for the servers, I'm happy to grant them SSH access to piddle around.

Mi50 Specs: - 16GB VRAM - 1TB/s VRAM BW - 25 TFLOPs

Sometime ago, I set out to create an open source GPU(currently using Clash-Haskell -> Verilog -> FPGA) that supports Linux Mesa as well as an accompanying PCI-e controller.

Needless to say, this is quite a challenging task to do in one's spare time after work. I'm wondering if there is value in such an implementation beyond doing it for the sake of doing it.

I'm an African American programmer who's been writing software since I was 7(born in the late 90s). I currently run a small company that does consulting for Machine Learning and Rust programming.

I've noticed that there doesn't seem to be many black programmers(I've only met one) where I am(U.S.), and certainly not many conservative ones.

Curious about the experience of others.

Also acknowledging ahead of time that HN isn't always the best place for certain social topics.

I'm pretty good at Rust, and Go is pretty easy - both compile to wasm or desktop native and have web/dekstop UI toolkits that have tiny memory footprints see:

1. https://www.egui.rs/ 2. https://gioui.org/

I find using slack, discord, and zoom unpleasant.

I've been toying with writing a zoom and slack replacement native for all platforms in either Rust or Go.

Should I do it?

I don't want to build it - and be the only one to use it - so I'm hoping I can get enough inspiring comments to go for it.

As a fan of Rust myself, I know that Rust offers memory safety and type safety.

Suppose there was an operating system written using as much safe Rust as possible, on top of which one only ran software written safe Rust...

How much more impervious would such an operating system be to attacks than other operating systems?

FWIW, I know that Redox exists.

And here's a ranking of common software vulnerabilities.

https://cwe.mitre.org/top25/archive/2021/2021_cwe_top25.html

Obviously, a software developer who stores passwords in plain text is just asking for trouble - even Rust can't fix that, but there are definitely issues on that list that Rust can fix like buffer overflow.