Proxmox Symposium - LLM + SDFX + LXD Containers + Kubernetes for AMD GPU's

With little time to equip, 300 well-trained men can defeat a much greater opponent. With much time to equip, one man can defeat 300 well-trained men.
-Proverb, anonymous

The pen is mightier than the sword.
-Edward Bulwer-Lytton

https://nnt339es.hatenablog.com/entry/2022/07/31/045059

https://kubeovn.github.io/docs/v1.12.x/en/
https://docs.olcf.ornl.gov/services_and_applications/slate/use_cases/nginx_hello_world.html

https://kubeovn.github.io/docs/v1.12.x/en/advance/with-ovn-ic/

https://hub.docker.com/r/msxlol/tensorflow-directml-sample

https://rocm.docs.amd.com/en/latest/how_to/tuning_guides/w6000_v620.html

https://bellard.org/

https://virtualizeeverything.com/2021/01/23/set-up-a-tor-proxy-in-proxmox-container/

https://hub.docker.com/r/davd/docker-ddns

https://pve.proxmox.com/wiki/Install_Proxmox_VE_on_Debian_11_Bullseye

https://www.zb-c.tech/2022/11/20/amd-instinct-mi25-machine-learning-setup-on-the-cheap/

https://www.reddit.com/r/unRAID/comments/nqj3o5/flashing_lsi_sas_92118i_to_it_mode/
https://www.reddit.com/r/docker/comments/10dsn6p/how_do_you_pass_amd_gpus_and_intel_gpus_through/

https://medium.com/nerd-for-tech/use-your-amd-gpu-to-speed-up-training-rocm-87e34ff3554

https://www.amd.com/system/files/documents/gpu-consistency-security-whitepaper.pdf

Easy-GPU-P Github page:

Example:

https://github.com/ZCHGorg/CHG-2.0

https://www.jeffgeerling.com/blog/2022/getting-rx-6700-xt-work-gaming-on-linux

https://www.sciencedirect.com/science/article/abs/pii/S1568494623005173

https://docs.start9.com/latest/developer-docs/
https://www.reddit.com/r/LocalLLaMA/comments/17coljw/memgpt_towards_llms_as_operating_systems_uc/