Dr. Donald Kinghorn | Puget Systems https://www.pugetsystems.com/bios/donkinghorn/ Workstations for creators. Mon, 17 Jun 2024 22:23:32 +0000 en-US hourly 1 https://wordpress.org/?v=6.5.5 https://www.pugetsystems.com/wp-content/uploads/2022/08/Puget-Systems-2020-logomark-color-500-48x48.png Dr. Donald Kinghorn | Puget Systems https://www.pugetsystems.com/bios/donkinghorn/ 32 32 AMD Zen4 Threadripper PRO vs Intel Xeon-w9 For Science and Engineering https://www.pugetsystems.com/labs/hpc/amd-zen4-threadripper-pro-vs-intel-xeon-w9-for-science-and-engineering/ https://www.pugetsystems.com/labs/hpc/amd-zen4-threadripper-pro-vs-intel-xeon-w9-for-science-and-engineering/#respond Thu, 07 Mar 2024 19:56:57 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=25940 The performance improvement with the new Zen4 TrPRO over the Zen3 TrPRO is very impressive!
My first recommendation for a Scientific and Engineering workstation CPU would now be the AMD Zen4 architecture as either Zen4 Threadripper PRO or Zen4 EPYC for multi-socket systems.

The post AMD Zen4 Threadripper PRO vs Intel Xeon-w9 For Science and Engineering appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/amd-zen4-threadripper-pro-vs-intel-xeon-w9-for-science-and-engineering/feed/ 0 LLM Server Setup Part 2 — Container Tools https://www.pugetsystems.com/labs/hpc/llm-server-setup-part-2-container-tools/ https://www.pugetsystems.com/labs/hpc/llm-server-setup-part-2-container-tools/#respond Mon, 20 Nov 2023 22:15:10 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=21032 This post is Part 2 in a series on how to configure a system for LLM deployments and development usage. Part 2 is about installing and configuring container tools, Docker and NVIDIA Enroot.

The post LLM Server Setup Part 2 — Container Tools appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/llm-server-setup-part-2-container-tools/feed/ 0 LLM Server Setup Part 1 – Base OS https://www.pugetsystems.com/labs/hpc/llm-server-setup-part-1-base-os/ https://www.pugetsystems.com/labs/hpc/llm-server-setup-part-1-base-os/#respond Wed, 15 Nov 2023 23:42:42 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=20669 This post is Part 1 in a series on how to configure a system for LLM deployments and development usage. The configuration will be suitable for multi-user deployments and also useful for smaller development systems. Part 1 is about the base Linux server setup.

The post LLM Server Setup Part 1 – Base OS appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/llm-server-setup-part-1-base-os/feed/ 0 Can You Run A State-Of-The-Art LLM On-Prem For A Reasonable Cost? https://www.pugetsystems.com/labs/hpc/can-you-run-a-state-of-the-art-llm-on-prem-for-a-reasonable-cost/ https://www.pugetsystems.com/labs/hpc/can-you-run-a-state-of-the-art-llm-on-prem-for-a-reasonable-cost/#respond Mon, 17 Jul 2023 23:44:37 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=15672 In this post address the question that's been on everyone's mind; Can you run a state-of-the-art Large Language Model on-prem? With *your* data and *your* hardware? At a reasonable cost?

The post Can You Run A State-Of-The-Art LLM On-Prem For A Reasonable Cost? appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/can-you-run-a-state-of-the-art-llm-on-prem-for-a-reasonable-cost/feed/ 0 Note: How To Setup Apache on Ubuntu 22.04 For User public_html https://www.pugetsystems.com/labs/hpc/note-how-to-setup-apache-on-ubuntu-22-04-for-user-public_html/ https://www.pugetsystems.com/labs/hpc/note-how-to-setup-apache-on-ubuntu-22-04-for-user-public_html/#respond Fri, 02 Jun 2023 15:37:23 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=14961 This is a short note on setting up the Apache web server to allow system users to create personal websites and web apps in their home directories.

The post Note: How To Setup Apache on Ubuntu 22.04 For User public_html appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/note-how-to-setup-apache-on-ubuntu-22-04-for-user-public_html/feed/ 0 GTC23  Notes And Selected Sessions https://www.pugetsystems.com/labs/hpc/gtc23-notes-and-selected-sessions/ https://www.pugetsystems.com/labs/hpc/gtc23-notes-and-selected-sessions/#respond Wed, 12 Apr 2023 15:27:46 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=14289 NVIDIA GTC 2023 was outstanding! To say that about a virtual conference tells you how much I value it. This post is largely a catalog of the talks I found interesting along with titles that I think will be interesting to a larger audience and my colleagues at Puget Systems.

The post GTC23  Notes And Selected Sessions appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/gtc23-notes-and-selected-sessions/feed/ 0 How To Use Linux Kernel Boot Options https://www.pugetsystems.com/labs/hpc/how-to-use-linux-kernel-boot-options/ https://www.pugetsystems.com/labs/hpc/how-to-use-linux-kernel-boot-options/#respond Mon, 13 Mar 2023 23:05:06 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=14011 This post is a short HowTo on passing Linux kernel boot options during OS installation and persisting them for future system starts

The post How To Use Linux Kernel Boot Options appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/how-to-use-linux-kernel-boot-options/feed/ 0 Problems With RTX4090 MultiGPU and AMD vs Intel vs RTX6000Ada or RTX3090 https://www.pugetsystems.com/labs/hpc/problems-with-rtx4090-multigpu-and-amd-vs-intel-vs-rtx6000ada-or-rtx3090/ https://www.pugetsystems.com/labs/hpc/problems-with-rtx4090-multigpu-and-amd-vs-intel-vs-rtx6000ada-or-rtx3090/#respond Wed, 15 Feb 2023 22:55:52 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=13754 I was prompted to do some testing by a commenter on one of my recent posts. They had concerns about problems with dual NVIDIA RTX4090s on AMD Threadripper Pro platforms. I ran some applications to reproduce the problems reported above and tried to dig deeper into the issues with more extensive testing. The included table below tells all!

The post Problems With RTX4090 MultiGPU and AMD vs Intel vs RTX6000Ada or RTX3090 appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/problems-with-rtx4090-multigpu-and-amd-vs-intel-vs-rtx6000ada-or-rtx3090/feed/ 0 Ryzen 7950x Zen4 AVX512 Performance With AMD AOCCv4 HPL HPCG HPL-MxP https://www.pugetsystems.com/labs/hpc/ryzen-7950x-zen4-avx512-performance-with-amd-aoccv4-hpl-hpcg-hpl-mxp/ https://www.pugetsystems.com/labs/hpc/ryzen-7950x-zen4-avx512-performance-with-amd-aoccv4-hpl-hpcg-hpl-mxp/#respond Fri, 20 Jan 2023 22:33:29 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=13309 This post is a first-look at performance of the Ryzen7 7950x CPU using the latest AMD compiler release with support for Zen4 arch including AVX512 vector instructions. Performance is tested using the HPC standard benchmarks, HPL (High Performance Linpack), HPCG (High Performance Conjugate Gradient) and the newer HPC Top500 benchmark, HPL-MxP (formerly HPL-AI).

The post Ryzen 7950x Zen4 AVX512 Performance With AMD AOCCv4 HPL HPCG HPL-MxP appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/ryzen-7950x-zen4-avx512-performance-with-amd-aoccv4-hpl-hpcg-hpl-mxp/feed/ 0 Install Golang In Your Home Directory And Configure VScode https://www.pugetsystems.com/labs/hpc/install-golang-in-your-home-directory-and-configure-vscode/ https://www.pugetsystems.com/labs/hpc/install-golang-in-your-home-directory-and-configure-vscode/#respond Mon, 09 Jan 2023 22:05:01 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=13166 Learning go (Golang) is one of my resolutions for 2023. It looks like a great cross platform compiled language with a straightforward simple syntax with modern features. I have multi-OS projects in mind where I expect it to be ideal. So, I'll get started …

The post Install Golang In Your Home Directory And Configure VScode appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/install-golang-in-your-home-directory-and-configure-vscode/feed/ 0