AMD THREADRIPPER PRO 3995WX
- landmeterbeuckx
- V.I.P Member
- Posts: 1616
- Joined: Tue May 01, 2012 5:19 pm
- 11
- Full Name: Lieven Beuckx
- Company Details: Studiebureau Beuckx
- Company Position Title: Owner
- Country: Belgium
- Linkedin Profile: Yes
- Has thanked: 183 times
- Been thanked: 548 times
- smacl
- Global Moderator
- Posts: 1409
- Joined: Tue Jan 25, 2011 5:12 pm
- 13
- Full Name: Shane MacLaughlin
- Company Details: Atlas Computers Ltd
- Company Position Title: Managing Director
- Country: Ireland
- Linkedin Profile: Yes
- Location: Ireland
- Has thanked: 627 times
- Been thanked: 657 times
- Contact:
Re: AMD THREADRIPPER PRO 3995WX
Not sure how much value the RTX cores provide outside of ray tracing and how well they're used outside of gaming. For GPU Compute on point clouds, maximum number of cores and lots of fast memory is where the performance comes from. Paging data from main memory to and from GPU can be comparatively slow and can be reduced with more on card memory.TommyMaddox wrote: ↑Mon Apr 12, 2021 6:54 pm Eager to see how RiScan Pro performs on the 48GB VRAM A6000 GPU. I know on our end the 1080Ti 11GB units we have perform better than the newer RTX series cards that have lower vram amounts just due to how RSP handles point display. Heavily considering getting that once prices become more justifiable.
-
- V.I.P Member
- Posts: 958
- Joined: Sun Nov 01, 2009 11:18 pm
- 14
- Full Name: Dennis Hirota
- Company Details: Sam O Hirota Inc
- Company Position Title: President
- Country: USA
- Linkedin Profile: Yes
- Location: Hawaii, USA
- Has thanked: 87 times
- Been thanked: 379 times
Re: AMD THREADRIPPER PRO 3995WX
Tommy and LievenTommyMaddox wrote: ↑Mon Apr 12, 2021 6:54 pm Eager to see how RiScan Pro performs on the 48GB VRAM A6000 GPU. I know on our end the 1080Ti 11GB units we have perform better than the newer RTX series cards that have lower vram amounts just due to how RSP handles point display. Heavily considering getting that once prices become more justifiable.
This is for you folks since I know you have VZ400i systems like us. I do not have the time to sell Riegl equipment since most people on this forum are in a different buying mode and are probably not interested in seeing Riegl information.
Riegl just released a newer version of their processing software RiScan Pro/RiSolve 2.12.1. I normally do not check the settings, but since I was speaking with the Riegl USA technical people and asking questions about multiple core CPU and GPU processing with the software, and the response that I received was the software utilization of multiple core CPU and GPU. Here are the settings pages for CPU which is normally at 8 parallel processes, in our case it is 16 threads with dual Xeon 2637 and I was surprised to see 64 parallel processes automatically defaulted for our TR Pro 3995WX.
I decided to run a quick BENCHMARK using PC162-Dual Xeon 2637 3.5GHz, 256GB RAM and TR Pro 3995WX 2.7-4.2GHz 512GB RAM processing 44 scans using our Riegl VZ400i.
PC162
REGISTER = 8m:51s
COLORIZE = 6m:07s
PC88
REGISTER = 7m:08s
COLORIZE = 4m:58s
Colorizing 44 scans with color panoramas in 5 to 6 minutes seems faster than it used to be, 100% CPU at all threads and 20-100% GPU during the compute period.
Riegl has also has a task selection wizard to automatically create 12 different features automatically, including an octree based combined point clouds at different resolutions, see below at 5mm (also 50mm, 20mm, 10mm) and video along scan positions.
It looks like no one is asking any questions about the TR Pro, so that is about the end for the presentation of new information. If there are any questions, please send them to my email, since I do not answer PM from any forum. We are continue using the TR Pro for processing and visualization applications on both W10 and Ubuntu 18.04.
You do not have the required permissions to view the files attached to this post.
- landmeterbeuckx
- V.I.P Member
- Posts: 1616
- Joined: Tue May 01, 2012 5:19 pm
- 11
- Full Name: Lieven Beuckx
- Company Details: Studiebureau Beuckx
- Company Position Title: Owner
- Country: Belgium
- Linkedin Profile: Yes
- Has thanked: 183 times
- Been thanked: 548 times
Re: AMD THREADRIPPER PRO 3995WX
Hi Dennis,
Great test. I haven't updated to 2.12.1 because i saw only 1 change in the revision list but definately will check it out.
Thanks for the detailed info.
We Riegl users know what to do with it;-)
Great test. I haven't updated to 2.12.1 because i saw only 1 change in the revision list but definately will check it out.
Thanks for the detailed info.
We Riegl users know what to do with it;-)
-
- V.I.P Member
- Posts: 205
- Joined: Mon Feb 25, 2019 4:42 am
- 5
- Full Name: Major Domo
- Company Details: VeritasVfx
- Company Position Title: ceo
- Country: Portugal
- Linkedin Profile: No
- Has thanked: 17 times
- Been thanked: 53 times
Re: AMD THREADRIPPER PRO 3995WX
Is that with SMT turned on or off?dhirota wrote: ↑Sat Apr 17, 2021 2:13 amTommy and LievenTommyMaddox wrote: ↑Mon Apr 12, 2021 6:54 pm Eager to see how RiScan Pro performs on the 48GB VRAM A6000 GPU. I know on our end the 1080Ti 11GB units we have perform better than the newer RTX series cards that have lower vram amounts just due to how RSP handles point display. Heavily considering getting that once prices become more justifiable.
This is for you folks since I know you have VZ400i systems like us. I do not have the time to sell Riegl equipment since most people on this forum are in a different buying mode and are probably not interested in seeing Riegl information.
Riegl just released a newer version of their processing software RiScan Pro/RiSolve 2.12.1. I normally do not check the settings, but since I was speaking with the Riegl USA technical people and asking questions about multiple core CPU and GPU processing with the software, and the response that I received was the software utilization of multiple core CPU and GPU. Here are the settings pages for CPU which is normally at 8 parallel processes, in our case it is 16 threads with dual Xeon 2637 and I was surprised to see 64 parallel processes automatically defaulted for our TR Pro 3995WX.
1.4-12-2021 10-47-14 AM.jpg
2.4-12-2021 10-52-21 AM.jpg
I decided to run a quick BENCHMARK using PC162-Dual Xeon 2637 3.5GHz, 256GB RAM and TR Pro 3995WX 2.7-4.2GHz 512GB RAM processing 44 scans using our Riegl VZ400i.
1.PC162-REGISTER-04-16-2021 10-02-40 AM.jpg
2.PC162-COLOR-04-16-2021 10-32-16 AM.jpg
4.PC88-REGISTER-4-16-2021 11-15-11 AM.jpg
5.PC88-COLOR-4-16-2021 11-34-08 AM.jpg
PC162
REGISTER = 8m:51s
COLORIZE = 6m:07s
PC88
REGISTER = 7m:08s
COLORIZE = 4m:58s
Colorizing 44 scans with color panoramas in 5 to 6 minutes seems faster than it used to be, 100% CPU at all threads and 20-100% GPU during the compute period.
Riegl has also has a task selection wizard to automatically create 12 different features automatically, including an octree based combined point clouds at different resolutions, see below at 5mm (also 50mm, 20mm, 10mm) and video along scan positions.
5mm-4-16-2021 2-31-49 PM.jpg
It looks like no one is asking any questions about the TR Pro, so that is about the end for the presentation of new information. If there are any questions, please send them to my email, since I do not answer PM from any forum. We are continue using the TR Pro for processing and visualization applications on both W10 and Ubuntu 18.04.
Curious to know if the RAM channels get overwhelmed by it.
-
- V.I.P Member
- Posts: 958
- Joined: Sun Nov 01, 2009 11:18 pm
- 14
- Full Name: Dennis Hirota
- Company Details: Sam O Hirota Inc
- Company Position Title: President
- Country: USA
- Linkedin Profile: Yes
- Location: Hawaii, USA
- Has thanked: 87 times
- Been thanked: 379 times
Re: AMD THREADRIPPER PRO 3995WX
Since I am not a testing organization, I will refer you to other forums which talk about Simultaneous Multi-Threading (SMT) that you asked about (As far as I know SMT was turned on). I do not know about the RAM question since only running Ubuntu for our NavVis post-processing is using more than 100GB of RAM (512GB RAM TOTAL)
Also in the discussion is:
UMA= uniform memory access, distributed mode
NUMA=non-uniform memory access, local mode
An older discussion
https://www.tweaktown.com/guides/8343/l ... index.html
A newer discussion of TR PRO + ASUS MB
https://hardforum.com/threads/disable-s ... e.2008674/
It looks like advantages on turning SMT on/off if you are using software not using the SMT or maybe gaming. The current BIOS on the ASUS MB does not look like it is easy unless I missed something.
-
- V.I.P Member
- Posts: 205
- Joined: Mon Feb 25, 2019 4:42 am
- 5
- Full Name: Major Domo
- Company Details: VeritasVfx
- Company Position Title: ceo
- Country: Portugal
- Linkedin Profile: No
- Has thanked: 17 times
- Been thanked: 53 times
Re: AMD THREADRIPPER PRO 3995WX
Thanks for your time Dennis.dhirota wrote: ↑Wed Apr 21, 2021 1:29 amSince I am not a testing organization, I will refer you to other forums which talk about Simultaneous Multi-Threading (SMT) that you asked about (As far as I know SMT was turned on). I do not know about the RAM question since only running Ubuntu for our NavVis post-processing is using more than 100GB of RAM (512GB RAM TOTAL)
Also in the discussion is:
UMA= uniform memory access, distributed mode
NUMA=non-uniform memory access, local mode
An older discussion
https://www.tweaktown.com/guides/8343/l ... index.html
A newer discussion of TR PRO + ASUS MB
https://hardforum.com/threads/disable-s ... e.2008674/
It looks like advantages on turning SMT on/off if you are using software not using the SMT or maybe gaming. The current BIOS on the ASUS MB does not look like it is easy unless I missed something.
You have done a wonderful job already with all the detailed information.
SMT/Hyperthreading is something that I've seen with an air of suspicion for a good while, the previous generation of TR unfortunately could not deal with the constant RAM reassignment for me on vast numbers of parallelled processes and despite not seeing a huge improvement of speed by keeping it off, it was a lot more stable for me.
Need to justify to myself the need for one of these to have a go at it
Thanks for such a detailed build, really like reading about the difficulties, it tells me that it's certainly not just me scratching my head as well.
-
- V.I.P Member
- Posts: 958
- Joined: Sun Nov 01, 2009 11:18 pm
- 14
- Full Name: Dennis Hirota
- Company Details: Sam O Hirota Inc
- Company Position Title: President
- Country: USA
- Linkedin Profile: Yes
- Location: Hawaii, USA
- Has thanked: 87 times
- Been thanked: 379 times
Re: AMD THREADRIPPER PRO 3995WX
Still waiting for my NVIDIA A6000 order to arrive.
I decided to see what additions to the system will improve performance. Since I had two empty slots on the ASUS Hyper M.2X16 PCIeGen4 card (I am looking for another card for my 3990X system, but difficult to obtain), I decided to see what happens in creating a RAID0 drive using two Samsung 980Pro 2TB sticks.
Listed below are some benchmarks
1. Video Disk Speed Test benchmark from BlackMagic (BM) testing the transfer from the on board workstation 72TB SAS HDD raid6 (PC88E, 8X12TB Seagate) of a 20GB E57 file to the raid0 virtual disk (PC88D, two 980Pro, 2TB M.2). Total time = 25.31 seconds. 2. BM Video Disk Speed Test benchmark for PC88C, 980Pro, 1TB, 1GB test. 3. CrystalDiskMark (CDM) for PC88C, 980Pro, 1TB, 1GB test 4. AS-SSD for PC88C, 980Pro, 1TB, 1GB test 5. BM Video Disk Speed Test benchmark for PC88D, Raid0 (2X980Pro, 2TB M.2) 4TB, 4GB test. 6. CDM for PC88D, Raid0 2X980Pro, 4TB, 4GB test. Copy from PC88C (1X980Pro) of a 20GB E57 file to the raid0 virtual disk (PC88D, two 980Pro, 2TB M.2). Total time = 10.24 seconds. 7. AS-SSD for PC88D, Raid0 (2X980Pro, 2TB M.2) 4TB, 1GB test
Since I have not tracked benchmarks recently, I do not know if these benchmarks are the significant ones to evaluate or what all these numerics mean. The significant problem is that the raid0 drivers only work for W10 so this does not help me for Ubuntu.
I decided to see what additions to the system will improve performance. Since I had two empty slots on the ASUS Hyper M.2X16 PCIeGen4 card (I am looking for another card for my 3990X system, but difficult to obtain), I decided to see what happens in creating a RAID0 drive using two Samsung 980Pro 2TB sticks.
Listed below are some benchmarks
1. Video Disk Speed Test benchmark from BlackMagic (BM) testing the transfer from the on board workstation 72TB SAS HDD raid6 (PC88E, 8X12TB Seagate) of a 20GB E57 file to the raid0 virtual disk (PC88D, two 980Pro, 2TB M.2). Total time = 25.31 seconds. 2. BM Video Disk Speed Test benchmark for PC88C, 980Pro, 1TB, 1GB test. 3. CrystalDiskMark (CDM) for PC88C, 980Pro, 1TB, 1GB test 4. AS-SSD for PC88C, 980Pro, 1TB, 1GB test 5. BM Video Disk Speed Test benchmark for PC88D, Raid0 (2X980Pro, 2TB M.2) 4TB, 4GB test. 6. CDM for PC88D, Raid0 2X980Pro, 4TB, 4GB test. Copy from PC88C (1X980Pro) of a 20GB E57 file to the raid0 virtual disk (PC88D, two 980Pro, 2TB M.2). Total time = 10.24 seconds. 7. AS-SSD for PC88D, Raid0 (2X980Pro, 2TB M.2) 4TB, 1GB test
Since I have not tracked benchmarks recently, I do not know if these benchmarks are the significant ones to evaluate or what all these numerics mean. The significant problem is that the raid0 drivers only work for W10 so this does not help me for Ubuntu.
You do not have the required permissions to view the files attached to this post.
-
- V.I.P Member
- Posts: 958
- Joined: Sun Nov 01, 2009 11:18 pm
- 14
- Full Name: Dennis Hirota
- Company Details: Sam O Hirota Inc
- Company Position Title: President
- Country: USA
- Linkedin Profile: Yes
- Location: Hawaii, USA
- Has thanked: 87 times
- Been thanked: 379 times
Re: AMD THREADRIPPER PRO 3995WX
Since much of our processing with scans has been centered around Ubuntu, the difficulty of implementing dual boot using both W10 and Ubuntu has been to try and keep it as simple as possible. Since the RAID0 can work with Ubuntu, but I decided it was not worth the effort since you can achieve significant speed using single 2TB Samsung 980Pro sticks without combining them under Ubuntu.
During the testing, I discovered that CrystalDiskMark can be set up using a NVMe format that uses 1 and 16 thread setting that I used previously and shown below on the May 6th thread above.
I decided to try implementing 64 threads since I have them on the TR Pro 3995WX to see what the difference might show below. Some of the numbers appear less, probably since using more threads reduces the maximum average CPU speed.
I decided to use the Samsung Magician to see the relative numbers for those that might be interested
Just to keep the discussion on data movement on workstations, I have included a link to a previous LSF thread on Samsung T7 USB3.2 Gen 2X2 that is on the ASUS MB which gives 2X10Gbps. Copying the same 20GB E57 file from the RAID0 (PC88D) to SamsungT7x2TB elapsed time =35.72 seconds.
viewtopic.php?p=88092#p88092
You do not have the required permissions to view the files attached to this post.
- smacl
- Global Moderator
- Posts: 1409
- Joined: Tue Jan 25, 2011 5:12 pm
- 13
- Full Name: Shane MacLaughlin
- Company Details: Atlas Computers Ltd
- Company Position Title: Managing Director
- Country: Ireland
- Linkedin Profile: Yes
- Location: Ireland
- Has thanked: 627 times
- Been thanked: 657 times
- Contact:
Re: AMD THREADRIPPER PRO 3995WX
Not sure if I've asked this before Dennis, but have you considered RAM disks. If you have an I/O bound process and available memory, these are likely to be an order of magnitude faster than SSD. The trick is figuring out how to divide the physical RAM out to leave enough space for the program and storage, may not be workable on larger jobs where you don't have the available excess.