AMD THREADRIPPER PRO 3995WX

To chat about anything else.
Post Reply
User avatar
landmeterbeuckx
V.I.P Member
V.I.P Member
Posts: 1616
Joined: Tue May 01, 2012 5:19 pm
11
Full Name: Lieven Beuckx
Company Details: Studiebureau Beuckx
Company Position Title: Owner
Country: Belgium
Linkedin Profile: Yes
Has thanked: 183 times
Been thanked: 548 times

Re: AMD THREADRIPPER PRO 3995WX

Post by landmeterbeuckx »

This is what is in my pc. P5000

Image
LSBbvba
Surveying services - 3D Laserscanning
Tel : +32477753126
www.lsbbvba.be
[email protected]
User avatar
smacl
Global Moderator
Global Moderator
Posts: 1409
Joined: Tue Jan 25, 2011 5:12 pm
13
Full Name: Shane MacLaughlin
Company Details: Atlas Computers Ltd
Company Position Title: Managing Director
Country: Ireland
Linkedin Profile: Yes
Location: Ireland
Has thanked: 627 times
Been thanked: 657 times
Contact:

Re: AMD THREADRIPPER PRO 3995WX

Post by smacl »

TommyMaddox wrote: Mon Apr 12, 2021 6:54 pm Eager to see how RiScan Pro performs on the 48GB VRAM A6000 GPU. I know on our end the 1080Ti 11GB units we have perform better than the newer RTX series cards that have lower vram amounts just due to how RSP handles point display. Heavily considering getting that once prices become more justifiable.
Not sure how much value the RTX cores provide outside of ray tracing and how well they're used outside of gaming. For GPU Compute on point clouds, maximum number of cores and lots of fast memory is where the performance comes from. Paging data from main memory to and from GPU can be comparatively slow and can be reduced with more on card memory.
Shane MacLaughlin
Atlas Computers Ltd
www.atlascomputers.ie

SCC Point Cloud module
dhirota
V.I.P Member
V.I.P Member
Posts: 958
Joined: Sun Nov 01, 2009 11:18 pm
14
Full Name: Dennis Hirota
Company Details: Sam O Hirota Inc
Company Position Title: President
Country: USA
Linkedin Profile: Yes
Location: Hawaii, USA
Has thanked: 87 times
Been thanked: 379 times

Re: AMD THREADRIPPER PRO 3995WX

Post by dhirota »

TommyMaddox wrote: Mon Apr 12, 2021 6:54 pm Eager to see how RiScan Pro performs on the 48GB VRAM A6000 GPU. I know on our end the 1080Ti 11GB units we have perform better than the newer RTX series cards that have lower vram amounts just due to how RSP handles point display. Heavily considering getting that once prices become more justifiable.
Tommy and Lieven

This is for you folks since I know you have VZ400i systems like us. I do not have the time to sell Riegl equipment since most people on this forum are in a different buying mode and are probably not interested in seeing Riegl information.

Riegl just released a newer version of their processing software RiScan Pro/RiSolve 2.12.1. I normally do not check the settings, but since I was speaking with the Riegl USA technical people and asking questions about multiple core CPU and GPU processing with the software, and the response that I received was the software utilization of multiple core CPU and GPU. Here are the settings pages for CPU which is normally at 8 parallel processes, in our case it is 16 threads with dual Xeon 2637 and I was surprised to see 64 parallel processes automatically defaulted for our TR Pro 3995WX.

1.4-12-2021 10-47-14 AM.jpg
2.4-12-2021 10-52-21 AM.jpg

I decided to run a quick BENCHMARK using PC162-Dual Xeon 2637 3.5GHz, 256GB RAM and TR Pro 3995WX 2.7-4.2GHz 512GB RAM processing 44 scans using our Riegl VZ400i.

1.PC162-REGISTER-04-16-2021 10-02-40 AM.jpg
2.PC162-COLOR-04-16-2021 10-32-16 AM.jpg

4.PC88-REGISTER-4-16-2021 11-15-11 AM.jpg
5.PC88-COLOR-4-16-2021 11-34-08 AM.jpg

PC162
REGISTER = 8m:51s
COLORIZE = 6m:07s
PC88
REGISTER = 7m:08s
COLORIZE = 4m:58s

Colorizing 44 scans with color panoramas in 5 to 6 minutes seems faster than it used to be, 100% CPU at all threads and 20-100% GPU during the compute period.

Riegl has also has a task selection wizard to automatically create 12 different features automatically, including an octree based combined point clouds at different resolutions, see below at 5mm (also 50mm, 20mm, 10mm) and video along scan positions.

5mm-4-16-2021 2-31-49 PM.jpg

It looks like no one is asking any questions about the TR Pro, so that is about the end for the presentation of new information. If there are any questions, please send them to my email, since I do not answer PM from any forum. We are continue using the TR Pro for processing and visualization applications on both W10 and Ubuntu 18.04.
You do not have the required permissions to view the files attached to this post.
Dennis Hirota, PhD, PE, LPLS
www.samhirota.com
[email protected]
User avatar
landmeterbeuckx
V.I.P Member
V.I.P Member
Posts: 1616
Joined: Tue May 01, 2012 5:19 pm
11
Full Name: Lieven Beuckx
Company Details: Studiebureau Beuckx
Company Position Title: Owner
Country: Belgium
Linkedin Profile: Yes
Has thanked: 183 times
Been thanked: 548 times

Re: AMD THREADRIPPER PRO 3995WX

Post by landmeterbeuckx »

Hi Dennis,

Great test. I haven't updated to 2.12.1 because i saw only 1 change in the revision list but definately will check it out.
Thanks for the detailed info.

We Riegl users know what to do with it;-)
LSBbvba
Surveying services - 3D Laserscanning
Tel : +32477753126
www.lsbbvba.be
[email protected]
MajorDomo
V.I.P Member
V.I.P Member
Posts: 205
Joined: Mon Feb 25, 2019 4:42 am
5
Full Name: Major Domo
Company Details: VeritasVfx
Company Position Title: ceo
Country: Portugal
Linkedin Profile: No
Has thanked: 17 times
Been thanked: 53 times

Re: AMD THREADRIPPER PRO 3995WX

Post by MajorDomo »

dhirota wrote: Sat Apr 17, 2021 2:13 am
TommyMaddox wrote: Mon Apr 12, 2021 6:54 pm Eager to see how RiScan Pro performs on the 48GB VRAM A6000 GPU. I know on our end the 1080Ti 11GB units we have perform better than the newer RTX series cards that have lower vram amounts just due to how RSP handles point display. Heavily considering getting that once prices become more justifiable.
Tommy and Lieven

This is for you folks since I know you have VZ400i systems like us. I do not have the time to sell Riegl equipment since most people on this forum are in a different buying mode and are probably not interested in seeing Riegl information.

Riegl just released a newer version of their processing software RiScan Pro/RiSolve 2.12.1. I normally do not check the settings, but since I was speaking with the Riegl USA technical people and asking questions about multiple core CPU and GPU processing with the software, and the response that I received was the software utilization of multiple core CPU and GPU. Here are the settings pages for CPU which is normally at 8 parallel processes, in our case it is 16 threads with dual Xeon 2637 and I was surprised to see 64 parallel processes automatically defaulted for our TR Pro 3995WX.


1.4-12-2021 10-47-14 AM.jpg


2.4-12-2021 10-52-21 AM.jpg


I decided to run a quick BENCHMARK using PC162-Dual Xeon 2637 3.5GHz, 256GB RAM and TR Pro 3995WX 2.7-4.2GHz 512GB RAM processing 44 scans using our Riegl VZ400i.


1.PC162-REGISTER-04-16-2021 10-02-40 AM.jpg


2.PC162-COLOR-04-16-2021 10-32-16 AM.jpg



4.PC88-REGISTER-4-16-2021 11-15-11 AM.jpg


5.PC88-COLOR-4-16-2021 11-34-08 AM.jpg


PC162
REGISTER = 8m:51s
COLORIZE = 6m:07s
PC88
REGISTER = 7m:08s
COLORIZE = 4m:58s

Colorizing 44 scans with color panoramas in 5 to 6 minutes seems faster than it used to be, 100% CPU at all threads and 20-100% GPU during the compute period.

Riegl has also has a task selection wizard to automatically create 12 different features automatically, including an octree based combined point clouds at different resolutions, see below at 5mm (also 50mm, 20mm, 10mm) and video along scan positions.


5mm-4-16-2021 2-31-49 PM.jpg


It looks like no one is asking any questions about the TR Pro, so that is about the end for the presentation of new information. If there are any questions, please send them to my email, since I do not answer PM from any forum. We are continue using the TR Pro for processing and visualization applications on both W10 and Ubuntu 18.04.
Is that with SMT turned on or off?
Curious to know if the RAM channels get overwhelmed by it.
dhirota
V.I.P Member
V.I.P Member
Posts: 958
Joined: Sun Nov 01, 2009 11:18 pm
14
Full Name: Dennis Hirota
Company Details: Sam O Hirota Inc
Company Position Title: President
Country: USA
Linkedin Profile: Yes
Location: Hawaii, USA
Has thanked: 87 times
Been thanked: 379 times

Re: AMD THREADRIPPER PRO 3995WX

Post by dhirota »

MajorDomo wrote: Tue Apr 20, 2021 11:06 am .........
Is that with SMT turned on or off?
Curious to know if the RAM channels get overwhelmed by it.
Since I am not a testing organization, I will refer you to other forums which talk about Simultaneous Multi-Threading (SMT) that you asked about (As far as I know SMT was turned on). I do not know about the RAM question since only running Ubuntu for our NavVis post-processing is using more than 100GB of RAM (512GB RAM TOTAL)

Also in the discussion is:
UMA= uniform memory access, distributed mode
NUMA=non-uniform memory access, local mode

An older discussion
https://www.tweaktown.com/guides/8343/l ... index.html

A newer discussion of TR PRO + ASUS MB
https://hardforum.com/threads/disable-s ... e.2008674/

It looks like advantages on turning SMT on/off if you are using software not using the SMT or maybe gaming. The current BIOS on the ASUS MB does not look like it is easy unless I missed something.
Dennis Hirota, PhD, PE, LPLS
www.samhirota.com
[email protected]
MajorDomo
V.I.P Member
V.I.P Member
Posts: 205
Joined: Mon Feb 25, 2019 4:42 am
5
Full Name: Major Domo
Company Details: VeritasVfx
Company Position Title: ceo
Country: Portugal
Linkedin Profile: No
Has thanked: 17 times
Been thanked: 53 times

Re: AMD THREADRIPPER PRO 3995WX

Post by MajorDomo »

dhirota wrote: Wed Apr 21, 2021 1:29 am
MajorDomo wrote: Tue Apr 20, 2021 11:06 am .........
Is that with SMT turned on or off?
Curious to know if the RAM channels get overwhelmed by it.
Since I am not a testing organization, I will refer you to other forums which talk about Simultaneous Multi-Threading (SMT) that you asked about (As far as I know SMT was turned on). I do not know about the RAM question since only running Ubuntu for our NavVis post-processing is using more than 100GB of RAM (512GB RAM TOTAL)

Also in the discussion is:
UMA= uniform memory access, distributed mode
NUMA=non-uniform memory access, local mode

An older discussion
https://www.tweaktown.com/guides/8343/l ... index.html

A newer discussion of TR PRO + ASUS MB
https://hardforum.com/threads/disable-s ... e.2008674/

It looks like advantages on turning SMT on/off if you are using software not using the SMT or maybe gaming. The current BIOS on the ASUS MB does not look like it is easy unless I missed something.
Thanks for your time Dennis.
You have done a wonderful job already with all the detailed information.

SMT/Hyperthreading is something that I've seen with an air of suspicion for a good while, the previous generation of TR unfortunately could not deal with the constant RAM reassignment for me on vast numbers of parallelled processes and despite not seeing a huge improvement of speed by keeping it off, it was a lot more stable for me.

Need to justify to myself the need for one of these to have a go at it :)

Thanks for such a detailed build, really like reading about the difficulties, it tells me that it's certainly not just me scratching my head as well.
dhirota
V.I.P Member
V.I.P Member
Posts: 958
Joined: Sun Nov 01, 2009 11:18 pm
14
Full Name: Dennis Hirota
Company Details: Sam O Hirota Inc
Company Position Title: President
Country: USA
Linkedin Profile: Yes
Location: Hawaii, USA
Has thanked: 87 times
Been thanked: 379 times

Re: AMD THREADRIPPER PRO 3995WX

Post by dhirota »

Still waiting for my NVIDIA A6000 order to arrive.

I decided to see what additions to the system will improve performance. Since I had two empty slots on the ASUS Hyper M.2X16 PCIeGen4 card (I am looking for another card for my 3990X system, but difficult to obtain), I decided to see what happens in creating a RAID0 drive using two Samsung 980Pro 2TB sticks.

Listed below are some benchmarks

1. Video Disk Speed Test benchmark from BlackMagic (BM) testing the transfer from the on board workstation 72TB SAS HDD raid6 (PC88E, 8X12TB Seagate) of a 20GB E57 file to the raid0 virtual disk (PC88D, two 980Pro, 2TB M.2). Total time = 25.31 seconds.
1.BlackMagic-PC88E-72TB-5GB.jpg
2. BM Video Disk Speed Test benchmark for PC88C, 980Pro, 1TB, 1GB test.
2.BlackMagic-PC88C-980PRO-1TB-1GB.jpg
3. CrystalDiskMark (CDM) for PC88C, 980Pro, 1TB, 1GB test
3.CrystalDiskMark-PC88C-980Pro-1TB-1GB.jpg
4. AS-SSD for PC88C, 980Pro, 1TB, 1GB test
4.AS-SSD-PC88C-980Pro-1TB-1GB.jpg
5. BM Video Disk Speed Test benchmark for PC88D, Raid0 (2X980Pro, 2TB M.2) 4TB, 4GB test.
5.BM-PC88D-RAID0-4TB-4GB.jpg
6. CDM for PC88D, Raid0 2X980Pro, 4TB, 4GB test. Copy from PC88C (1X980Pro) of a 20GB E57 file to the raid0 virtual disk (PC88D, two 980Pro, 2TB M.2). Total time = 10.24 seconds.
6.CDM-PC88D-RAID0-4TB-4GB.jpg
7. AS-SSD for PC88D, Raid0 (2X980Pro, 2TB M.2) 4TB, 1GB test
7.AS-SSD-PC88D-RAID0-4TB-1GB.jpg

Since I have not tracked benchmarks recently, I do not know if these benchmarks are the significant ones to evaluate or what all these numerics mean. The significant problem is that the raid0 drivers only work for W10 so this does not help me for Ubuntu.
You do not have the required permissions to view the files attached to this post.
Dennis Hirota, PhD, PE, LPLS
www.samhirota.com
[email protected]
dhirota
V.I.P Member
V.I.P Member
Posts: 958
Joined: Sun Nov 01, 2009 11:18 pm
14
Full Name: Dennis Hirota
Company Details: Sam O Hirota Inc
Company Position Title: President
Country: USA
Linkedin Profile: Yes
Location: Hawaii, USA
Has thanked: 87 times
Been thanked: 379 times

Re: AMD THREADRIPPER PRO 3995WX

Post by dhirota »

dhirota wrote: Fri May 07, 2021 4:42 am
Since I have not tracked benchmarks recently, I do not know if these benchmarks are the significant ones to evaluate or what all these numerics mean. The significant problem is that the raid0 drivers only work for W10 so this does not help me for Ubuntu.
Since much of our processing with scans has been centered around Ubuntu, the difficulty of implementing dual boot using both W10 and Ubuntu has been to try and keep it as simple as possible. Since the RAID0 can work with Ubuntu, but I decided it was not worth the effort since you can achieve significant speed using single 2TB Samsung 980Pro sticks without combining them under Ubuntu.

During the testing, I discovered that CrystalDiskMark can be set up using a NVMe format that uses 1 and 16 thread setting that I used previously and shown below on the May 6th thread above.
0.CDM-PC88D-RAID0-4TB-4GB.jpg

I decided to try implementing 64 threads since I have them on the TR Pro 3995WX to see what the difference might show below. Some of the numbers appear less, probably since using more threads reduces the maximum average CPU speed.

1.CDM64T.jpg
2.CDM+CPU.jpg

I decided to use the Samsung Magician to see the relative numbers for those that might be interested

3.SSM-980Pro-1TB.jpg
4.SSM-RAID0-2X980Pro-4TB.jpg

Just to keep the discussion on data movement on workstations, I have included a link to a previous LSF thread on Samsung T7 USB3.2 Gen 2X2 that is on the ASUS MB which gives 2X10Gbps. Copying the same 20GB E57 file from the RAID0 (PC88D) to SamsungT7x2TB elapsed time =35.72 seconds.

viewtopic.php?p=88092#p88092

5.CDM+64T-SST7-2TB.jpg
You do not have the required permissions to view the files attached to this post.
Dennis Hirota, PhD, PE, LPLS
www.samhirota.com
[email protected]
User avatar
smacl
Global Moderator
Global Moderator
Posts: 1409
Joined: Tue Jan 25, 2011 5:12 pm
13
Full Name: Shane MacLaughlin
Company Details: Atlas Computers Ltd
Company Position Title: Managing Director
Country: Ireland
Linkedin Profile: Yes
Location: Ireland
Has thanked: 627 times
Been thanked: 657 times
Contact:

Re: AMD THREADRIPPER PRO 3995WX

Post by smacl »

Not sure if I've asked this before Dennis, but have you considered RAM disks. If you have an I/O bound process and available memory, these are likely to be an order of magnitude faster than SSD. The trick is figuring out how to divide the physical RAM out to leave enough space for the program and storage, may not be workable on larger jobs where you don't have the available excess.
Shane MacLaughlin
Atlas Computers Ltd
www.atlascomputers.ie

SCC Point Cloud module
Post Reply

Return to “General Chat”