We dream a magic button for 3-D point cloud processing

aurivus|REVIT, 3D Studio MAX, 3D Coat, Lightwave, ZBrush, VRMesh, TopoGun, Blender, Rhino, Trimble Sketchup Etc.
Post Reply
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

Finding Planes in depthMap - Apple iPad Pro LiDAR


youtu.be/8ixtwnfsuzA

CurvSurf FindSurface extracts object planes through the segmentation and plane fitting to the max 3,072 points sampled from the max 256x192 depthMap points.

The max 256x192 depthMap points are generated at 60 Hz by interpolating the max 576 (3x3x8x8) laser dot points (i.e., original sensor data) together with the RGB-image.

We prefer the original sensor data of max 576 points to the sampled points from the max 256x192 depthMap points.

The access API to the original sensor data of max 576 points is not available/released yet, 20 July, 2020.

Tools used:
- Apple iPad Pro LiDAR
- Apple ARKit 4
- Apple Metal API
- CurvSurf FindSurface.
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

Real Time Object Recognition in depthMap - Apple iPad Pro LiDAR


youtu.be/o_D4_Azq5cs

CurvSurf FindSurface determines the shapes, sizes, positions and rotations of object surfaces by using:
- Curvature analysis: determines the shape type and the initial surface parameter values.
- Orthogonal distance fitting: refines the surface parameter values.
- Region growing: gathers the inlier candidate points.

The max 1,536 points are sampled randomly from the max 256x192 depthMap points with the reduction ratio of 1/32.

The max 256x192 depthMap points are generated at 60 Hz by interpolating the max 576 (3x3x8x8) laser dot points (i.e., original sensor data) together with the RGB-image.

We prefer the original sensor data of max 576 points to the sampled points from the max 256x192 depthMap points.

The access API to the original sensor data of max 576 points is not available/released yet: 23 July, 2020.

Tools used:
- Apple iPad Pro LiDAR
- Apple ARKit 4
- Apple Metal API
- CurvSurf FindSurface.
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

As-Built Object Geometry from Point Cloud - Apple iPad Pro LiDAR


Max 192 points are randomly sampled from the max 256x192 depthMap points of 60 Hz frame rate.

If the camera motion between two (start and end) frames oversteps the parallel motion threshold of 5 cm or the optical axis change threshold of 5 deg, then the max 192 points of the last frame are appended to the point cloud.

The object geometries are for creating a lot of contents, e.g., 3-D CAD information, game environments, work instructions, advertisements, navigation map, etc.

The ultra wide angle camera helps ease the problem of large area motion tracking.

With smart glasses, the user experience will be more immersive and two hands be free.


youtu.be/7OFsXU2JfpI
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

As-Built Torus Geometry from Point Cloud - Apple iPad Pro LiDAR

Lee JaeHyo (이재효, 0121-1110=110101)
http://leejaehyo.com
http://www.sungkokmuseum.org
http://www.sungkokmuseum.org/main/exhib ... re-garden/


youtu.be/4TNjcN7MLvw
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

3-D Measurement of Tree Branches II - Apple iPad Pro LiDAR

A measuring app will be recording DBH (diameter at breast height) of trees together with GPS coordinates, device direction, calendar day and time, tree type, snapshot, etc.

Compared to the measurement of the same tree 17 months ago (https://youtu.be/h9s8_lt1I64), ARKit 4 with LiDAR shows improvements in point accuracy, motion tracking, and work efficiency.

Tools used today Aug. 2020:
- Apple iPad Pro LiDAR (A2228) 2020
- Apple ARKit 4
- Apple Metal API
- CurvSurf FindSurface.

Tools used 17 months ago:
- Apple iPad Pro (A1980) 2018
- Apple ARKit 2.0
- Apple Metal API
- CurvSurf FindSurface.


youtu.be/_jwZ2EjzwhE
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

Looking into depthMap II - Apple iPad Pro LiDAR

Compared with:
Looking into depthMap - Apple iPad Pro LiDAR
about 2 months ago.

Since iOS & iPadOS 14 Beta 5, Apple has improved the quality of ARDepthData with the provisional option of so-called 'smoothedSceneDepth'.

The improvements we have observed:
- The depthMap points are more accurate but linearized
- The RMS errors of surface fitting are smaller (decreased from 2~5 mm to 1~3 mm)
- Object steps (edges) with small offset are visible
- Edges of object surface are more clear
- Planar object surfaces are more flat
- The number of noisy points in shadow boundaries are reduced
- The number of points with 'medium' or 'high' confidence threshold is increased (The number 49,152 points with 'low' confidence threshold is the max number of the depthMap points).
- The number of points with the current (beta 5, 6) 'high' confidence threshold is about the same with that of the old (beta 4) 'medium' confidence threshold.


Looking into depthMap II - Apple iPad Pro LiDAR

youtu.be/ncSkQ84iDBM

Looking into depthMap - Apple iPad Pro LiDAR

youtu.be/h3PBy0psayY
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

In 2-D or 3-D space, the scanning is the seeing.
The 2-D scanning's result is photos and the 3-D scanning's result is point clouds.

Understanding the geometric contents of them is the same: shape, size, position & rotation of objects in 2-D/3-D space.

Why FindSurface 2020 KICT Smart construction seminar CurvSurf Dr. SJ Ahn.png

Ground breaking theory and practice of 3-D data processing and applications.


youtu.be/H1ZY1bOw0kU
You do not have the required permissions to view the files attached to this post.
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

Outdoors under direct sunlight - Apple iPad Pro LiDAR

Finding object cone or cylinder from the point cloud measured under direct sunlight.

Eventually, planes, boxes, spheres, cylinders, cones and tori can be recognized and extracted from a point cloud by utilizing the following facts:
  • Cylinder is a special case of cone with zero vertex angle.
  • Cylinder is a special case of torus with infinite mean radius.
  • Sphere is a special case of torus with zero mean radius.
  • Box is an extension of plane, consisted of at least 2 orthogonal planes.
Tools used:
- Apple iPad Pro LiDAR
- Apple ARKit 4
- Apple Metal API
- CurvSurf FindSurface.


youtu.be/bow5VHMf2lg
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

Jongno 3(sam)-ga - Google ARCore

The platform of Jongno 3(sam)-ga, a subway station in Seoul.
The passengers are waiting for trains.
The 3-D point cloud of surroundings is being recorded.
And, the motion of the recording mobile device is tracked.

The cylindrical pillar is measured:
diameter, position and axis.

A virtual satellite is rotating around the real cylindrical pillar.

How about virtual ads on the real object surfaces?
AR games, CADCAM, reverse engineering, BIM, ...

Tools used:
- Samsung Galaxy S8+
- Google ARCore 2.0
- OpenGL ES 3.1
- CurvSurf FindSurface.


youtu.be/sm5B1922OWk
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

ARKit FindSurface Web - Apple iPad Pro LiDAR

Advance notice:
The source codes of the App will be available on GitHub CurvSurf in weeks, in 2020.

Max 192 points are being randomly sampled from the max 256x192 depthMap points.
Collecting points...
9826 points are collected.
Finding object torus and plane.
Sphere is a special case of torus with zero mean radius.
The latency of the current Wi-Fi networking is about 1 second.
Red points are inlier points.
Hiding point cloud.
The ball sphere on the floor plane.
The RMS ODF (orthogonal distance fitting) error is 4~5 mm.

Tools used:
- Apple iPad Pro LiDAR
- Apple ARKit 4
- Apple Metal API
- CurvSurf FindSurface Web.


youtu.be/sUWCbS_P7b8
Post Reply

Return to “Modeling Software”