We dream a magic button for 3-D point cloud processing

[Joon]

3-D Measurement of Ring Sculpture - Apple ARKit

Extraction of torus from ARKit point cloud under device motion.

Tools used:
- Apple iPad Pro (A1980)
- Apple ARKit 2.0
- Apple Metal API
- CurvSurf FindSurface.

youtu.be/IOxglYq2t3Y

[Joon]

The source code under the MIT license of the iOS App 'ARKitPointCloudRecorder' (unpublished) is available on GitHub CurvSurf.

The point cloud will be saved as a text file of xyz format on the App folder 'ARKitPointCloudRecorder'.
By using a point cloud viewer, you can investigate the point cloud generated by Apple ARKit.

Joon

demo01.png

[Joon]

Testing the robustness of localization with Apple ARKit

Tools used:
- Apple iPad Pro (A1980)
- Apple ARKit 2.0
- Apple Metal API
- CurvSurf FindSurface.

The radius and position of ball sphere is determined by CurvSurf FindSurface from the point cloud generated by Apple ARKit.

The iPad Pro is then being wildly shaken and losing its position and orientation.

Please look how the device is recovering its position and orientation.

Joon

PS: Apple ARKit is somewhat more stable than Google ARCore.
A list of comparison between them will be posted in months.
Of course, you can experience and compare them yourself at the booth #232, SPAR 3D EXPO, May 21-23, 2019, Anaheim, CA.


youtu.be/V-_opluQ3Ko

[Joon]

Finding Plane and Torus - Apple ARKit

Plane and torus are extracted by CurvSurf FindSurface from the point cloud generated by Apple ARKit.


youtu.be/tDfDYKuT5tM

[Joon]

Test the robustness of motion tracking with Google ARCore

Tools used:
- Samsung Galaxy Note 9
- Google ARCore 1.7
- OpenGL ES 3.1
- CurvSurf FindSurface.


youtu.be/SX43xEgN_2k

[Joon]

Extraction of plane, sphere, cylinder and cone from ARCore point cloud under device motion.

Tools used:
- Samsung Galaxy Note 9
- Google ARCore 1.7
- OpenGL ES 3.1
- CurvSurf FindSurface

Sculptor:
Lee JaeHyo (이재효, 0121-1110=1)
http://www.leeart.name


youtu.be/JFPuI3c5Auc

[Joon]

Plane and Torus

Tools used:
- Samsung Galaxy Note 9
- Google ARCore 1.7
- OpenGL ES 3.1
- CurvSurf FindSurface.

Lee JaeHyo (이재효, 0121-1110=1)
http://www.leeart.name .


youtu.be/lWvpmiWHi6s

[Joon]

Large Ring Torus

Tools used:
- Samsung Galaxy Note 9
- Google ARCore 1.7
- OpenGL ES 3.1
- CurvSurf FindSurface.

Sculptor:
Lee JaeHyo (이재효, 0121-1110=1)
http://www.leeart.name .


youtu.be/ugnvhvVwqaw

[Joon]

A comparison between Apple ARKit and Google ARCore

ARKit/ARCore are tools for developing AR applications. They have the corresponding functions or modules to each other.

CurvSurf had noticed the 'motion tracking' and the 'point cloud' provided by ARKit/ARCore, because a smartphone/tablet can be used as a potential 3-D measuring device with the AR on-site.

Once we have scanned and extracted the geometric object features from a scene on-site, we can identify and overlay the corresponding 3-D CAD, work and product information onto the live-video on site.

As far as CurvSurf has tested, the performance of ARKit/ARCore is determined mainly by the performance of the camera, i.e. resolution, noise, etc.

Lee JaeHyo Gallery Ball Table - Google ARCore

youtu.be/0cmKIyA5oyU

Lee JaeHyo Gallery Ball Table - Apple ARKit

youtu.be/t7_jOl8oxWs

[Joon]

Extracting a large dome sphere from ARCore point cloud


The dome of the planetarium is large and distant. To guarantee sufficient parallaxes between the successive frames of ARKit/ARCore, the device's moving speed should be high enough. But the hand-held mobile device was slow and shaken. The accuracy of motion tracking and point measurement is consequently bounded.

Mobile AR for a large and distant object:
- Active 3-D sensors (SL or ToF) are categorically excluded, because of the measuring range and the power consumption
- Passive 3-D sensors (moving single or multiple lens camera) with sufficiently high moving speed are practical.

Tools used:
- Samsung Galaxy Note 9
- Google ARCore 1.7
- OpenGL ES 3.1
- CurvSurf FindSurface.

With Apple iPhone XS Max, a reasonable result could not be obtained for the large dome, today April 2019.

The Planetarium of Gwacheon National Science Museum (sciencecenter.go.kr) is located at 37°26'21"N 127°00'18"E.


youtu.be/ZAmgxPq6c7k