We dream a magic button for 3-D point cloud processing

[Joon]

Physical ads displays will be superfluous.
Physical object surfaces will provide virtual ads display surfaces.
------------------------------------

Chungmuro station Line 3 - iPhone Pro 12

youtu.be/BmKNmZCiMkw

https://en.wikipedia.org/wiki/Chungmuro_station

Chungmuro Station is on Line 3 and line 4 of the Seoul Subway system.
Platforms for both Line 3 and Line 4 are in Chungmuro-4-ga, Jung-gu, Seoul.

This station is named after the road under which it passes, in honor of the Chosun general Yi Sunsin, who was also known by the title of Chungmugong.

---------------------------------------
Once, the shape, size, position, orientation of an object surface is known, there are a variety of AR applications.

YouTube CurvSurf, GitHub CurvSurf, FindSurface Web Demo.

The source code for AR overlaying/rendering virtual image/video around/on the real geometric object primitives extracted from the LiDAR point cloud is available.
https://github.com/CurvSurf/FindSurface ... ARDemo-iOS

#spatialcomputing #realtime #automation #robotics #ar #computervision #surface #fitting #pointcloud #curvature

Tools used:
- iPhone 12 Pro
- Apple ARKit
- Apple SceneKit
- Apple Metal API
- CurvSurf FindSurface runtime library.

3-D, least squares, analytic geometry, geometric primitive, differential geometry, principal curvature, principal direction, fitting, curve, surface, orthogonal distance fitting, ODF, robust fitting, point cloud, segmentation, region growing, outlier elimination, object recognition, reverse engineering, CAD CAM, BIM, augmented reality, occlusion, curve fitting, surface fitting, plane fitting, sphere fitting, cylinder fitting, cone fitting, torus fitting, piping, reducer, elbow, box, cuboid, radius, length, size, position, location, orientation, pose, rotation, axis, Software, ISO 10360-6, ARKit, ARCore, HoloLens, RealSense, FindSurface, LiDAR, ToF, laser scanner, iPad Pro, iPhone Pro

[Joon]

As far as I observed, Apple has been improving the SOFTWARE performance of LiDAR and ARKit since their release in 2020 and 2017, respectively.

The overall performance of the combination of Apple's LiDAR and ARKit can be checked by using CurvSurf's FindSurface runtime library:
1. 3D measurement accuracy of LiDAR
2. Robustness of DepthMap against darkness
3. Accuracy of the motion tracking of ARKit
4. Robustness of the motion tracking of ARKit against darkness and device's shaking.

CurvSurf's FindSurface runtime library determines the shape, size, position, and orientation of an object surface by processing the 3D measurement points according to the orthogonal distance fitting.

The accuracy of the orthogonal distance fitting algorithms adopted by CurvSurf's FindSurface runtime library is approved by the German PTB according to ISO 10360-6 (see my PhD thesis, ISBN 3540239669, 2004).

If there are somewhat shortages in the overall performance of Apple's LiDAR and ARKit mentioned above, we will observe some misalignment between the real object surfaces and the virtual ads.

In the same way, we can check the overall performance of '3D measurement and motion tracking' of Google ARCore and Microsoft HoloLens.

Virtual Ads inside Chungmuro station Line 3 - iPhone Pro 12:
https://youtu.be/BmKNmZCiMkw

The source code of the App producing the above video is available on GitHub CurvSurf:
FindSurface-SceneKit-ARDemo-iOS
https://github.com/CurvSurf/FindSurface ... ARDemo-iOS

[Joon]

Why FindSurface?

A solution to the problem of 3D object detection, measurement and extraction from 3D point cloud data:
- FindSurface can detect and fit various geometric primitives such as planes, spheres, cylinders, cones and tori from noisy and incomplete 3D point clouds in real time.
- FindSurface does not require any prior knowledge or assumptions about the shape, size, orientation or location of the objects in the scene.
- FindSurface also does not require any preprocessing or segmentation of the point cloud data.
- FindSurface can handle point clouds from any source, such as LiDAR, structured light, stereo vision or photogrammetry.
- FindSurface can also handle point clouds with varying density, resolution and scale.
- FindSurface can provide accurate and robust results even in challenging scenarios such as occlusion, clutter, outliers and overlapping objects.
- FindSurface can be used for various applications such as 3D scanning, reverse engineering, inspection, quality control, augmented reality and virtual reality.
- FindSurface is a breakthrough solution that solves the long-standing problem of 3D object recognition, measurement and extraction from 3D point cloud data in a fast, easy and reliable way.

CurvSurf FindSurface is a solution to the problem of 3D object recognition, measurement and extraction from 3D point cloud data.

A well-known problem in computer vision, robot vision, machine vision, and coordinate metrology is how to recognize, measure and extract 3D object geometries including their parameters from 3D point cloud data.

A measurement point is a probable observation of an unknown real object point next to the measurement point. The unknown measurement error is the distance between the measurement point and an unknown real object point.

The maximum likelihood estimation is minimizing the unknown measurement error down to zero by substituting an unknown real object point with the measurement point.

For 3D object surface measurement, the maximum likelihood estimation is minimizing the sum of the squared distances between a 3D model surface and the 3D measurement points.

FindSurface SDK as a solution to this problem is available at GitHub CurvSurf.
https://github.com/CurvSurf/FindSurface

A web demo is also available.
https://developers.curvsurf.com/WebDemo .