email: | maksim.lukyanchenko@gmail.com |
---|---|

project: | Template matching using 2D + 3D |

mentor: | Alexander Velizhev |

My name is Maksim Lukyanchenko. I’m master’s student at the Cybernetics Department of the National Research Nuclear University. I’m performing my research work at the Laboratory of Computer Graphics of the Lomonosov Moscow State University. The scope of my research interests include computer vision, three-dimensional reconstruction and robotics. My last work is related to the possibility of using three-dimensional reconstruction at nuclear power plants. I think that participation at the PCL-SRCS will help me expand my knowledge in the areas of interest, as well as improve the programmer’s skills. During my work, I will cover here every stage of development and share with you my success, failure and experience.

I’m graduated from my University. Now I have master degree and I have enough time to work at project. I figured out and implemented in Matlab surface editing based on the coordinates of Laplace. This conversion is the basis of the method that I have to implement in the Code Sprint. Implemented algorithm is Laplacian Mesh Editing consists of the following steps:

- Based on information about the relative positions of surface points computed the Laplacian operator of the mesh.
- Fix points whose position should not change - “static anchors”.
- Choose the point, whose position should be changed, and specify the offset of its origin - “handle anchors”.
- Based on available information, we construct the normal equations. For the static anchors we set big weight, and for the handle anchors little weight.
- The new coordinates of the surface are calculated based on the method of least squares.

The results of the program are presented below.

Now I proceed to implement the algorithm from article “Template Deformation for Point Cloud Fitting”.

I almost not was working with the project the last two weeks. I was making report on my master’s thesis. Almost completed work on it. Resume work on the project: now I will work on Matlab realization deformation of the surface.

Now I try implement algorithm for 3D mesh editing base on Laplacian matrix. I decide to do it in MATLAB for verify my idea. If it will work I will implement it in C++.

Last week, I wrote the program for calculation the Laplace matrix with uniform and cotangent weights (Described in the article Laplacian Mesh Optimization). Now I want to write a program for smoothing based on the Laplacian matrix.

The steps of the chosen algorithm:

User-program interaction:

- User must choose the most appropriate template for the input point cloud.
- User must identifies and marks pairs of corresponding points on template and point data, defines a local frame for every marked point (Fig. 1 (a, b)).

The program:

- From the selected correspondences, we compute the initial deformation of the template. We compute Laplacian coordinates of the template and estimate local rotations for every pair of corresponding points.
- Make initial deformation (Fig.1 (c)).
- We estimate a global scaling factor for the template which is applied to the Laplacian coordinates, to consider the fact that template and input data may be (and generally are) scaled differently may distort the resulting shape in an unacceptable way . Make new deformation (Fig.1 (d)).
- Iterative process moves the template nearer towards the data points guided by local correspondences which are established from simple heuristics. This local matching is motivated by iterative closest point (ICP) algorithms for finding (rigid) transformations for shape registration (Fig.1 (e-g)).
- We improve the remaining regions of the deformed template for which no counterparts exist in the data (Fig.1 (h)).

The first phase of the realization described algorithm, I will write code to calculate the initial approximation and estimate the coordinates of Laplace