[SoC] GSoC 2021 FINAL REPORT : Integrating a module to 3d scan a house within the MapMint4ME android application

[Ayoub FATIHI]

Hello all,
Here is my final report:
============================================
Abstract:

This project allows a minimalist 3D scan (taking multiple pictures,
recording camera position, using opendrone map to rebuild the 3D scene)
with the house faces (accessible/visible faces) then load it as 3D model
and export the data back on MapMint for 3D viewing.
<https://github.com/ayoubft/Journey-GSoC-21/wiki/Final-Report#the-state-of-the-art-before-gsoc>The
state of the art BEFORE GSoC:

Have you ever wished that you could easily transfer a real object into a
digital file? The technology is here, but most of us simply do not have
access to high-end 3D scanners that can reconstruct the digital geometry of
a physical model.
<https://github.com/ayoubft/Journey-GSoC-21/wiki/Final-Report#the-added-value>The
added value:

Now it is possible to take multiple pictures using MapMint4ME, then
visualize the 3D model issued from the taken pictures in MapMint.
<https://github.com/ayoubft/Journey-GSoC-21/wiki/Final-Report#future-work>Future
Work:

   - One challenging part of my project, not yet done, is to get to link
   the MapMint4ME with a MapMint instance.
   - I did not get enough time to automate the step of creating the model
   using openDroneMap, here is what i was thinking to do
   <https://jpetazzo.github.io/2015/09/03/do-not-use-docker-in-docker-for-ci/>
   .

<https://github.com/ayoubft/Journey-GSoC-21/wiki/Final-Report#permanent-links--documentation>Permanent
links & documentation:
<https://github.com/ayoubft/Journey-GSoC-21/wiki/Final-Report#code-repositories>Code
Repositories:

   - ZOO-Project <https://github.com/ayoubft/ZOO-Project/tree/docker-gsoc21>
   - MapMint4ME <https://github.com/ayoubft/MapMint4ME>

<https://github.com/ayoubft/Journey-GSoC-21/wiki/Final-Report#videos>Videos:

   - Loading Models
   <https://drive.google.com/file/d/150PgaYOqNWTER8W0CTFqRQ4JDvy9SpLA/view?usp=sharing>

<https://github.com/ayoubft/Journey-GSoC-21/wiki/Final-Report#other-important-links>Other
Important Links:

   - Wiki on GitHub <https://github.com/ayoubft/Journey-GSoC-21/wiki>
   - Project on OSGeo Wiki
   <https://wiki.osgeo.org/wiki/Integrating_a_module_to_3d_scan_a_house_within_the_MapMint4ME_android_application>

<https://github.com/ayoubft/Journey-GSoC-21/wiki/Final-Report#documentation>
Documentation

My work consist of three parts:

   - One graphical image describing my project:

<https://github.com/ayoubft/Journey-GSoC-21/wiki/Final-Report#part-one-get-the-pictures-using-mapmint4me>Part
One: Get the pictures using MapMint4ME

Here <https://github.com/ayoubft/MapMint4ME/commits/gsoc-21> are the
commits for this part.

   - Created a button
   <https://github.com/ayoubft/MapMint4ME/commit/ec347c0e5161395c31c04a7cee5a8af2bdca3c38>
that
   direct you to the this layout
   <https://github.com/ayoubft/MapMint4ME/commit/abee7d7faad96fa1ff984a517f86b543cc02f25a>
   .
   - I have created a form that can be filled with a fixed number of images
   taken from the mobile MapMint4ME app, and will be transfered to MapMint,
   here is how to do it
   <https://github.com/ayoubft/Journey-GSoC-21/wiki/Create-a-FORM-in-MapMint-to-save-images-from-MapMint4ME-needed-for-3D-constructing-a-model>
   .
   - I have some issues regarding linking MapMint to MapMint4ME, so I did
   get the datasets for buildings from here
   <https://colmap.github.io/datasets.html>, and I have taken the tajjin
   pictures by myself.

<https://github.com/ayoubft/Journey-GSoC-21/wiki/Final-Report#part-two-create-the-3d-model-using-odm>Part
Two: Create the 3D model using ODM

   - I have created a 3D model from pictures, here is the tutorial
   <https://github.com/ayoubft/Journey-GSoC-21/wiki/Create-3D-scene-using-ODM>
   .

<https://github.com/ayoubft/Journey-GSoC-21/wiki/Final-Report#part-three-visualize-the-3d-model-in-mapmint>Part
Three: Visualize the 3D model in MapMint

Here <https://github.com/ayoubft/ZOO-Project/commits/docker-gsoc21> are the
commits for this part.

   - Got MapMint working on virtual machine tutorial here
   <https://github.com/ayoubft/Journey-GSoC-21/wiki/Setup-MapMint>, then I
   finished up with configuring it on Docker tutorial here
   <https://github.com/ayoubft/Journey-GSoC-21/wiki/Setup-MapMint-with-Docker>
   .
   - Added 3D models to the volume see here
   <https://github.com/ayoubft/ZOO-Project/commit/1640b4464d1a37f747a807140f8006c121190b6f>
   .
   - Used docker volumes
   <https://github.com/ayoubft/ZOO-Project/blob/docker-gsoc21/docker-compose.yml#L17-L18>
to
   get access to the 3D models to be visualized.
   - Using threeJS <https://threejs.org/>, I was able to render the 3D
   models in MapMint, using a template
   <https://github.com/ayoubft/ZOO-Project/commit/8062585d9ec95af0a622c2f8c3ce92964621448c>
   .

=================================================
I had learned a lot, thank you for this opportunity.
Best,

-- 
FATIHI Ayoub
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/soc/attachments/20210822/ce4416ab/attachment-0001.html>