Photogrammetry 1

photogrammetry
(fō’tə-grăm’ĭ-trē) Photogrammatry uses the laws of perspective to create mathematical models to determine the coordinates of a point inspace from two or more images. This was first developed by R. Strums and Guido Haick in Germany in 1883. 140 years of Photogammatry & History Of Photogammatry History Videos

BACKGROUND
Previously LIDAR was the only way of getting accurate dense survey data. In the last couple of years the alternative of automated photogammatry evolved from being a academic/military/medical applications to one applied in many areas such as aerial mapping, archeology, forensic science and and engineering. There are now a range of available applications and online services to the filmmaker, that automate photogammatry by:

  1. Pattern recognition from multiple photos to create a point cloud of features.
  2. Retopology – Mesh reconstruction from point cloud
  3. Decimate the polygon mesh so its not so heavy
  4. Applying a texture to the model or aligning projection cameras of stigs

– for arguments of Photogammatary vs Lidar click here or here or here

AIMS
My aim here is to push photogammatry to do more than model an object or a facade of a building (that has been shown to accurately work), and use it as a tool for building set-extensions for vfx. The cost of LIDAR is out of the reach of most filmmakers, as is the cost of employing a modeler for a couple of weeks to build a scene using traditional manual photogammatry tools such as model builder. What i wanted to discover is how close to the camera i could get away with a photogammatry using projections in Nuke and if i could use matte painting projections, rather than textures as the as cheaper, easier to paint.

EARLY TESTS
There are several dozen applications out there that claim to do automatic pattern recognition with photogammatry. My first three tests (of the a london street, landscape and large room) failed due to me not taking the pictures correctly . After taking photographs correctly, I tested several online services to a couple of desktop applications (discussed later in part two). All the on-line services were great for modelling an object or a façade of a building, but something as complex as a street just produced a mess of a point cloud. On the otherhand the desktop apps that allowed me to manual create matching marker sets between the photos generated good looking dense point clouds. These tools also allowed me to use several on-set measurements to correctly scale the model in their different axis.

Test of point cloud of my street
mysteetGrab

 

Importing this pointcloud to Nuke was ok – but far too dense to work with practically. If i was at this point handing this pointcloud off to a modeler or match-mover then my job would be done. But i wanted to see if i could automate generating textures and decimated models. This was great at low settings but when getting the software to produce fine detail my computer run out of ram (8gb is no way enough).

So… while i await the delivery of some more ram and a cloudy day to shoot my next Photogammatry location have a look at some videos of what other people are doing with photogammetry. I also list at the bottom of the page many of the available applications:

GALLERY
For a taste of what has been recently done with automated photogammatry:

[wpvideo bRqq80uZ]

3D From Images (SfM, Photogrammetry) in Digital Cultural Heritage / Nicola Amico (nicola.amico)Collect what you like from your Android devices thanks to the Pearltrees’ app

LIST OF APPLICATIONS

http://usa.autodesk.com/adsk/servlet/pc/index?id=11390028&siteID=123112
http://www.photomodeler.com/
http://cubify.com/products/capture/
http://homes.cs.washington.edu/~ccwu/vsfm/
http://photosynth.net/
http://www.visual-experiments.com/demos/photosynthtoolkit/
http://www.123dapp.com/
http://www.tgi3d.com/
http://www.ilexsoft.com/highdesign/photogrammetry.html
http://www.agisoft.ru/products/photoscan/professional/
http://www.kscan3d.com/
http://www.2d3.com/
http://www.photosculpt.net/
http://www.heliconsoft.com/
http://www.banzai-pipeline.com/product.html
http://homes.esat.kuleuven.be/~visit3d/webservice/v2/
http://insight3d.sourceforge.net/
http://homes.cs.washington.edu/~ccwu/vsfm/
http://areo.co.nz/
http://www.my3dscanner.com
http://ptak.felk.cvut.cz/sfmservice/
http://www.visualsize.com/
http://phototour.cs.washington.edu/
http://www.cs.cornell.edu/~snavely/bundler/
http://www.topconpositioning.com/products/software/office-applications/imagemaster

END

Part two of this blog series will explore some of the applications out there, as well as how to take photographs for photogammatry correctly.


Comments

Leave a Reply

Your email address will not be published. Required fields are marked *