We are proud to announce that ReconstructMe teamed-up with CANDELOR, our in-house solution for robust and fast object localization, to significantly improve the tracking experience of ReconstructMe.
The integration of CANDELOR allows us to greatly improve the following aspects of ReconstructMe
- Recovery of camera tracking
- Automate extrinsic calibration of multiple sensors
- Point-and-shoot 3D object reconstruction
Recovery of Camera Tracking
Until now, ReconstructMe assumed that the camera movement between subsequent frames is rather small. Violating this constraint threw ReconstructMe off the track and a manual re-location required the user to position the camera very closely to the last recovery position. While this mode works most of the time it can be tedious to find the correct position manually.
With CANDELOR we can weaken this requirement as its algorithms allow us to determine the correct camera movement for large displacements. This is possible as CANDELOR searches for similar features in the 3D data of the recovery position and the current sensor frame. Given a set of corresponding features a transform can be estimated that reflects the searched for camera movement.
The video below shows tracking with CANDELOR enabled and directly compares tracking performance with and without CANDELOR enabled reconstruction.
As one can see in the video recording of data is paused multiple times and the resume position is far off from the paused position. Despite the displacement of the camera, tracking is successfully recovered by CANDELOR.
Automate extrinsic calibration of multiple sensors
A nice benefit of using CANDELOR is that it now has become very easy to use multiple sensors working on the same volume. In traditional multi-sensor applications one requires a good estimate of the so called extrinsic calibration. That is the transformation between two cameras. This extrinsic calibration is often assumed to be fixed and not allowed to change.
ReconstructMe works differently. The initial extrinsic calibration of multiple cameras is automatically calculated by CANDELOR. Once both sensors have registered you can freely move the cameras into different locations. They will maintain calibrated via the data you record. The unique advantage is that multiple sensors can scan more quickly (divide and conquer).
In the following video you can see Christoph and me scanning a person using multiple cameras that work on the same volume.
Point-and-shoot 3D object reconstruction
We’ve added a new reconstruction mode based on global tracking: Point-and-shoot. It means that reconstruction of objects is performed only at specific manually picked locations. Especially for users with low-powered GPU/CPUs will benefit from this mode as it allows you to capture an object with very few positions. The video below shows how it works.
Despite the fact that only few positions are used for data generation, the model looks quite smoothed and closed.
We are confident that the new features will ship with the upcoming SDK and Qt within the next two weeks.
Happy reconstruction!
The ReconstructMe-Team
This is pretty exciting to see a high quality scan go so fast. Will this feature be incorporated into ReconstructMeQT?
Sure, within the next two weeks.
I’m still waiting to see SKD 1.3 features incorporated into ReconstructMeQt.
You will.
done, check the new release
Can’t wait. Having lots of fun with the current version but this update will make quite a difference in the success and quality of the scans.
Well done Christoph :)
Looks great – looking forward to using the new features!
Thanks for the feedback!
Very exciting! Any thoughts on when textures will be a part of the model?
Not exactly, but the good news is that we have enlarged our team and one guy will be focusing on that feature exclusively.
I’m pumped up – thanks for the new dev. Can’t wait to use it.
Just one or two more days.
“14 days ago” … still waiting :D
Is there planed an update for console too?
And can I buy Qt without SDK-Licence, or need them both for using Qt?
you just need Qt, no SDK. SDK is for developers only.
Pingback: New Releases | ReconstructMe
Hi, looks like I’m jumping on the Kinect train alil late looking at the dates of its release. I’m very new at this, Just learnt how to upgrade my GPU, (even learnt what a GPU is).I got me a sweet bad ass GTX770 being advised that this was the GTX680 on steroids and this was the advised” higher end” card required. Further forums reading suggests I might have over killed it but i would like to import as close to true, maximum detail 3D models into Solidworks to further manipulate and then of course export to 3D printer or CNC cutter. So I guess my questions are: 1) hat does a licence for latest Qt cost? 2)How long does it last? 3)What add on/prgrams/software are available to complete my “Kinect scan to solidworks transition” with maximum quality and trueness?
Spent the last 3 days batterling with the drivers install issue. Just got it running on ReMe. Have not tied anything else yet. 4) Any suggestion for this newbi??? Advice greatly appreciated.