Sportswear for Wheelchair Athletes

by Anke Klepser

Hi everyone,

Hohenstein research team for clothing technology works with 3D scanner systems since 1999. The aim is to take body measurements and geometrical data to provide important information for garment construction, product development and optimization.

One of our recentprojects was concerning sportswear for wheelchair athletes. Garment should be constructed for the specific target group. Therefore, focus was to analyze the change of dimensions and geometry due to specific sports movement and position. We used Kinect sensor and ReconstructMe software for acquisition of handcycling athletes in their sports wheelchairs. The system gave many advantages over stationary 3D bodyscanners: Being able to scan people during training times at different places and acquisition of athletes in handcycles.

We captured the athletes in two shots and merged the files as shown below.

Merging of 3D scan files

Merging of 3D scan files

One result was that due to the specific posture in the handcycle athletes do have a differing neck position (see image below). Therefore, collars of sports shirts should be constructed differently to prevent discomfort to the customer.

Differing neck position due to different posture in handcycle

Differing neck position due to different posture in handcycle

With the results of the research project companies are enabled to produce adapted sportswear fulfilling the special requirements of wheelchair athletes.

All images courtesy of Hohenstein Institute. If you have any questions please contact us a.klepser@hohenstein.de.

Structure.io sensor in ReconstructMe

The company Occipital has recently released their Structure sensor. We ordered one early this year and received it yesterday. Now we’d like to show you how you can use it together with ReconstructMe.

The Structure sensor is based on a PrimeSense Carmine / Capri 1.08 depth sensor and comes without an additional RGB camera module. Since it is PrimeSense based technology, a Structure sensor can simply be accessed via OpenNI, a framework developed by PrimeSense.

Setup

In order to use the sensor on Windows using ReconstructMe you should order one including the Hacker cable, which allows you to connect the sensor to a standard USB slot on your Windows machine. The sensor packages comes with an USB hacker cable, an iPad connector cable and a power supply to charge the built-in battery. For ReconstructMe, only the following parts are needed to get it run.

P1020512

Note that we didn’t need to charge its internal battery which we assume is only needed for iPad uses where additional power is needed to keep the sensor running.

To get the sensor recognized in Windows you need to install OpenNI. Connect the sensor via the USB Hacker cable to the USB slot on your PC. Your sensor should be recognized in the device manager as PrimeSense.

Next, start ReconstructMe. Once started, ReconstructMe will detect your sensor and you are (almost)ready to go. As with every sensor it makes sensor to calibrate it in order to get the best reconstruction results. Luckily we’ve already done this for you and provide a specific Structure sensor configuration file. To apply the configuration, navigate to Device / Sensor Selection. Uncheck Automatically detect sensor and browse to the sensor configuration file.

structureio-in-reme

ReconstructMe will re-open your sensor and now you are all set for scanning.

Results

In our tests the Structure turned out to be a decent depth sensor on par with a Carmine 1.08. Below is a video showing a quick self scan.

Enjoy scanning.

MiniMe3d is born thanks to ReconstructMe

by Corey Wormack

Every year our home has three young athletes who are awarded standard trophies at the end of each season. With the advances in technology we thought maybe 3D scanning and printing could offer a more personalized, memorable solution, but what type of system to use? To the internet, and after a lot of research, trial & error, and with the timely release of ReconstructMe version 2, we decided to build our solution around their software.

The new version allows us to 3d scan a person in color adding a new level of realism and allowing the final product to really stand out! After many hours and several different outfit changes, for the whole family, we developed a pretty efficient workflow and were ready for prime time! Our first chance to apply what we had learned in public was at a very large regional volleyball tournament.

We arrived the night prior to the tournament and tested our system in the large convention center lighting. Yeah – it worked! We were now ready for the hordes of sports fans to purchase our amazing piece of memorabilia. What we had not realized was that it would take customers a little while to warm up to the idea that they could have a “minime” of themselves with 3d scanning. Comments from “cool” to “creepy” with everything in between, but by the end of the show we had sales.

minime3d

So how did we configure our system? We had a laptop with an NVidia Quadro 3000M video card, Asus XTION Pro Live sensor, a modified manual turntable based on Fredini’s design, and a tripod.

Why were we successful? The ReconstructMe UI allowed people to see the process in real-time and as it quickly displayed the scan data. The fluorescent lighting only required some quick post processing cleanup of our captures. The final products were then sent into Sculpteo for color printing.

Where do we go from here? We look forward to the next version of ReconstructMe which allows the user to create great 3D print ready busts like the 180 displayed on the ReconstructMe website. This will simplify our work flow and allow us to have consistent results.

minimi3d2

Babe – The 3D Iguana

by Erich Purpur

The DeLaMare Science & Engineering Library at the University of Nevada, Reno has undergone some drastic changes. In the past few years and has become heavily used both as a place to study, as well as a makerspace. The notion of academic libraries incorporating makerspaces, which include collaborative learning spaces, cutting edge technology, and knowledgeable staff, has seen more interest recently and the DeLaMare Library has proven to be a popular and engaging model for the campus community.

Scan-O-Tron 3000

Lets flash back to December, 2013 when Dr. Tod Colegrove, Head of DeLaMare Library, presented the latest edition of Make Magazine to me. Inside was an article written by Fred Kahl, who had built himself a large-scale 3D scanning tower and turntable for the purpose of scanning large objects using ReconstructMe. Fred then took these 3D models and brought them to reality with his 3D printer. The DeLaMare Library had all the DIY capabilities to do the same and the process of building the scanning station commenced.

In 2012 Mary Ann Prall, a resident of San Diego, CA, lost her friend Babe, an iguana who died at the age of 21 and has been frozen since. Mary Ann was looking to preserve her friend in a new format and came to us in hopes of printing Babe in 3D. At the time we only had a small handheld scanner and with the help of our exceptional student employee, Crystal, we scanned Babe in sections and stitched them together in using CAD programs.

Mary Ann, myself, and Crystal with Babe.

Mary Ann, myself, and Crystal with Babe.

We invited Mary Ann and Babe back in April 2014 once we had completed the DIY 3D scanning tower. After mounting an Xbox Kinect Sensor on the scanning tower we purchased a single-use version of ReconstructMe and used it to scan Babe and created an accurate graphical representation. After taking several scans and playing with different variables, the results turned out great!

Me scanning Babe using ReconstructMe software.  Crystal and Mary Ann watching.

Me scanning Babe using ReconstructMe software. Crystal and Mary Ann watching.

Mary Ann happened to visit on a Friday, a popular day on campus for visiting prospective students. During the process many newcomers came in and we had the opportunity to spark interest in the visitors as well as many current University of Nevada students who happened to walk by.

Some UNR students admiring Babe.

Some UNR students admiring Babe.

We have not yet printed Babe but will in the near future. Last time around, Mary Ann had Babe printed as a small model but this time around we intend to print a much larger model.

BabeUpdate4

ReconstructMe and Multicopters (Part 2)

Since my last heads-up considering my project about a quadcopter for full autonomous indoor 3D reconstruction, I implemented a simple start and landing routine to make the first step toward full autonomous navigation. To achieve a smooth start of the motors, the autonomous takeoff routine starts with a set point 4 meters below ground and rises up to the actual scanning height. Landing follows the opposite approach with an additional step at 20 centimeters height to avoid crash landing.

Adding a first simple trajectory that consists of the start routine, followed by an arc around a point (center of the object you want to scan) and the landing routine, the quadcopter can now already reconstruct simple objects.

Trajectory tracking  deviation. Dashed lines are the set points, and the solid lines are the actual coordinates.

Trajectory tracking deviation. Dashed lines are the set points, and the solid lines are the actual coordinates.

By plotting the same data in 3D the trajectory becomes visible.

Trajectory deviation plotted in 3D

Trajectory deviation plotted in 3D

The arc shaped set point trajectory and the actual trajectory are clearly visible. The magenta colored lines show the heading of several intermediate points (should point to the center of the arc). As a benefit ReconstructMe SDK outputs the full reconstruction of the chair used for tracking.

Reconstructed chair used for tracking.

Reconstructed chair used for tracking.

I also made a video of such an experimental run so you can see the full autonomous quadcopter for indoor 3D reconstruction in action

A 3D scanner for Hunt Library (Part 2)

by William Galliher

Hello everyone! We are the 3D Body Scanner team at North Carolina State University, and we are here with another blog update to show two important things. Pictures and progress! That’s right, we have a mid-project update for you all and a bunch of pictures of the team, our work, and where our project will be once we have completed it. The sponsor for our project, and the eventual home for our booth, is the Makerspace team at the James B. Hunt Jr. Library.

The Hunt library is a showcase for engineering and technology, boasting large, open spaces provided by the bookBot system that houses all of the books in underground storage. The MakerSpace within the library hosts multiple 3D printers, and is dedicated to educating the patrons of the library in 3D technology. In comes our team. We told you about our purpose, to make 3D scanning fun and educational, in our last post.

Here are three members of our four person team.

From left to right: Dennis Penn, William Galliher, Austin Carpenter

From left to right: Dennis Penn, William Galliher, Austin Carpenter

The three of us are standing in our prototype scanning booth, which can rotate around the user. The other member of the team is below, where he is getting scanned using the alpha prototype of our software and station.

Jonathan Gregory, standing in the station

Jonathan Gregory, standing in the station

But don’t worry, not only do we have pictures of our team and the library, we also have progress. Our prototype station was able to successfully scan Jonathan, and the output mesh is below.

The scan of Jonathan Gregory

The scan of Jonathan Gregory

Pretty good for our alpha demo. We even managed to successfully scan the chancellor of our school, Chancellor Randy Woodson. Not only did we get a successful scan of our chancellor, we also got a small figure printed out!

The 3D print of Chancellor Randy Woodson

The 3D print of Chancellor Randy Woodson

So that concludes this mid project blog post. You got to meet the team, and even got a sample of what we are able to do so far. We cannot wait to finish this project and be ready for our Design Day near the end of April. We will be back then with a final post on our project. Thank you for reading!

All images courtesy of William Galliher and http://lib.ncsu.edu/huntlibrary

Idea Contest – Win a 3D Printer!

makerbotrep2Hello everyone!

We are proud to announce the first ReconstructMe idea contest, where your idea can win a 3D printer and other great prizes. To participate, all you need to have is a good idea. We’ve put together a short document describing the contest, the evaluation criteria and other things you need to know to get started.

Please note that the closing data is 15th of June 2014 19th of June 2014. In case your submission contains larger files, please upload them to third party services and refer to the material by linking.

Looking forward to see your submission!

ReconstructMe Large Scale Reconstruction – Development Insights

Recently we kicked off the development of a new feature. Large scale reconstruction. Our vision is to enable users to reconstruct large areas with low cost sensors on mobile devices. This post shows the initial developments in boundless reconstruction.

Many approaches could be applied to enable this feature. After an evaluation we finally decided for a solution which integrates nicely into ReconstructMe. That is, we translate the volume along canonical directions and keep track of the camera position in world space. Once we determine how to shift, we need to figure out when to shift.

We decided to go with the concept of what we call trigger boundaries that are relative to the volume. When a specific point crosses this boundary, the volume will be shifted. The first approach was to position the camera at the center of the volume. Once the camera position crossed the boundary, the volume was shifted. We found that this concept did not perform ideally, since the data behind the camera is allocated but most likely not captured and thus wasteful. After evaluating different options, we settled with the idea to specify the trigger point as the center of the view frustum in camera space. Again, when the trigger point crosses the trigger boundary the volume is shifted into the dimension of the cross occurence.

LargeScaleVolumeShift

In testing we faced the issue that ReconstructMe requires decent computation hardware and its rather tedious to move around with a full blown desktop PC or gamer notebook. Luckily, a old feature called file sensor helped us to speed up testing and data acquisition. Recording a stream of a depth camera does not require a lot of hardware resources and can be performed on Windows 8 tablets (Asus Transformer T100 in this case).

The streams were used to test the approach and to extract a colorized point cloud of the global scanned area. The tests showed a drift of the camera which was expected. Nonetheless, ReconstructMe is able to reconstruct larger areas without any problems if enough geometric information is available.

Based on our initial experiences, we plan to invest into more research in robust camera tracking algorithms, loop closure detection and mobility. Additionally we will need to settle with a workflow for the user interface and at the SDK level.

A 3D scanner for Hunt Library (Part 1)

by William Galliher

Hello everyone, we are the 3D Scanner team from North Carolina State University! For our senior design project, we are constructing a full body 3D scanner station for the Hunt public library here on campus. Hunt Library has a technology showcase and a Makerspace with 3D printers, and they are dedicated to showing what this technology can do. Unfortunately, many people who come in to the library do not know what this technology is capable of, and many printers take quite a while to print.

To solve this problem, and show off what can be done with the technology in this field, our team has decided to construct a 3D scanner that will scan a patron in less than two minutes. The booth will show the scan that is taking place and export the scan as a .STL which can be printed in the Makerspace within the library.

As part of the planning stage for this project, we spent time evaluating alternatives in hardware and software. In doing so, we came across the video for ReconstructMe 2.0 which showed two sensors doing a fast, real time scan of someone in a chair spinning around. At that point in time, our design encompassed moving a sensor up and down to get multiple levels on a scan. Multiple sensors along with the fast record time would allow us to move our original goal of a scan within five minutes down to below two, and so we decided to go with ReconstructMe.

The video that made the decision on ReconstructMe We are in the midst of constructing our station now, and recently got multiple sensor support and export of files completed. We have rapidly approaching alpha and beta demos, in addition to a final design day in late April. We will be back soon after that to show our final product. Thanks for reading, and see you again soon!

All images courtesy of http://lib.ncsu.edu/huntlibrary

ReconstructMe 2.1 introduces Selfie 3D

We are thrilled to announce that today’s ReconstructMe release includes a Selfie 3D technology, a feature that allows you capture 3D printable self-portraits. We developed Selfie 3D so you could simplify the process of generating 3D printable busts of yourself and your friends, just like the one below.

The current Selfie 3D feature is best used for generating head-to-shoulder busts. To use it, simply activate Selfie 3D and turn in front of your camera. The tutorial covers the basic steps and has some invaluable tips and tricks for creating the best possible busts. So don’t miss it!

Is the output directly printable?

Yes! Post-processing is fully automatic. We’ve put a lot of efforts into the automatic post-processing of your scan. Here’s what happens behind the scenes.

Making it watertight
Watertight refers to a property of 3D meshes that allows the 3D printer to determine the inside and outside of meshes. A mesh without holes is often referred to as watertight, because when you fill-up the inside with water, no water will drop out. ReconstructMe will enforce this property.
Creating a planar stand
ReconstructMe slices the model on the bottom to generate a nice planar stand of your bust, so that it does not fall over when being put down.
Fixing the orientation
ReconstructMe will place the origin of the model on the center of the base of the bust with positive z-direction pointing upwards towards its head. This will allow you to directly import the bust in your favorite 3D printer application or printing service and your bust should already be placed on the printer’s virtual platform.
Scaling it down
Since your 3D printer won’t be able to print you in full-size, ReconstructMe scales your model down to 20cm when saved. Note, the saved model dimensions are in millimeters.

Need even more info? Make sure to check out our blog post about ReconstructMe SDK 2.1 and stay tuned for further blog posts covering this feature.

How long does post-processing take?

Usually, post-processing takes between 15 and 25 seconds. The time increases on a low-powered machine or when you don’t have a ReconstructMe license. We used the Selfie 3D feature during the Long Night of Research, were we gathered over 150 scans in 3 hours. To view all scanned models, click the image below.

montage

Amazing, isn’t it? Tell us about your favorite scan! And don’t forget to download.

Download 2.1.348 for Vista/7/8

Weight Watching using ReconstructMe

by Francois Chasseur

Who would have thought that 3D scanning and printing could have a therapeutic effect? We recently discovered that quality per inadvertence.

It’s difficult to see our body changing, because we see it every day in the mirror. Even if the loss or gain of weight is great, it remains tricky to actually see it. Photos are often unrealistic due to light, exposure, camera, how you are posing.But you can’t lie to a 3D camera. For his huge weight loss, Sebastien called the services of VOUSen3D to make 3D-models of himself, which we achieved by building full body scans, using ReconstructMe.

Sebastien

Sebastien

In July 2013, Seb had a bariatric surgery (gastric bypass) and wanted to keep a more explicit memory than photos of his ‘rebirth’ as he says, his ‘refurbishing’, his new life. We met with him one week before his surgery, and every month since. After each scan he prints his new figurine out. You can’t ignore the evolution when they’re all standing in a row. These figurines are helping Sebastien a lot in his ‘psychologic’ healing: he can touch and see his progressive departure from obesity. He really knows where he’s coming from, where he’s going. When he’s looking at himself in the mirror, he doesn’t see an obese man anymore. He sees a healthier, more attractive man, with great self-esteem – which he is!

We wish you much courage Seb, congrats on the 50 lost Kg – only 30 more to go ;-) Enjoy your new life!

All images courtesy of Francois Chasseur and Sebastien

ReconstructMe SDK 2.1 Released

Hello everyone! We are proud to announce the availability of ReconstructMe SDK 2.1. The new version brings a lot of new features and fixes many issues we have encountered of the past months. You can get the latest version here.

The major changes are

Post-process your scan with CSG

We have added a constructive solid geometry (CSG) module that allows you to post-process reconstruction data using manipulative operations. These operations allow you to perform intersections, unions or differences between volume content and other objects. Currently, we support the following primitive objects

  • spheres,
  • axis aligned boxes,
  • and planes.

In the screenshots below you can see CSG operations (union, difference, intersection) applied to a box and a sphere.

csg_operations

All operations are performed on the volume and generate intersection free meshes when extracted. Additionally, we’ve added support for complex meshes. This allows you to easily add stands or cut your reconstruction. We used this feature extensively for automatically generating printable busts such as the example below.

We will go into more detail on how to automatically generate busts in upcoming blog posts next week. In the mean-time check out the CSG example for usage.

Use any RGBD sensor

Another feature we turned our development efforts on is to allow users to share a 3D camera resource with ReconstructMe. This means, that ReconstructMe does not enforce you anymore to use the sensors that ship with it, but you can roll out your own sensor implementation and provide ReconstructMe only the data it requires for reconstruction (this usually boils down to sensor intrinsics, a depth map and optionally an color image).

Using an external sensor allows you to use yet unsupported sensors in ReconstructMe. You might want to have a look at the external sensor example for details.

Browse the volume directly

Until now ReconstructMe SDK did not provide any means of directly navigating through reconstruction volume content. Users always were forced to explicitly generate a surface from the volume andsurface afterwards. This has now changed thanks due to the volume viewer. It pretty much boils down to placing the following lines in your code

reme_viewer_t viewer;
reme_viewer_create_volume(ctx, volume, sensor, "My volume viewer", &viewer);
reme_viewer_wait(c, viewer);

180 Amazing 3D Scans from the Long Night of Research 2014

Hello everyone! We had a great Long Night of Research last Friday with more than 300 people visiting us at PROFACTOR. And we scanned most of them! More than 180 people agreed to upload their scans to our site. Here’s a good example of what those scans look like.

Over the weekend we uploaded all models to our site and rolled out our very own 3D web-based viewer. The viewer should work with most modern browsers (expect probably Internet Explorer). If you see an error message when clicking the above play button, you probably need to update your internet browser or switch to a different one.

Entire collection

To view all scanned models, click the image below. Note those are rendered 3D scans, not photographs – no manual post-processing applied.

montage

Amazing, isn’t it? Tell us about your favorite scan!

Words on post-processing

As promised, we’d like to mention a couple of things for all the people who want to download and post-process their files. First of all, model files can be downloaded through our 3D viewer. For storage reasons ReconstructMe uses the OpenCTM file format for web downloads. In order to view or post-process the model, you will therefore need a tool that can handle OpenCTM files.

Although there many tools around we recommend to use Meshlab. It runs on all major platforms such as Windows, MacOS and Linux. Meshlab provides conversion between many file-formats and it is free to use.

Some people mentioned that they would like to turn their virtual models into 3D printed busts. You can do this by ordering your 3D print at a 3D printing services. In the recent years many such services have been created. The most famous ones are Shapeways and Sculpteo.

License

Unless otherwise stated, all 3D model files are licensed under CC BY-NC 4.0. This means you can share or adapt them as long as you give appropriate credit and don’t use the material for commerical purposes.

We’d like to conclude with another great scan.

ReconstructMe and Multicopters (Part 1)

by Gerold Huber

In the course of my master thesis in the fields of Robotics and Automation at the Johannes Kepler University in Linz (Austria), I am working at the PROFACTOR (the creators of ReconstructMe) since last summer. We wanted to set up a quadcopter for full autonomous tasks without external markers/sensors/cameras. The main challenge in this set-up is position estimation and tracking position accurately. After some struggling with a 2D flow sensor to determine the position, we decided to use a depth sensor in combination with the ReconstructMe SDK for position tracking.

Therefore, I implemented a mobile version of ReconstructMe. As you can see in the Picture about the system architecture below, a high level board streams the sensor information via WiFi to a groundstation running ReconstructMe. There ReconstructMe is used to build a global model of the sensor data. As a benefit, ReconstructMe provides complete tracking information of the camera to the high level board. The Flight Management Unit (Microcontroller) than uses this Position estimation from ReconstructMe in a raw manner to stabilize the multicopter.

MulticopterSystemOveriew

The entire process chain (sensor – data streaming – reconstruction – tracking streaming) takes about 120ms. It turns out, that this mobile version of ReconstructMe is sufficient for control and stabilization of a quadcopter as can be seen in the video below. Note that all cables visible are for power supply purposes.

Hardware used:

Software used:

Extending ReconstructMe with Measuring Capatibilities

by Sabine Winkler

We are a group of students from the Upper Austria University of Applied Sciences in Hagenberg (Software Engineering) and have teamed-up with PROFACTOR, the creators of ReconstructMe. For the last two semesters we have been working hard to create a tool that enables you to calculate the perimeter of an object as well as the distance between two points on the surface of the model.

The image below shows a slice through an human head bust and the resulting paths. All measurements are evaluated in real-time.

Measuring using a slicing Plane. All paths with their corresponding perimater are evaluated seperately.

Measuring using a slicing Plane. All paths with their corresponding perimater are evaluated seperately.

As you can see, it supports the calculation of multiple perimeters when cut with a plane aligned to two of the axes. The tool is able to recognize these perimeters completely independent from each other and highlights them in different colors. Think of it as a tool that can be used to load models from your file system, currently supporting PLY and STL file formats. This works by selecting a file from your computer or by passing a command-line argument.

Additionally, you can put two points anywhere on the surface of the loaded model to calculate the geodesic distance (the distance on the surface) between these points.

Geodesic distance between two selected points and the corresponding path.

Geodesic distance between two selected points and the corresponding path.

This can be especially handy e. g. for an orthopaedic specialists or anyone who wants to take certain measurements in ReconstructMe scans. We would like to thank PROFACTOR for letting us be part of the development process of new features and for providing us with support during this time.

A note from PROFACTOR
We are currently evaluating scenarios of adding this application, or functionality of it, to ReconstructMe and/or ReconstructMe SDK. If you happen to have the need for such a feature, we would love to hear about your needs, so we can design the functionality in best fitting sense.