Robot Hand Integration Test

by - 2012/04/18 75 Comments Development, Production

During these weeks before the filming and the actual work on the shots starts we are doing several tests to check out the production tools. One of them is obviously Cycles. In this particular test we wanted to see how far we can go with the integration of the robot hand in a shot.

Of course it is obvious that the hand is fake, after all it’s a robot hand, so we also put in objects that could in theory be actually standing on the table. We went for a mirror ball (because there was an actual mirror ball in the scene, so, easy to compare) and a plastic toy.

To create believable light and reflections we took a RAW image of the mirror ball and mapped it to the environment (anyone knows a tool to convert CR2 images to EXR, other than Aperture?). Cycles node-shaders allowed to adjust the amount of reflection and lighting influence of the environment material, as well as tint and contrast of the reflections.
The mirror ball rendered very fast and works quite well, even though not perfect at all. Integrating the little orange dragon also worked pretty straight-forward in terms of light.


The tricky thing however was the shadow. We wanted to create an extra challenge for us, so we put the little dragon both in sun and in shadow. It is always a challenge to merge a CG shadow with a real one, not only because you have to get the same intensity and tint, but also because of the transition area of CG and real shadow. During the work we realized that it is impossible to separate shadows from different objects from each other in Cycles. In Blender Internal it would have been possible to assign the shadow casting objects and the shadow receiving objects to different render layers, thereby controlling what object receives which shadow. But Cycles works differently, lamps shine “through” render layers. That makes some things easier, but other things harder, like controlling the shadows. Therefore Brecht has implemented a new feature, which lets you exclude certain objects from a render layer.

This gave us the control to have the little dragon cast a shadow onto the table, but also receive a shadow from a fake shadow-caster, but without that shadow-caster affecting the shadow-catcher (the table plane). With Blender’s compositing nodes we subtracted the actual shadow on the table from the fake one by using a Luma Matte.
But still, because of the camera motion and the motion blur, which results in some imperfections in the track, the trick with the shadow doesn’t really work in every frame. At some points you can see double-shadows, which totally gives it away. So, lesson learned: If possible, avoid CG objects being partly in real shadow and in CG shadow!

Another thing that we realized was that Cycles sometimes problems with glossy samples at glancing angles, which lead to noise that doesn’t go away even with 1000 samples. But having Brecht at the institute it was just a matter of one hour or so until we had a fix for that: blurring glossy rays that hit sharp highlights. I don’t really understand how exactly it works internally, but: it works!

Setting glossy blur to 1 helps to get rid of noise without any significant loss in quality. Also, clamping overly bright areas helps to get rid of fireflies. So we could reduce render time from almost 1 hour per frame to a few minutes. :)

So a big thanks to Brecht and Sergey for being awesome!

  1. Bill says:

    Image Magick has the ability to convert between formats, including Canon’s CR2 and OpenEXR. See: http://www.imagemagick.org/script/formats.php

  2. ctdabomb says:

    complex process :/

  3. “If possible, avoid CG objects being partly in real shadow and in CG shadow” Yup! Also learned that two days ago :)

  4. Matt says:

    I am in envy of all the really cool stuff going on at the blender institute these days. It blows my mind.

    I think some bump mapping and “dirt”/scratches/dents etc… will help push the final version of the robot hand over the top. It looks very “perfect” now.

    I was looking at some concept art for a pixar shorts in the bookstore the other day and John Lasseter’s modeling sheet for the telephone pole in “Birds on a wire” had notes all over saying “not regularly spaced” or “not perfectly round” to remind the modelers that real things aren’t.

    That said, I am thoroughly impressed with your work, and I thank you for posting. I get more excited for the final version of the movie (and the whirlwind of activity that will happen when filming starts).

  5. n-pigeon says:

    Great post very interesting!

    Thanks Brecht and Sergey.

  6. Thomas Rainer says:

    WOW Great Work

    Instead of Apature you could use Darktable this is a very god Raw Converter.
    Why did you not use a wide angle lens and take a HDR panorama that you stich with with Hugin, its advantage is that you have a perfect 360° enviroment map and not a distorted and only half one like the mirrorbal method.

  7. Dusty says:

    Well done Brecht and Sergey, and the rest of the team so far!

    Robot hand looks amazingly real!!

  8. ovidiu says:

    ok, first of all “hand is fake” is obvious because you know you put it there ;) (obviously!) – for me, it was because I read it in the title.

    I have to admit that, during the whole 9 seconds I’ve tried to figure it out if the other objects on the table are real or not!

  9. bydesign says:

    Great work, I couldn’t tell the other items were fake as well. But now that I know they are I noticed one thing that is different from the physical objects.

    You’ll notice that the duck toy, even though it’s in the shadow, is still casting a slight shadow on the table behind it. Same with the physical metal ball. The CG objects in the shadow do have some kind of AO or something, but are lacking the nice blurry shadow from the indirect light of the window.

    Keep up the great work!

  10. ronald says:

    for RAWs: rawtherapee

    for HDR: luminance (former qtpfsgui)

    both open source (?)

  11. Ben says:

    The guy reflecting on the ball doesn’t move :).

  12. Joster says:

    I know Luminance HDR can do CR2 to EXR conversion.
    But in my experience it doesn’t seem to be a straight conversion. I think the EXR it outputs is a tonemapped version, which sometimes clamp some value information and doesn’t match the look in other software like RawTherapee(which can not write a EXR file)

    And nice to see the glossy blur feature. I think it work like the reflection blur feature of MIA material in mentalRay? This would be really handy.

    • brecht says:

      Glossy Blur (maybe not a great name, still time to change it before it goes to trunk) is not like reflection blur in Mental Ray I think, that would be roughness on the Glossy BSDF.

      It’s a trick to avoid noise. I know some studios are doing something similar, but not if they do it the same way or if/how it is available in other render engines. There’s a more detailed explanation here:
      http://wiki.blender.org/index.php/Doc:2.6/Manual/Render/Cycles/Integrator#Tricks

      • Ben says:

        Thanks Brecht, I am a fan of you!

      • Joster says:

        wow it’s already documented!!
        Thank you Brecht.
        for these great information

      • Joster says:

        Sorry I got the name wrong.
        the feature I tried to mentioned in mental Ray is called interpolate reflection. it’s a different setting from glossiness. But after reading the document I’m not quite sure if it’s the same thing as the blur glossy.

      • Sam Schad says:

        You know, as some point, I am going to have to try some other software so that I can gain perspective. The problem is that every time I consider doing it, Blender changes again and there’s no need. One of these days I’m simply going to have to blame Brecht for stifling my creative development. :-)

        Thanks, as always, Brecht. Great job and thanks for keeping us hooked on Blender.

  13. francoisgfx says:

    You should also think about using gray ball to match lighting on diffuse only. It can help to setup spec, bump and so on… before bringing up colors and textures. It’s easier to match lighting on gray first.

    http://www.hdrlabs.com/tutorials/index.html#What_is_the_use_of_the_gray_bal
    http://www.hdrlabs.com/cgi-bin/forum/YaBB.pl?num=1264525246

  14. Sam Schad says:

    Sebastian-
    I’m mostly an idiot when it comes to getting shadows out of cycles- do you think you could post a high-res link to that node setup? That would be the bomb.

    Ahhhh… what must it be like to be a Blender Superstar? The rest of us can only dream! Looks like you all are having “fun”!

    • Dewald says:

      I would love to see the node setup and even the .blend file if at all possible.

      I think it is cery sucessful and totally sells the illusion. Very convincing. The only thing giving it away is definitely the robot hand and only because it is out of context.

  15. AnotherFellow says:

    Charmander is a flame pokémon and not a dragon pokémon.

  16. As someone who knows very little about CG it’s fascinating reading these updates and seeing things as you’re working through them. So complicated…

  17. postrock says:

    The only thought of these assets animated and in context makes me drool.

  18. Nabil Stendardo says:

    It might seem obvious, but dcraw (http://www.cybercom.net/~dcoffin/dcraw/) seems to be the best solution for RAW processing. It can output linear 16-bit (s)RGB to a TIFF file, which can easily be converted to an EXR.

  19. Sam Schad says:

    Also-
    I’ve been doing some pano creation recently and really can’t tell much of a difference (in Blender) between an EXR file and an HDR file. I know EXR can handle an alpha channel, but I have yet to see that utilized in Blender. And I know that EXR has greater color fidelity, so one would think that it should….look better?

    This was bugging me. I rendered out a HDR and an EXR 360 panorama at low res (3000px by 1500px (10+ exposure levels for the pano, so decent dynamic range b/n -4 ev and 4ev.)) Then I chucked it into Cycles and rendered one scene with the HDR and the other with the EXR. Here was the result: http://www.pasteall.org/pic/

    To be honest, I can’t tell much of a difference. I even split one in half in photoshop and laid it on top of the other. I toggled it off an on and there was no indication that these two were different. Other than file size and render time. (the EXR was a slightly larger file and slightly longer)

    My question to the team is: 1) is there a conscious choice to use EXR over HDR? and 2) will there be a situation (do you think) during Mango when you would actually need the alpha channel that EXR provides?

    Sorry for the long lead in- but this has been driving me nuts for a while. Thought someone might take it up?

    • riftmaster says:

      The image URL you posted was incomplete!

    • brecht says:

      The main thing EXR has over HDR is that it has multilayer support, and that it’s basically well integrated into the render pipeline in Blender already.

      But converting between HDR and EXR should be no problem. The difficulty is converting from RAW files, since those are camera specific and need to be ‘baked down’ to a format like EXR/HDR/TIFF.

      • Sam Schad says:

        Thanks for taking the time Brecht. The clarification is great. I’ll start rendering my panos to HDR instead.

        I’ve got some more tests to run, but I’m also getting to the point of realizing that (at least in terms of Blender), I might not need to be taking 10+ levels of exposure when I’m making panos. If you all are using RAW images, that should work fine for most situations.

    • brecht says:

      Also regarding fidelity, HDR is indeed compressed more than a typical EXR. In practice for environment maps it might not make much difference, but there’s no reason for us to use a different file format if EXR works ok and is used in other places in the render pipeline.

  20. stephen says:

    That wouldn’t be the new tile compositor by any chance? ;-)

  21. David says:

    Wow looks great! However my brother immediately noticed that the mirror ball was fake because he could not see the reflection of the camera man!
    Also not apparent in this shot but here: http://mango.blender.org/wp-content/uploads/2012/04/robot_hand_integration.jpg you can see that the reflection of the hand does not block the reflection of the vase. Instead it blends with it. CG reflections should be opaque not transparent.

  22. Joeri says:

    Looking good.
    I guess getting the real shadows right will be a pain.
    Even in starwars the shadows flip on and of per shot.
    Maybe film everything without shadows and cg them all in.

  23. Is there going to be a download for these new features? I’d find them very useful.

  24. Amazing video, hand job done perfectly. I’m waiting for the whole movie.

  25. Luciano says:

    please please the node setup for the SHADOW CATCHER just that is all i ask for :)

  26. Hi there Dear, are you really visiting this site
    regularly, if so then you will definitely get pleasant know-how.|

    Here is my web page – pit 2013 (http://programypity.pl)

  27. martial arts says:

    Thanks designed for sharing such a fastidious thought, post is nice, thats why i have read it fully

  28. You can certainly see your enthusiasm within the article you write.
    The sector hopes for even more passionate writers like you
    who are not afraid to mention how they believe.
    At all times follow your heart.

  29. Back says:

    Hi GavinI am mostly cnaiyrrg the camera either in my hand or dangling from my neck. I haven’t bought a special camera bag for it but I am looking into this When not shooting or just going to work, pub etc I am keeping the camera in my normal bag (messenger type bag). I feel the Fuji X10 is safe enough in this bag.I have to mention that I am a careful person with my gadgets, and I never had any serious mishap with cameras bumping into hard stuff, so I feel confident in risking the X10 in this way Good luck in your search for a suitable bag. Remember to provide space for one or two additional batteries!

  30. Hi there, i read your blog occasionally and i own a similar one and i was just curious if you get a lot of spam remarks?
    If so how do you protect against it, any plugin or anything you can suggest?
    I get so much lately it’s driving me mad so any assistance is very much appreciated.

  31. I am regular visitor, how are you everybody? This article posted
    at this site is genuinely fastidious.

  32. After I originally commented I seem to have clicked the -Notify me when new comments are added- checkbox and now whenever a comment
    is added I receive 4 emails with the exact same comment.
    Perhaps there is an easy method you are able to remove me from
    that service? Cheers!

  33. Very nice post. I just stumbled upon your blog and wanted to say
    that I’ve truly enjoyed browsing your blog posts.
    In any case I will be subscribing to your rss feed and I hope
    you write again soon!

  34. Lionel says:

    The real history of the application of the macaron is not 100%
    clear. Most of the games are geared toward children ages two to five years-old and all are informative.
    There are the warlocks, the male witches, of the present.

  35. Because Ps3 Jailbreak can download your games as a backup file for you to enjoy
    several times. It retains the SIII sturdy and light at the same time.
    You can improve your folders using this app.

  36. Link exchange is nothing else but it is just placing the other person’s
    weblog link on your page at appropriate place and other person will also
    do similar for you.

  37. For the interest of creating a related product comparisons, we
    have looked at routers in this variety that discuss similar
    aspects including IEEE 802.11n wi fi standards, 2.4-ghz band and double antennas.
    If you are searching for a new router, nothing less than an n router is highly
    recommended. It might be wise to update to some wireless n router, when you have a wireless-g router.
    The latest routers also increase speed with wi fi Quality of Service applications (QoS) standard,
    which makes efficient usage of Ethernet connections by prioritizing multimedia traffic based on the program’s sensitivity
    to delay. Many wireless-n routers additionally apply multiple-input and numerous-output (MIMO)
    radio antennae to increase speeds.

  38. Jailbreaking is the process which can be employed to achieve this.

    Nonetheless, when you want to look at films in high definition, the unit has a large amount of room.
    The key difference is more in the language.

  39. Deana says:

    I would suggest allowing it to sit in wet hair for approximately 30 minutes.

    Pistachios provide you with fiber to keep the body feeling full and
    satisfied for a longer period of time.

  40. Danilo says:

    There is a buzz of excitement attached with the flicks being
    released come early JULY. The initial came out in 1989 and the next came out
    in 2004. Ratatouille: ofcourse a rat isn’t quite exactly like a mouse!

  41. Puteți găsi unele resurse destul de bune de cuvinte cheie , care sunt gratuite , dacă executa doar un pic de anchetă .
    Primul lucru pe care o mulțime de oameni citesc din acest număr
    este titlul site-ului .

  42. Eso es simplemente porque algunos atributos clave se han quedado fuera .
    No se preocupe , es bastante fácil de conseguir
    de nuevo su fondo de chat en su teléfono. Sin embargo , el más popular no implica el más
    seguro.

  43. Google.Com says:

    I don’t even know how I ended up here, but I berlieved thi poist was great.
    I don’t know who you’re howver definitely you’re gling to a famous blogger in case
    yoou aren’t already. Cheers!

  44. ¿Qué es un smartphone con salida a Internet
    de mayor velocidad ? WhatsApp en el PC es capaz de importar
    los contactos de e -mail , y su cantidad. Sin embargo , otros
    servicios de mensajería tienen mucho mayor alcance.

  45. It’s really a dangerous world outthere, but preferably it just got a little
    less dangerous.
    Are additional network sites like Facebook and Twitter the
    new influx of web mingling?

  46. Nice post. I learn something totally new and challenging on sites
    I stumbleupon on a daily basis. It will always be useful to
    read articles from other writers and use a little something from other websites.

  47. Hello! Quick question that’s entirely off topic.
    Do you know how to make your site mobile friendly? My blog looks weird when browsing from my iphone4.
    I’m trying to find a template or plugin that might be able to fix this
    problem. If you have any suggestions, please share.

    Cheers!

  48. Verificați din nou mai târziu pentru mai multe cu
    privire la modul cel mai bun de a angaja publicrelations de a opera un vehicul SEO .
    Veți fi avertizat motorul de căutare pe internet
    este incepand cu prima indexare .

  49. Valuable info. Fortunate me I found your web site accidentally, and I’m shocked why this coincidence did not happened earlier!
    I bookmarked it.

    Here is my homepage carpet cleaning abbotsford Victoria

  50. This info is priceless. When can I find out more?

    Have a look at my homepage … Source Webpage

  51. As I said, I’m getting excited about the brand new
    release and my Windows 7 launch party. Then FarmVille provides you with an opportunity to stay a plantation life,
    if yes. Clean up the Registry problems within your process.

  52. Edward says:

    May I just say what a relief to uncover somebody who truly understands what they’re discussing on the web. You certainly understand how to bring a problem to light and make it important. More and more people ought to read this and understand this side of your story. I was surprised that you’re not more popular because you most certainly possess the gift.

  53. First, which means that you can start working with your pc far more swiftly after logon.
    Programs that break the etiquette and integrity of Apple
    would be the ones that get banned.

  54. The sections are translucent and have the cover tabs switched on. They claim
    you need to split the program. Follow ON HERE to obtain more details about the
    top Computer repair device in 2010.

  55. Comex, via twitter, said that he surely could reproduce the issues, and is
    working on a fix.

  56. When I initially commented I seem to have clicked on the -Notify me when new comments are added- checkbox
    and now every time a comment is added I get 4 emails with the same comment.
    There has to be a way you can remove me from that service?
    Appreciate it!

Leave a Reply

Your email address will not be published. Required fields are marked *

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>