Navigation

Showing posts with label Pureview. Show all posts
Showing posts with label Pureview. Show all posts

July 24, 2012

The iCamera (Nokia 808 Pureview) Part II: In the studio ;)

A still image taken in the studio by the Nokia 808 Pureview mobile phone
-- Please, click onto the image to access the uncropped full 38.4 megapixel image --


First of all, I'd like to clarify that this article isn't meant seriously. The Nokia 808 Pureview (808PV) isn't a studio camera. Medium format cameras and the Nikon D800E play in their own league when it comes to work in the studio. And they better do as the 808PV is positioned as a mobile phone ...

But just for the sake of having some fun, we can ask the question of how close the Nokia 808 Pureview (808PV) is actually being able to get to true studio cameras. And so we did :)

Above, you see "Young Fruits" in the studio, shot by the 808PV. I ordered some other young fruit but without going into to much detail, "Plan B" turned out to be it ;) You can click the above image to access the full resolution image. It isn't the JPG out of camera. It is the JPG after doing some post processing in Lightroom (no, the 808PV doesn't write RAW but this isn't a big problem for Lightroom). I basically improved contrast and adjusted colors a bit. I personally consider such things arbitrary as you can change settings in camera too. The image's EXIF data reads: 8.016 mm f/2.4, 1/100s, ISO 50. The image's physical size is 7.5 x 10.0 mm^2 (crop 3.45), i.e., the 35mm-equivalent EXIF data reads: 27.7 mm f/8.3, 1/100s, ISO 600.
It isn't actually simple to use the 808PV in the studio. This is the procedure I was going to follow:
  1. To save you a few hours of frustration:
    Do not use CameraPro, use the 808PV native camera app!
  2. Set the 808PV into creative mode, full resolution with 4:3 aspect ratio, super fine JPG, -1EV exposure compensation, sunlight white balance, ISO 50.
  3. The tricky part: Set flash to "Red eye reduction"
  4. Configure your studio flashes into slave mode.
  5. Focus with the Xenon flash allowed to act as focus assist, or with an external focus assist light source.
  6. Fire with 808PV Xenon flash:
    - either covered by paper to remove its effect from the photograph
    - or from a few meters distance where it appears darker
    - or alternatively enforce the ND filter which makes the Xenon flash appear darker too.
    The studio must be dark enough to make the 808PV use the flash at all. Because the "Red eye reduction" setting doesn't enforce flash in turn. The paper cover must not be too dark to hide it to the slave flashes though.
  7. Another tricky part: Your studio flashes need to be powered for f/2.4 ISO 50 (which is low power) or 3 stops higher power when using the ND filter (which is a bit above normal power, as would be used by ISO 100 f/9.6). But at the same time, the power must be low enough for your studio flashes to discharge twice within a fraction of a second. In my case, this required the flashes to stay at 1/2 power or below. Which I am perfectly happy with.
Following this procedure, the 808PV will fire the flash three times: a preflash to determine exposure, a first flash to make the eyes close and soon after, the final flash for the exposure which will have studio flash support again. The second flash will come too soon after the preflash to trigger the slaves. Some slave flashes can be configured with a trigger count. You can then use "2" and don't need the "Red eye reduction" setting. CameraPro seems to do the Red eye flash manually which implies that a second preflash is fired and synchronization fails. I had no problems to get the 808V to use anything between 1/100s and 1s exposure time. If you obtain faster than 1/100s or 1/200s exposure times though, you can dial in less than -1EV exposure compensation.

The 808PV has an ND8 filter which you can see with your naked eye when looking at the lens: there first is a protective glass, then a motorized protection shutter, then a motorized ND8 filter glass, and eventually there is the fixed aperture lens with focus motor (you can see the lens move forth and back). I wanted to make sure that the ND filter doesn't negatively effect image quality, so the image above has been made without ND filter. However, I have seen little or no negative impact of the ND filter on image quality. So, the above procedure may be easier to follow with enforced ND filter and I recommend to do so (if your studio flashes recharge quickly enough).


Result:

The results are pleasing. I invite you to click the image above to see the full size version. The quality is certainly good enough for most applications. And probably beats anything APS-C or FourThirds.

However, it isn't without quirks. First, enforcing ISO 50 is crucial. The pixels are small (1.4 µm) and therefore, the 35-mm equivalent sensitivity is ISO 600. I.e., the pixels aren't entirely noise-free and it doesn't help that they need some sharpening to get rid of diffraction blur. Moreover, the autofocus isn't fast and it isn't very reliable in studio modeling light (using the ND filter doesn't help either -- it is not switched off during AF ... ;) ). Therefore, the kind of studio work which would also use a tripod is quite feasible. But shooting is nowhere near as fast or reliable as with a dSLR.

Also, I had to ramp up the contrast a bit. It may be that the studio light from the sides create a little bit of stray light lowering contrast. Nothing serious though. And to be fair, the 808PV uses no lens hood :)

Look at the strawberry right to the peach, the bell pepper tip to its left, or the peach itself: IMHO, the level of detail is great.

However, before enthusiasm rises too high, I post the same subject shot with the Nikon D800E, for comparison:

A still image taken in the studio by the Nikon D800E 35mm digital SLR
-- Please, click onto the image to access the uncropped full 36.2 megapixel image --
While the level of detail in the image from the 808PV was great, it is simply stunning from the D800E. Just look at the peach'es hairs ...

So, while the 808PV delivers great results for static subjects in the studio which is good enough for professional use, it doesn't actually compete against the D800E or medium format. At least ;)

March 5, 2012

The iCamera (Nokia 808 Pureview) Part I





Why "The iCamera"?

Because in my opinion, this term would best describe what this camera is all about. Camera? Yes, I consider the Nokia 808 Pureview to be a camera (which happens to have an embedded phone), not the other way round. Nokia may not like this perspective. Not yet. Further down, I am going to explain why it is such a great revolutionary camera. But first, let me explain why I call it the iCamera. And no, I will not say anything about the iCamera's embedded phone function. Please, refer to Nokia for further details about the phone.

Remember the iPhone back in 2007? The year the 808 project was started? "It is an iPod, a phone, and an internet communications device". Some laughed at it, but it became the blueprint for almost every smartphone made since. And a big success. And what matters most: it came from a company who never did a phone before! Launched after years of hidden development.

Now, you have "a camera, a phone, and an internet communications device". Some laugh at it, but it may become the blueprint for almost every compact camera going to be made. It comes from a company who never did a camera before! Launched after years of hidden development.

Nokia may not realize what they did and actually may still screw it up. But if they play their cards right, they can create an entirely new market and rule it! A photography market. Just let's forget for a second that the 808 is also a phone. The iPhone is also an iPod. So what?

And so I call it the iCamera.


Why is it revolutionary?

A product becomes revolutionary if it combines existing technologies in a way that the result leapfrogs several generations of competing products and seems to contradict common wisdom. The 808 does this. Let me explain in detail now.

First, let me classify the iCamera. You need to read my paper about camera equivalence though. You'll find it here:
It explains how to correctly compare cameras when they have different sensor sizes. The 808 is two different cameras at the wideangle and the long tele end. And another different camera in video mode. I give three 35mm equivalent cameras at both ends now (ISO are the minimum equivalent values), followed by 5 other cameras serving as a reference:
  • Wide iCamera:      28mm/8 iso640 (38MP, 169g)
    exact: 38.4 MP (4:3), 27.7 mm, F8.3, ISO 690 (crop 3.45)
  • Long iCamera:      77mm/22 iso6400 (5MP, 169g)
    exact: 5.0 MP (4:3), 76.6 mm, F22.9, ISO 5300 (crop 9.55)
  • Wide video iCamera:      26mm/8 iso640 (HD, 169g)
    exact: 2.1 MP (16:9), 25.7mm, F7.7, ISO 590 (crop 3.2 wrt 4:3)
  • Apple iPhone 4:      29mm/22 iso4800 (5MP, 137g)
  • Wide Olympus E-P3 + 14-42/3.5-5.6II:      28mm/7 iso400 (12MP, 481g)
  • Long Olympus E-P3 + 14-42/3.5-5.6II:      84mm/11 iso400 (12MP, 481g)
  • Wide Nikon D800 + 24-70/2.8G:      24mm/2.8 iso50 (36MP, 1800g)
  • Long Nikon D800 + 24-70/2.8G:      70mm/2.8 iso50 (36MP, 1800g)
Please, refer to the Nokia White Paper for the 808 specification and further details.

Even though the tele effect (Long iCamera) is achieved via simple cropping, it is equivalent to a different camera. Very much like a zoom lens which yields different focal lengths and apertures at both ends. Equivalent means you should expect the same indistinguishable image quality from a full frame 35mm camera with the given specification. Please feel invited to read the paper above to understand the details (applies to Nokia employees too: please understand why your way to zoom via crop is not equivalent to a constant aperture zoom).

In a nutshell: the above list allows for a direct, quick and no-nonsense comparison of available products.

And it shows that the iCamera is physically very close to a mobile smart phone (actually, Nokia says it is one) but its optical performance is rather close to a mirrorless system camera, only significantly bettered by a big full frame SLR with a fast lens.

So, in optical performance, the iCamera leapfrogs all mobile phone and P&S cameras, while in resolution, it additionally leapfrogs all mirrorless system cameras and even APS-C SLRs.

Of course, in order to make this claim, we have to check if the 808's lens is up to the task. So, let's refer to some sample images which have been published already

Image taken with the Nokia 808 Pureview (the iCamera). © 2012 Nokia (click to access original)

The above image is taken with the Nokia 808 Pureview (the iCamera). The image is mildly post-processed by me in a way typical for other photo cameras in JPG mode (the image is a bit sharpened and noise-reduced) to provide an easier reference for a direct comparison (the 808 seems to apply no or almost no post-processing to its results which is a good thing for photo enthusiasts).

The above image is an example of good image quality for a mobile phone or almost acceptable image quality one would expect from a system camera with a kit zoom. Most details are resolved but there remain a few sharpening/denoising artefacts.

So far, this is nothing spectacular or worth talking about.

But what if I tell you that the above is an 18x crop (1:1 or 100% crop) taken from the following image?

Image taken with the Nokia 808 Pureview (the iCamera). © 2012 Nokia (click to access original)

The above is the full and same image as shown above! Only resized to the typical web size. And now and immediately, you may understand why the iCamera is like no other camera before!


The Zeiss lens

Moreover, this example clearly shows that the lens is up to the task and able to resolve the incredible resolution of the sensor. Closer inspection of the original images reveals even the corner resolution is  good even if it doesn't fully resolve the sensor, still beating most other available cameras in the corner. A more complete analysis was done by Werner Ruotsalainen: Nokia 808 resolution tests. He concludes that even the smaller 5 MP images from the 808 beat 10 MP images from a P&S in resolution! And there are reasons to believe this to be true.

But how can a mobile phone lens resolve such tiny detail? Good question. As I explain in my paper about camera equivalence, it becomes increasingly harder to resolve many pixels when shrinking the sensor size.

But famous lens maker Zeiss did an incredible job solving this problem: By glueing 5 lenses together into one group, all having aspherical surfaces and one using ED glass, they created a lens with unprecedented optical performance and very tight manufacturing tolerances. The problem is larger than it appears: The lens aperture is only 3.34mm while the image circle 8mm further down the optical axis is a whopping 12.5mm, almost 4x the aperture. If the aperture were as large as the image circle, this would be an f/0.6 lens! So, the lens elements nearer to the sensor are larger than they appear when looking at the camera front. Such a lens must be mounted to the sensor assembly on extremely tight tolerances or it is decentered. We have to keep in mind that the iCamera's lens is diffraction-limited at F2.4! Nokia uses a live manufacturing method where live view from the camera is used to fine calibrate the lens when assembling the sealed camera module. That's fairly innovative by itself and definitely virgin territory. This method won't work for an interchangeable lens camera. More on this below.

UPDATE 2012, March 5:
Today more information about the lens was made available by Nokia and Zeiss.
Zeiss 808 8mm/2.4 lens
source: http://conversations.nokia.com/2012/03/05/nokia-808-pureview-carl-zeiss-science-of-making-the-perfect-lens/
The lens is depicted in the image above and as it said in the source, it is made from a special plastics rather than glass. This is only possible for small lenses like the one in the 808 but has the advantage that much more complex surfaces can be made to precision. That seems to be part of the recipe how to achieve the high optical performance despite the small footprint. END OF UPDATE.

So, we conclude that the optical performance figures are hard to believe but they seem to be real.

But this isn't everything yet. We saw that the wide iCamera is equivalent to a camera with rather low ISO setting. So, it should have good dynamic range. And indeed, this seems to be true. I treated the above image in an HDR manner and came up with the following result:

Image taken with the Nokia 808 Pureview (the iCamera). © 2012 Nokia (click to access original)

The above is is still the same image as shown above! But now we used the iCamera's dynamic range to heavily boost shadows to illuminate the black regions of the original image. That's not normally possible with images from mobile phones.

The reason why this works is that the iCamera has a large sensor, much larger than mobile phones or P&S cameras. It is almost as large as the sensor in the mirrorless Nikon 1 system cameras. The equivalent camera parameters express this as an equivalent ISO value of 640 which is known to be good enough to have enough headroom for extending an image's dynamic range (like I did above).

I hope that all the text above answered the question why the iCamera is indeed revolutionary.


One more thing ...

It wouldn't be The iCamera if there wouldn't be one more thing ... :)

All still photo cameras have the problem that the sensor has many more pixels than there are in HD video. But it is hard to read out all pixels of a still image (10 MP or more) 24, 25, 30 or even 60 times a second. Therefore, still cameras only read a small fraction of its pixels to make the video stream, known as subsampling or line skipping. The effect is a significant degradation of image quality in video mode: there is noise, line flicker, color moiré and the result is no match for HD content produced with so called 4k cameras or cameras with supersampling such as the Canon C300. Such cameras cost $15,000 or more (a notworthy exception is the Panasonic GH2 though which made it the camera of choice for serious video work on a budget).

And what shall I say? The iCamera does it too, not supersampling 8MP (C300) or 16MP (GH2) but supersampling all 33,593,616 pixels (16:9) 30 times every second! That's one billion pixels the iCamera processes every second. In a mobile phone. This is crazy!

As a consequence, the wide iCamera could have the same good low light capabilities in video mode as the legendary Canon 5DmkII which does line skipping, but without the Moiré and line flicker problems.

And because no graphics processor (GPU) obviously can handle this data rate (otherwise, HDSLRs would be able to do it too), Nokia designed a special chip (the scaling processor) which sits in the camera module between the sensor and the GPU. And Toshiba managed to make a sensor which can output the equivalent of 8 GBit/s. So, there is a large CMOS sensor, a scaling processor, a graphics processor and the ARM CPU chewing each others output to get the job done.


The people behind

Nokia was kind enough to emphasize the role of three persons in this project:

Eero Salmelin and Juha Alakarhu (Nokia "pureview inventors")
Source: http://conversations.nokia.com/2012/02/29/zooming-in-on-nokia-pureview/
Damian Dinning (Nokia "imaging guru")
Source: http://conversations.nokia.com/2012/03/01/nokia-pureview-qa-with-damian-dinning

I believe that the creation of the iCamera was driven by opportunity rather than strategic planning. Nokia decided to give engineering green light to pursue the project and see where it leads to. And I guess they are still watching. The Nokia press conference only "mentioned" the 808. And that's the real difference between the iCamera and the iPhone: the iCamera isn't top-level driven, it is not born out of vision from the leaders. It is born out of engineering vision and often, this is not enough.

So, here is my humble advice to Nokia managers who are only watching the 808:


Implications

The iCamera is such a groundbreaking device that Nokia must no longer consider themselves a phone maker.

The iCamera is such a groundbreaking device that Nokia must no longer consider themselves a phone maker.

( I said it twice on purpose.) Like the iPhone made Apple drop the "Computer" in "Apple Computer", Nokia may consider to drop the "Phone" in their brain. They may continue building great phones just like Apple continues to build great computers. But now, they have to become a camera maker and whatever this leads to. Nokia engineers may have understood it already: They provide a tripod mount and a decent camera user interface.

It is useful to consider what the iCamera could be in another form factor (less phone like) and to remember that interchangeable lenses wouldn't necessarily deliver (cf. above). The "lens module" concept then comes to mind. Where a lens module is exactly what the camera module is in the 808: A sealed module containing lens and sensor. And therefore, a system camera would become:

A mirrorless interchangeable module camera (MIMC).

Nokia wouldn't be first (Pentax Ricoh Imaging with their GXR line is first). But an 808-based MIMC would be the first camera where this concept actually makes sense: Because it delivers a level of performance not possible otherwise. And at an attractive price point considering the Nokia 808 minus the phone isn't more expensive than a system camera's lens.

Nokia could create the future and dominant kind of camera market between the phone and 35mm full frame system cameras. And they could reestablish a European camera industry just like Apple revitalized a dying US phone industry. There are good cooperation partners to the task, like Zeiss or Leica. Nokia may even consider to make a GXR module to test the waters.

Anyway, personally I plan to release more parts to this article after I got the chance to run some laboratory tests. It will be exciting to see what all of this leads to.

Enjoy your iCamera.