Navigation

July 21, 2010

LumoLabs: Shutter-induced blur with an SLR camera



A recent observation made by us and others was that shake reduction efficiency for the Pentax K-7 camera seemed to have a weak spot around about 1/100s and less. Something nobody could really understand and not everybody was able to confirm.

Therefore, we decided to try to answer an old and fundamental question for SLR photography: To which extent does the mechanical focal plane shutter and the mirror slap negatively influence image sharpness? Especially in the digital age with its theoretically rather high image resolution. We, this means two friends (Henning and Rüdiger) and myself (Falk). And of course, we decided to focus our study to the Pentax K-7 SLR camera in order to provde an answer to the observation mentioned above.

The short story is that we managed to find the answers. All our findings are written down in detail in a LumoLabs White paper:

-> http://www.falklumo.com/lumolabs/articles/k7shutter/index.html.

Please refer to this document to actually understand the work we have done. In the following, we will summarize our findings without explaining how we got there. However, note that 4 different camera bodies, data from 4 testers, 8 lenses and two firmware versions have been used. More than thousand test shots and several thousand accurate blur data measurements have been aggregated. High speed video, acoustic recording and acceleration measurements complement the data. So, we assure that the result describe the general behaviour of a Pentax K-7 SLR camera. Pentax has obtained a copy of the paper to be used at their discretion.

We will make no statement about how the results relate to other SLR cameras. Except for a quantitative comparison with one Pentax K20D SLR camera.


Results:

  1. The mechanical focal plane shutter indirectly can increase the blur in an image. The exact amount of additional blur depends on the direction in the image. It is zero at a vertical contrast edge (aka yaw blur, blur due to yaw movement). And it is up to 11 µm (on average) at a horizontal contrast edge (aka nick blur, blur due to nick movement).

    The exact amount of average blur is shown in the opening figure of this article. It has its maximum for shutter speeds of about 1/100s to 1/80s. It is less than 5 µm for 1/25s and slower. Or 1/250s and faster.

    Note that any single image can be affected more or less. Add or subtract +/-50% to get an idea of variation from image to image.

    Note that one pixel is 5 µm large and the blur effect is only visible if all other sources of blur are very well under control (sharpening, defocus, shake, subject blur, lens abberation, noise etc.). Normally, these other sources mask the effect. Nevertheless, if you want tack sharp images then you need to understand the shutter blur effect.
  2. The effect for the Pentax K-7 is larger than for the Pentax K20D. About 2 - 3x larger.
  3. Mirror slap or shake reduction have no negative or positive impact on the effect. Shake reduction works as advertized but cannot counteract the perturbation from the focal plane shutter as it is too fast really. Mirror slap is very well dampened in the K-7 camera and has no negative impact on image resolution except on a weak tripod.

    There is a delay of about 10 ms between end of mirror slap and begin of shutter operation which suffices to keep the mirror slap perturbation out of the image.
  4. The blur effect is an indirect one:

    First, the moving masses of the shutter (curtain etc.) make the body move (with surprising speed and acceleration of its stiff body!).

    Second, the body movements cause a classical blur effect lasting as long as the shutter works. The K-7 shutter is faster and stronger than that of the K20D probably increasing the effect by some 60% or so.

    Third, the body accelerations cause additional vibrations in the imaging sensor which last a bit longer than the first shutter curtain operates and which magnify the effect by another 60% or so.

    Preventing the first from happening (which requires a heavy and sturdy tripod) will kill the effect. There is no "loose" magnetically held imaging sensor and no negative direct impact from shutter curtain or mirror slap causing air flow in the mirror box or whatever.
  5. In practice, you'll only see any effect with wide angle lenses.

    At about 1/100s you would normally have blur due to free-hand shake (we can ignore the case of a tripod as only weak tripods would cause any trouble with the shutter). At 50 mm and longer, the shutter blur will be masked and at 30 mm it will have comparable magnitude. It is at 10-20 mm that the effect will be noticeable most.

    In these cases, we highly recommend to shoot at 1/25s (or slower) and to enable shake reduction as it is highly efficient at such exposure speeds. The images will be sharper than at 1/100s!
  6. Early efficiency tests of the K-7 shake reduction suggested that it may be ineffective at fast shutter speeds as required for long focal lengths. This was a preliminary conclusion we proved to be wrong.

    The Pentax shake reduction is effective even at 1/500s! It just cannot prevent the shutter blur at about 1/100s. We may soon publish an update to our SR guide reflecting this.

So, here you have it in a nutshell. Please, refer to the full paper before asking questions. The paper is available as HTML and PDF (linked from the top of the paper). It is recommended to download and read the White Paper on "Understanding Image Sharpness" first.

UPDATE (2010 July, 28):

We checked if the new firmware release 1.10.00.25 released earlier today brought an improvement. The answer is NO.

We've run a number of measurements and within the limits of our very good measurement accuracy (about 0.10 to 0.15 pixels error margins) we cannot see an improvement.

[end of update]

Frequently Asked Questions:

Q: Did you study the K-x, do you know if it has a similar effect?
A: No. But anybody is invited to replicate our study for the Penatx K-x :)

Q: Is the shutter blur in the Pentax K-7 a defect?
A: No, any SLR shutter for any make causes blur to some degree. We just wished for the Pentax K-7 that it would be as small as it is for the K20D. We publish this partly to remind all camera makers that we watch their work ;)

Q: Does switching off shake reduction lead to sharper images?
A: No.

Q: Does mirror lookup work around shutter blur?
A: No.

Q: Does a tripod work around shutter blur?
A: Sometimes. If it is rock solid. A normal tripod most likely won't help much.

Q: Why does a longer exposure time work around shutter blur?
A: Because during the majority of the exposure, the shutter won't move and what you get is an average blur.

Q: Why does a shorter exposure time work around shutter blur?
A: Partly, because there simply is less time for anything to blur. Partly, because stimulated vibrations cause no harm after the shutter already closed.

Q: May I ask questions without reading the White paper?
A: No.

Q: But I don't understand the White paper!
A: How do you know without reading it? ;)

Q: Will you win a Nobel price for this crazy shit of work?
A: No. Alfred Nobel forgot photographers ;)

Further reading:

Enjoy the read ;)

July 14, 2010

Philipp Lahm Wedding



Philipp Lahm is team captain of German national FIFA football team, who just scored third place at the FIFA world championship in South Africa.

First thing he did when he came back to Munich was to marry his bride, Claudia Schattenberg. And as luck would have it he selected the St. Emmeran church of Kleinhelfendorf to do so. Just some of hundred meters away from where my studio is located.

So, I decided to play paparazzo and see what I could grab as a photo.

No question that about hundred true paparazzi were blocking my sight and -- as the number of them exceeded the population of Kleinhelfendorf ;) -- theirs as well. I can only say:

Bring your own ladder!


I am glad I don't have to earn my money this way. As soon as the bride entered the church, they started to run each other over in an attempt to be first to upload the photo. Of course, the 3G/UMTS infrastructure of Kleinhelfendorf wasn't really meant for this use case. To see scores of paparazzi left in frustration is a priceless experience :)

Also, chatting with some of the photographers, TV teams and moderators was interesting. I now have a better idea of the amount of money changing hands on events like this. Needless to say that the right to officially take photos was sold exclusively upfront.


Despite the competition for sight, I tried my luck and here is what I managed to achieve. Enjoy :)


















(Click on the images to enlarge. All photos © 2010 Falk Lumo. No reprint or linking without permission. All and more photos available in high resolution.)

Just a closing remark after you have seen the images... I used my mountain bike to be ahead of the horse drawn wedding carriage on its path thru small and rural roads. After a few kilometers only I've seen no more paparazzi photographers. They don't try as hard as one would imagine... ;)

June 17, 2010

LumoLabs: Understanding Image Sharpness

We have prepared our first White Paper. It shall serve as a base to better understand our methodologies to measure image resolution and more importantly, it is meant to help understand what factors can prevent an image from turning out tac-sharp.


LumoLabs website

We changed the layout of our site too.

LumoLabs is now at www.falklumo.com/lumolabs and hosts a repository of articles.

Therefore, we will use the blog to announce new articles or important updates to followers and interested parties. And to enable their discussion.

The actual articles are not posted as a blog article as its format was deemed unsuitable. But you'll find links to both the online article and a printable PDF version. If possible, we always recommend to download and read the PDF version. The PDF version does update more frequently too ;)


Understanding Image Sharpness


(Sample chart form the article)
Hint: The article image URLs actually open as larger images as they appear embedded in the article.


This article is a recommended read for anybody loving to dig into technology and who isn't afraid of a bit of math.

It's abstract and table of contents is:

Abstract
This White Paper is one in a series of articles discussing various aspects in obtaining sharp photographs such as obtaining sharp focus, avoiding shake and motion blur, possible lens resolution etc. This paper tries to provide a common basis for a quantitative discussion of these aspects.

Table of Content
1. Measures
1.1. Modular Transfer Function
1.2. Blur
1.2.1. The hard pixel
1.2.2. The perfect pixel
1.2.3. The real pixel, sharp and soft
1.3. More realistic resolution measures
1.4. Combining blur
2. Sources of blur
2.1. Defocus
2.1.1. Ability of deconvolution operators to reduce defocus blur
2.2. Bayer matrix and anti aliasing
2.3. Diffraction
2.4. Lens aberrations
2.4.1. Defocus, Spherical aberration, Coma, Astigmatism
2.5. Shake
2.5.1. Measuring shake
2.5.2. Expected shake
2.5.3. Empirical results
2.5.4. Tripod classification
2.6. Motion blur
2.7. Noise
2.8. Atmospheric perturbations
2.9. Precision and calibration
3. Practical considerations and examples


Please, proceed here:


 

June 10, 2010

Apple iPhone 4 camera specs



On 2010, June 7 His Steveness has introduced the Apple iPhone 4 which features a new camera module. Two actually but I am going to talk about the main camera (on its rear side) only. And only about its still photography capabilities (it records 720p 30fps HD video as well).

It is typically hard to figure out the exact camera specification for cell phones and to compare them with a P&S camera. E.g., the HTC EVO 4G is said to have an 8 megapixel camera but little else is known. Images shot with the EVO all lack the significant EXIF information!

However, I think I managed to extract the full iPhone 4 camera specs now.

First, the pixels are 1.75 µm (according to Job's keynote) and we may assume that this is the pixel pitch. Sample images are 2592x1936 pixels (5.0 MP, 4.02:3). This makes a 4.54 x 3.39 mm^2 chip (5.67 mm diagonal) which corresponds to a 35mm film camera crop factor of 7.64.

In a P&S, this would be called a 1/3.2" sensor and P&S sensors range between 1/3.8" and 1/1.5" (crop factors between 8.6 and 3.9). So, it is an imaging sensor at the lower end of the P&S range, but it is in the P&S range and with a reasonable number of pixels and a back-illuminated sensor like the Sony Exmor R sensor. Here is a sample image from Apple's web site:


(click on the image for the sample in original size; hosted on apple.com)

Gizmodo.de has published the full EXIF data for exactly this sample photo (it is magically absent from the web sample though ...):
Aperture: 2.97
Color space: Uncalibrated
Date and time: 2010/05/07 15:14
Exposure: Auto exposure
Exposure time: 1/887
Flash: Flash did not fire, auto mode
FNumber: 2.8
Focal length: 3.85
ISO speed rating: 80
Metering mode: Spot
Sharpness: Hard
White balance: Auto


So, the lens is a 3.85 mm f/2.8 lens.

This corresponds to 35mm film camera equivalent lens of 29.4mm f/21.4.

I should note that even an aperture this small is not restricted by diffraction yet (limit at f/2.8 is at 54% of pixel width). This is a good value. But one really shouldn't stop down beyond f/4 and it seems the iPhone 4 has an f/3 fixed aperture lens anyway.


Summary

iPhone 4 main camera:
  • 5.0 Mpixels (2592 x 1936)
  • 1/3.2" back-illuminated CMOS sensor
  • 4:3 aspect ratio
  • 35 mm film camera crop factor: 7.64
  • Low ISO 80 (or better)
  • 3.85 mm lens focal length
  • f/2.8 lens aperture
  • Autofocus: tap to focus

Equivalent 35mm film camera and lens:
  • 30 mm f/22

So, don't throw away your FourThird, APS-C or full frame SLR ;)

Besides the deep depth of field, an f/21.4 aperture at ISO 80 produces as much noise as an f/8 lens at ISO 570 (for a given shutter speed). Where 35mm film camera f/8 and APS-C f/5.6 produce the same level of noise.


Conclusion

The iPhone 4 seems to have a camera which should deliver an image quality on par with the lower segment of P&S cameras. It's field of view (no zoom!) corresponds to a 30mm lens (on a 35mm film camera) and it captures as much light (produces as much noise) as a system camera with a lens aperture between f/11 (FourThird) and f/22 (35mm film).

April 14, 2010

Pentax shake reduction revisited

Update (April 18, 2010) Breaking News

The entire blog article may only apply to Pentax K-7 with firmware up to 1.00.02.xx with yet to be determined xx. Rüdiger from a German forum has done more measurements with 1.03 which seem to indicate this. I'll keep you updated.

End of Update.


This is a first for me. Because I am going to write about results obtained by others.

Nevertheless, I hope to be able to shed some new light onto an old question: How well does the Pentax shake reduction system work? The result may be surprising which is why I post this article.


1. Information sources

1.1 First and foremost, the admirable work by P. Smith for the Pentax K-7:
- Study of the Effectiveness of Shake Reduction in the Pentax K7
- Discussion of the above original work

1.2 Article by German magazines:
- ColorFoto 7/2008 "8 Bildstabilisatoren von 8 Herstellern"
- Pentax measurement chart contained therein
- ColorFoto 1/2010 "14 Bildstabilisatoren" (only available as print, pp.26-32).

1.3 Own work:
- Quick tests with my K-7
- Re-evaluation of data originally published by P.Smith
- Proposed mathematical model

Let me add that all data I am using (except my own quick tests) are based on a careful examination of edge blur widths (and their variation). Note that edge blur widths can be computed with high subpixel accuracy using the slanted edge method as all sources above do. They compare the shake (motion blur) with static blur caused by the sensor and lens too. Comparisons based on "percentage of useful shots" are not meaningful enough and therefore, haven't been used.

The work of P. Smith uses the Smith shake device aka as his body. The work of ColorFoto uses Steve aka Stabilization Evaluation Equipment which is an apparatus build exclusively for ColorFoto magazine. It was set to a mean shake frequency of 4 Hz and 0.2° amplitude. AFAIK, the shake isn't harmonic which is good.


2. Scope of the work

Aquiring a better understanding of the Pentax SR system. I am not in the boat to examine the 1/100s "SR bug" some report for the K-x and others deny. However, my article may help decide what is a bug and what isn't. My article will also help understand the performance differences of a sensor based system vs. an optical system.


3. A little background

Pentax uses sensor shift-based image stabilization (SR aka shake reduction). It is based on two (or three) angular velocity (gyro) sensors. More about the sensors:
- maRata Gyrostar ENC-03R

The measured angular velocities means that the body knows how the lens pointing direction is shaking and can shift the sensor to compensate. Unlike in-lens systems, it can even compensate for rotations around the axis which are not to be neglected. P. Smith has compiled a number of documents from the Pentax patent application:
- Pentax patents collected by P. Smith

Vendors with sensor-shift based image stabilization include Olympus, Pentax and Sony. Vendors with lens-tilt based image stabilization include Nikon, Canon and Sigma. A few lenses with lens-based stabilization for Pentax exist from Sigma. All systems are actively powered.

It is commonly accepted that neither system is superior to the other. I'll spend a few words on this later. No existing system works in the macro range. Canon has filed a patent requiring additional sensors to address this.


4. A fresh look at existing data


© 2010: measurement data: P. Smith; chart: F. Lumo.

This plot shows the blur width (in pixels) due to shake induced motion blur as a function of exposure time (in milli seconds; e.g., 1/125s = 8ms). The data is taken from the work by P. Smith as cited above. The red curve above is without shake reduction, the green curve is with shake reduction enabled. The thin lines denote upper and lower error margins (based on standard deviation and N=10 sample size). The dashed lines denote a fitted linear line thru the origin.

The camera used (Pentax K-7) has 5 µm pixels and the lens (Sigma 50/2.8 Macro) has 50 mm focal length.


This plot is the same as above with both axes in logarithmic scale. The green dashed line shows a linear line thru zero blur at 44 ms.

It turns out that all data by P. Smith are (within margins of statistical and systematic errors) compatible with the following formula (dotted lines in the above log-log plot):

b = a f |t - t0|

where b be the blur width (e.g., in µm),
a and t0 are constants,
and f be the focal length (e.g., in mm)
and t be the exposure time (e.g., in ms).

and where values are as follows:

SR OFF:
t0 = 0
a = 1 / (280 s)
(of course, a as above is a measurement of P. Smith's body tremor ;) )

SR ON:
t0 = 44 ms
a = 1 / (1200 s)

and b_SRON actually is the minimum of the above formula and b_SROFF. The crossover where b_SRON actually becomes b_SROFF is at t=8ms or 1/125s. For faster shutter speeds, the SR system has no effect (at 50mm focal speed).

The standard deviation of blur width is about the same size as the blur width itself, for both SR on and off.

This corresponds to an advantage of 2.1 stops within a nice range and actually better (~4 stops) around 1/20s - 1/25s. Persons with stronger tremor may see a better reduction.

The nice things about this formula is that we can compute the range of permissable shutter speeds, given a blur width and focal length.


5. Claim

The Pentax formula above holds true for all focal lengths.


6. Backing it up

Wait a second! If true, this claim means that the Pentax SR mechanism isn't able to help aquiring tac-sharp images with long focal lengths! Because below 1/125s, SR basically won't help anymore. It does help aquiring accepable images at maybe 1/50s and 200mm. But not tac-sharp at maybe 1/150s and 200mm. This may then require 1/400s actually, where SR on or off wouldn't matter anyway.

Because this claim is not to be made light-heartedly, I will use more sources to confirm it.

First, my own informal tests involving a visual inspection of images taken with a 300mm lens, at 1/320s, 1/160s, 1/100s, 1/25s, SR ON and OFF: the blur doesn't seem to depend on SR on or off with 1/320s, 1/160s, 1/100s. Blur was less at 1/25s with SR on but still a little bit more than at 1/160s with SR on or off.

Because this quick test isn't academic enough, I consult two additional sources: The ColorFoto tests from 2008 (K20D) and 2010 (K-7). The former measurement chart is online and I try to embedd it here (if it doesn't display, follow the link in the sources section):

© 2008 ColorFoto

We need to look at the second chart here, taken at 130mm and 1/125s. The red bar is with SR off and the dark blue bar to the right is with SR on. As you can see, both bars are roughly of same height, i.e., ColorFoto found SR ineffective at 130mm and 1/125s with the K20D. They actually found blur to be less at 1/15s than at 1/125s...

Now in 2010, I have the paper source for the same test with the K-7 and DA60-250 at 130mm at my disposition. Result: SR on (compared to SR off) has a positive effect of only 10% at 1/200s and maybe 20% at 1/100s. In a range of 1/200s to 1/13s, it remains at about 1 to 1.5 pixels as opposed to 0.5 pixels with tripod. Which is excellent at 1/13s but not so good at 1/200s. Their same curve at 23mm focal length reveals contant, tripod-like blur between 1/30s and 1/8s and even at 1s, only 2px blur. Their result is a little bit less irritating than the earlier K20D result in so far as shorter exposure times didn't lead to more blur.

These are two independent measurements basically coming to the same result: The Pentax SR is designed "to kick in" at exposures longer than about 1/50s.

This leads me to make my claim above.


7. Compared to the competition

In their 2010 study, ColorFoto compared the following SR systems, both at 35mm equivalent and 200mm equivalent focal lengths (FT and APS-C sensors).

35mm: (improvement in stops vs. 1/30s):
Nikon 18-200 VR II: 5
Olympus E3: 5
Panasonic GH1: 3
Sigma 18-50: 3
Pentax K-7: 3 (*)
Canon 18-135: 1
Sony A380: 1
Tamron 17-50: 0

200mm:
Olympus E3: 3
Panasonic GH1: 2
Canon 18-135: 1
Nikon 18-200 VR II: 1
Tamron 18-270: 1
Sony 70-300: 1
Canon 100: 0
Nikon 70-200 VR: 0
Sigma 70-300: 0
Pentax K-7: 0 (*)

(*) I define the number of stops improvement by the time where blur becomes more than 120% compared to a tripod shot, using the 1/focal-s rule to define the 0 stop point. The K-7 had more published shake without SR than the others which can only mean that the higher resolution wasn't corrected for. So, it was ok to add 1 stop to Pentax results (and avoid a -1 stop improvement listing ;) ).

So, all vendors have a common problem already at 100mm (FT) and 130mm (APS-C) focal lengths. At the long end, the best and the worst result are from sensor-shift based systems. At the wide end, they are mixed as well. So, differences are always due to the particular implementation details and not the principle as such.

Looking at results in more detail, I can see the "kick in effect" for the following systems: Tamron 18-270, Nikon 70-200 VR, Canon 100, Sigma 70-300 and Pentax K-7. So, it isn't a system-immanent effect.


8. Pentax SR usage guide

One can compile a usage guide of good exposure times based on the formula given above. This is possible because we can now assume that it holds true for all focal lengths.

The above is a 2D plot of ranges of good combinations of exposure time and focal length. The bright green (tack-sharp) represents 1 µm extra blur due to shake or better (0.2 pixels), the red (blurry) represents 20 µm blur or worse (4 pixels). The two darker shades of green (sharp and soft) represent degrees of blur, which are bearly or clearly noticeable at the 100% crop level.

The border between the two darker green regions represents the standard 135-format 1/f rule (1/(1.5*f) in APS-C land).

The blue or lilac region (blurred) represents a region where blur is obvious but not ruining the shot when looked at from the normal viewing distance: 20µm or 0.02mm is the traditional circle of confusion diameter for depth of field calculations.

One may think that the level of DoF-kind of sharpness be good enough. It depends on the subject. Because a crop from a shorter focal length would have done as well then. Sometimes, the longer focal length would still be the better choice because it collects more light (less noise than the crop) and allows for better focussing.

(Note: the chart and chart description was updated 2010, April 16.)


As can be seen, for focal lengths larger than 100mm, it is getting increasingly difficult or impossible to obtain the required sharpness from the SR mechanism and one has to use the good old rule of thumb. Nevertheless, if one shoots at 200mm and is accepting 1 pixel motion blur, then the avaible range is extended down from about 1/150s to 1/25s or 1/15s even, with the region around 1/100s to be avoided!

One may think that adding a tele lens from Sigma with lens-based stabilization could deliver more headroom for long range tele photo shots. In theory, this may be true. But it remains to be seen if the image stabilization mechanism made by Sigma can deliver for longer focal lengths. It may well be limited to the wide end as well. Additional tests would be required to answer this question.


9. Conclusion

Pentax delivers a capable shake reduction system able to provide up to 4 stops stabilization. However, it is designed to work best at exposure time around 1/20s and therefore, is most useful for normal and wide angle lenses used at low light or in video. Starting at around 100mm focal length, it is increasingly unlikely to see a positive effect from the SR system and beyond 200mm, the SR system cannot be used anymore to produce tac-shap images at lower than usual exposure times.

Olympus shows that this isn't a principle limitation of sensor-shift by delivering best stabilization for longer focal lengths (as far as I am aware of tests). So, there is hope that a future installment of the Pentax SR system is more useful for long focal lengths.

I call it "Tele-SR" and say to Pentax: I want it and I want it now :)


Thanks for stopping by.