Google aims to change the definition of good photography with Pixel 4’s software-defined camera

Google’s new Pixel 4 camera offers a ton of new tricks to improve its photographic chops, and to emphasize the point, it had Professor Mark Levoy, who leads camera technology development at Google Research, up on stage to talk about the Pixel 4’s many improvements, including its new telephoto lens, updated Super Res Zoom technology and Live HDR+ preview.

Subject, Lighting, Lens, Software

Levoy started by addressing the oft-cited saying among photographers that what’s most important to a good photo is first subject, then lighting and followed after that by your hardware: ie., your lens and camera body. He said that he and his team believe that there’s a different equation at play now, which replaces that camera body component with something else: Software.

Screen Shot 2019 10 15 at 10.59.55 AM

Lens is still important in the equation, he said, and the Pixel 4 represents that with the addition of a telephoto lens to the existing wide angle hardware lens it offers. Levoy also offered the opinion that a telephoto is more useful generally than a wide angle, clearly a dig at Apple’s addition of an ultra-wide angle hardware lens to its latest iPhone 11 Pro models.

Google Pixel 4 Camera

In this context, that means Google’s celebrated “computational photography” approach to its Pixel camera tech, which handles a lot of the heavy lifting involved when it takes a photo from a small sensor, which tend to be bad, and turns that into something pretty amazing.

Levoy said that he calls their approach a “software-defined camera,” which most of the time just means capturing multiple photos, and combining data from each in order to produce a better, single final picture.

Screen Shot 2019 10 15 at 11.07.56 AM

What’s new for Pixel 4

There are four new features for the Pixel 4 phone powered by computational photography, which include Live HDR with dual exposure controls, which shows you a real-time image of what the final photo will look like with the HDR treatment applied, instead of just giving you a very different looking final shot. It also bakes in exposure controls that allow you to adjust the highlights and shadows in the image on the fly, which is useful if you want bolder highlights or silhouettes from shadows, for instance.

Also new is “Learning-based white balance,” which addresses the tricky issue of getting your white balance correct. Levoy said that Google has been using this approach in white-balancing night sight photos since the introduction of that feature with Pixel 3, but now it’s bringing it to all photo modes. The result is cooler colors, and particularly in tricky lighting situations when whites tend to be incorrectly exposed as orange or yellow.

Screen Shot 2019 10 15 at 11.02.01 AM

The new wide-range portrait mode makes use of info from both the dual-pixel imaging sensors that Pixel 4 uses, as well as the new second lens to derive more depth data and provide an expanded, more accurate portrait mode to separate the subject from the background. It now works  on large objects and portraits where the person in focus is standing further back, and it provides better bokeh shape (the shape of the defocused elements int eh background) and better definition of strands of hair and fur, which has always been tricky for software background blur.

Lastly, Night Sight mode gets overall improvements, as well as a new astral photography mode specifically for capturing the night sky and star fields. The astral mode provides great looking night sky images with exposure times that run multiple minutes, but all with automatic settings and computational algorithms that sort out issues like stars moving during that time.

google pixel 4 sample images

Still more to come

Google wanted to emphasize the point that this is a camera that can overcome a lot of the problems faced typically by small sensors, and it brought out heavyweight photography legend Annie Lebowitz to do just that. She showed some of the photos she’s been capturing both with Pixel 3 and Pixel 4, and they did indeed look great, although the view from the feed doesn’t say quite as much as would print versions of the final photos.

Levoy also said that they plan to improve the camera over time via software updates, so this is just the start for Pixel 4. Based on what we saw on stage, it definitely looks like a step-up from the already excellent Pixel 3, but we’ll need more time hand-on to see what it does compared to Apple’s much-improved iPhone 11 camera.

Gadgets – TechCrunch

Nintendo Switch Lite’s trade-off of whimsy for practicality is a good one

Nintendo revealed a new Switch Lite version of its current-generation console today, which attaches the controllers permanently, shrinks the hardware a bit, and adds a touch more battery life – but it also takes away the ‘Switch’ part of the equation, because you can only use it handheld, instead of attached to a TV or as a unique tabletop gaming experience.

The changes mostly seem in service of brining the price down, since it will retail for $ 199 when it goes on sale in September. That’s $ 100 less than the original Switch, which is a big price cut and could open up the market for Nintendo to a whole new group of players. But it’s also a change that seems to take away a lot of what made the Switch special, including the ability to plug it into a TV for a big-screen experience, or quickly detach the Joy-Con controllers for motion-control gaming with rumble feedback.

Switch Lite makes some crucial changes that I suspect Nintendo knows are reflective of how a lot of people actually use the Switch, regardless of what the aspirational, idealized Switch customer does in Nintendo’s ads and promo materials. As mentioned, it should bump your battery life during actual gameplay – it could add an extra hour when playing The Legend of Zelda: Breath of the Wild, for instance. And the size savings mean it’s much easier to slip in a bag when you head out on a trip.

NSwitchLiteImageWallImg04 image950w

The new redesigned, permanently attached controllers also include a proper D-pad on the left instead of the individual circle buttons used on the Joy-Pad, and the smaller screen still outputs at the same resolution, which means things will look crisper in play.

For me, and probably for a lot of Switch users, the trade-offs made here are actually improvements that reflect 90 percent of my use of the console. I almost never play plugged into a TV, for instance – and could easily do without, since mostly I do that for one-off party game use that isn’t really all that necessary. The controller design with a D-pad is much more practical, and I have never used motion controls with my Switch for any game. Battery life means that you probably don’t need to recharge mid-trip on most short and medium-length trips, and the size savings means that when I’m packing and push comes to shove, I’m that much more likely to take the Switch Lite rather than leave it at home.

Already, some critics are decrying how this model makes the Switch ‘worse’ in almost every way, but actually I think it’s just the opposite – Nintendo may have traded away some of its trademark quirk with this version, but the result is something much more akin to how most people actually want to use a console most of the time.

Gadgets – TechCrunch