Ghost wants to retrofit your car so it can drive itself on highways in 2020

A new autonomous vehicle company is on the streets — and unbeknownst to most, has been since 2017. Unlike the majority in this burgeoning industry, this new entrant isn’t trying to launch a robotaxi service or sell a self-driving system to suppliers and automakers. It’s not aiming for autonomous delivery, either.

Ghost Locomotion, which emerged Thursday from stealth with $ 63.7 million in investment from Keith Rabois at Founders Fund, Vinod Khosla at Khosla Ventures and Mike Speiser at Sutter Hill Ventures, is targeting your vehicle.

Ghost is developing a kit that will allow privately owned passenger vehicles to drive autonomously on highways. And the company says it will deliver in 2020.

This kit isn’t going to give a vehicle a superior advanced driving assistance system. The kit will let human drivers hand control of their vehicle over to a computer, allowing them to do other activities such as look at their phone or even doze off.

The idea might sound similar to what Comma.ai is working on, Tesla hopes to achieve or even the early business model of Cruise. Ghost CEO and co-founder John Hayes says what they’re doing is different.

A different approach

The biggest players in the industry — companies like Waymo, Cruise, Zoox and Argo AI — are trying to solve a really hard problem, which is driving in urban areas, Hayes told TechCrunch in a recent interview.

“It didn’t seem like anyone was actually trying to solve driving on the highways,” said Hayes, who previously founded Pure Storage in 2009. “At the time, we were told that this is so easy that surely the automakers will solve this any day now. And that really hasn’t happened.”

Hayes noted that automakers have continued to make progress in advanced driver assistance systems. The more advanced versions of these systems provide what the SAE describes as Level 2 automation, which means two primary control functions are automated. Tesla’s Autopilot system is a good example of this; when engaged, it automatically steers and has traffic-aware cruise control, which maintains the car’s speed in relation to surrounding traffic. But like all Level 2 systems, the driver is still in the loop.

Ghost wants to take the human out of the loop when they’re driving on highways.

“We’re taking, in some ways, a classic startup attitude to this, which is ‘what is the simplest product that we can perfect, that will put self driving in the hands of ordinary consumers?’ ” Hayes said. “And so we take people’s existing cars and we make them self-driving cars.”

The kit

Ghost is tackling that challenge with software and hardware.

The kit involves hardware like sensors and a computer that is installed in the trunk and connected to the controller area network (CAN) of the vehicle. The CAN bus is essentially the nervous system of the car and allows various parts to communicate with each other.

Vehicles must have a CAN bus and electronic steering to be able to use the kit.

The camera sensors are distributed throughout the vehicle. Cameras are integrated into what looks like a license plate holder at the back of the vehicle, as well as another set that are embedded behind the rearview mirror.

A third device with cameras is attached to the frame around the window of the door (see below).

Initially, this kit will be an aftermarket product; the company is starting with the 20 most popular car brands and will expand from there.

Ghost intends to set up retail spaces where a car owner can see the product and have it installed. But eventually, Hayes said, he believes the kit will become part of the vehicle itself, much like GPS or satellite radio has evolved.

While hardware is the most visible piece of Ghost, the company’s 75 employees have dedicated much of their time on the driving algorithm. It’s here, Hayes says, where Ghost stands apart.

How Ghost is building a driver

Ghost is not testing its self-driving system on public roads, an approach nearly every other AV company has taken. There are 63 companies in California that have received permits from the Department of Motor Vehicles to test autonomous vehicle technology (always with a human safety driver behind the wheel) on public roads.

Ghost’s entire approach is based on an axiom that the human driver is fundamentally correct. It begins by collecting mass amounts of video data from kits that are installed on the cars of high-mileage drivers. Ghost then uses models to figure out what’s going on in the scene and combines that with other data, including how the person is driving by measuring the actions they take.

It doesn’t take long or much data to model ordinary driving, actions like staying in a lane, braking and changing lanes on a highway. But that doesn’t “solve” self-driving on highways because the hard part is how to build a driver that can handle the odd occurrences, such as swerving, or correct for those bad behaviors.

Ghost’s system uses machine learning to find more interesting scenarios in the reams of data it collects and builds training models based on them.

The company’s kits are already installed on the cars of high-mileage drivers like Uber and Lyft drivers and commuters. Ghost has recruited dozens of drivers and plans to have its kits in hundreds of cars by the end of the year. By next year, Hayes says the kits will be in thousands of cars, all for the purpose of collecting data.

The background of the executive team, including co-founder and CTO Volkmar Uhlig, as well as the rest of their employees, provides some hints as to how they’re approaching the software and its integration with hardware.

Employees are data scientists and engineers, not roboticists. A dive into their resumes on LinkedIn and not one comes from another autonomous vehicle company, which is unusual in this era of talent poaching.

For instance, Uhlig, who started his career at IBM Watson Research, co-founded Adello and was the architect behind the company’s programmatic media trading platform. Before that, he built Teza Technologies, a high-frequency trading platform. While earning his PhD in computer science he was part of a team that architected the L4 Pistachio microkernel, which is commercially deployed in more than 3 billion mobile Apple and Android devices.

If Ghost is able to validate its system — which Hayes says is baked into its entire approach — privately owned self-driving cars could be on the highways by next year. While the National Highway Traffic Safety Administration could potentially step in, Ghost’s approach, like Tesla, hits a sweet spot of non-regulation. It’s a space, that Hayes notes, where the government has not yet chosen to regulate.


Android – TechCrunch

The Los Angeles Fire Department wants more drones

As it looks to modernize its operations, the Los Angeles Fire Department is turning to a number of new technologies, including expanding its fleet of drones for a slew of new deployments.

One of the largest fire departments in the U.S., next to New York and Chicago, the LAFD has a budget of roughly $ 691 million, employs more than 3,500 and responded to 492,717 calls in 2018.

The department already has a fleet of 11 drones to complement its fleet of 258 fire engines, ambulances and helicopters.

However, Battalion Chief Richard Fields, the head of the department’s Unmanned Aerial Systems program, would like to see that number increase significantly.

Los Angeles has become an early leader in the use of drones for its firefighting applications thanks in part to an agreement with the Chinese company DJI, which the department inked back in April.

At the time, the Chinese drone manufacturer and imaging technology developer announced an agreement to test and deploy DJI drones as an emergency response preparedness tool. The company called it one DJI’s largest partnerships with a fire-fighting agency in the U.S.

“We are excited to be strengthening our partnership with the LAFD, one of the nation’s preeminent public safety agencies, to help them take advantage of DJI’s drone technology that has been purpose-built for the public safety sector,” said Bill Chen, Enterprise Partnerships manager at DJI, in a statement at the time. “Through our two-way collaboration, DJI will receive valuable insight into the complexities of deploying drones for emergency situations in one of the most complex urban environments in the nation.”

Now, roughly five months later, the program seems to have been successful enough that Battalion Chief Fields is looking to double the fleet.

“Our next iteration is to start using our drones to assist our specialized resources,” said Fields. Those are firefighters and support crews that deal with hazardous materials, urban search and rescue, marine environments and swift water rescues, Fields said.

33734266774 bf1485b00d k

The LAFD Swift Water Rescue Team. Photo courtesy of Flickr/ LAFD Mike Horst

The technologal demands of the fire department extend beyond the drone itself, Fields said. “There are a lot of technologies that allows us to make the drone more versatile… the most valuable tool isn’t the drone; it’s the sensor.”

So far, the most useful application has been using infrared technologies to balance what’s visible and combine it with the heat signatures the sensors pick up.

Training to become a drone pilot for the LAFD is particularly intense, Fields says. The typical pilot will get up to 80 hours of training. “Our training is nation-leading. There’s nothing out there in the commercial market that beats it,” according to Fields.

For now, the entire LAFD fleet is composed of DJI drones, something that has given military and civilian officials pause in the past few years.

Concerns have been growing over the reliance on Chinese technology in core American infrastructure, extending from networking technology companies like Huawei to drone technology developers like DJI.

Back in 2018, the Department of Defense issued a ban on the acquisition and use of commercial drones, citing cybersecurity vulnerabilities. The ban came a year after officials from the Department of Homeland Security and members of Congress called out DJI specifically for its potential to be used by the Chinese government to spy on the United States.

However, the rule isn’t set in stone, and many branches of the military continue to use DJI drones, according to a September Voice of America News report.

In Los Angeles, Fields says he takes those concerns seriously. The department has worked closely with regulators and advocacy groups like the American Civil Liberties Union to craft a strict policy around what gets done with the data the LAFD collects.

“The way that we establish our program is that the drone provides us with our real-time situational awareness,” said Fields. “That helps the incident commander get a visual perspective of the problem and he can make better decisions.”

The only data that is recorded and kept, says Fields, is data collected around brush fires so the LAFD can do a damage assessment, which can later be turned into map layers to keep records of hotspots.

As for data that could be sent back to China, Fields says that any mapping of critical infrastructure is done without connecting to the internet. “It’s being collected on the drone and 90% of that information is how the drone is operating. There is some information of where the drone is and how it is and the [latitude] and [longitude] of the drone itself… That’s the data that’s being collected,” Fields says. 

From Fields’ perspective, if the government is so concerned about the use of drones made by a foreign manufacturer, there’s an easy solution. Just regulate it.

“Let’s come up with a standard. If you use them in a federal airspace these are the check marks that you have to pass,” he says. “Saying that DJI drones are bad because they come from China [and] let’s throw them all out… that’s not an answer either.”

Gadgets – TechCrunch