Startups

Latent AI, which says it can compress common AI models by 10x, lands some key backing

Comment

Image Credits: NicoElNino / Getty Images

Roughly a year ago, Latent AI, a now three-year-old, Menlo Park, California-based startup, pitched a handful of investors during TechCrunch’s Battlefield competition. It didn’t win that contest, but that hasn’t kept it from winning the interest of investors elsewhere. It just closed on $19 million in Series A funding in a round co-led by Future Ventures and Blackhorn Ventures, with participation from Booz Allen, Lockheed Martin, 40 North Ventures, and Autotech Ventures. The company has now raised $22.5 million altogether.

What are these backers funding exactly? The company says it makes software designed to train, adapt and deploy edge AI neural networks, irrespective of hardware constraints or the inexpensive chips that are typically found in edge devices. It also says it can compress common AI models by ten times without a noticeable change in accuracy, partly through an “attention mechanism” that enables it to save power and run only what is needed based on environment and operational context. Not last, it promises its users (who are edge device developers) that its software can do all of this with nearly zero latency (thus the company name).

Steve Jurvetson, the veteran investor and co-founder of Future Ventures, says of possible applications to think of “face-detection algorithms running locally within security cameras or appliances, or Siri-like voice interfaces working instantly,” even when there’s no network connectivity.

Certainly, there’s a growing market for the kind of tech that Latent AI is developing. Indeed, though in an interview earlier today, co-founder and CEO Jags Kandasamy declined to delve into specifics, he suggested that the U.S. government is already a customer, thanks in part to strategic investors like Booz Allen. (In a press release last month about Booz Allen’s investment in Latent AI, an SVP at the government services agency noted that the “ability to collect, analyze and quickly act on data is at the core” of the U.S.’s national defense strategy.)

Another strategic investor, Lockheed Martin, is very focused on finding ways that AI technologies can help the U.S. military improve on situational awareness across land, sea, air, space, cyber and electromagnetic spectrum domains, so it’s easy to appreciate its attraction to the startup.

Kandasamy also talked this afternoon about an unnamed steel manufacturer that it is using Latent AI’s tech in its Google Glass-like augmented reality goggles.

Of course, given that the world is now rife with data-collecting devices and that there’s an enormous interest in making that data actionable without having to send it back and forth to a distant cloud, there are many other companies and projects with the same objective as Latent AI. Among them are open-source tools like TensorFlow, hardware vendors like Xilinx and rival startups like OctoML and Deeplite.

Kandasamy insists that all fall short in some way. Of TensorFlow, he says that developers have only community support when it comes to production deployment. Of the chipmakers of the world, they’re focused on their own hardware and not vertically integrated. And what of those rivals? They’re either focused on compression or compiling and not both, says Kandasamy.

Either way, Latent AI has the kind of backstory that investors like. After Kandasamy, a serial entrepreneur, sold his last startup to Analog Devices, he headed to SRI International in 2018 as an entrepreneur-in-residence. There, he was quickly wowed by tech being developed by Sek Chai, who was the research institution’s technical director for nearly a decade and who specialized in low-power, high-performance computing, computer vision and machine learning. Soon after, Kandasamy and Chai formed Latent AI and began smoothing out some of the kinks.

Now, with fresh funding and a small but growing customer base that pays Latent AI on a subscription basis to access its tools (then deploy them on premises), the question is whether the 15-person outfit is coming along far enough, fast enough, to get ahead of its current and future rivals.

Jurvetson plainly thinks it’s well positioned. He says he has been an advisory board member with SRI International for more than a decade and seen a good many technologies like Siri develop and then spin out of the organization.

“This is the only one I have invested in,” he says.

How to choose and deploy industry-specific AI models

More TechCrunch

The TechCrunch team runs down all of the biggest news from the Apple WWDC 2024 keynote in an easy-to-skim digest.

Here’s everything Apple announced at the WWDC 2024 keynote, including Apple Intelligence, Siri makeover

Hello and welcome back to TechCrunch Space. What a week! In the same seven-day period, we watched Boeing’s Starliner launch astronauts to space for the first time, and then we…

TechCrunch Space: A week that will go down in history

Elon Musk’s posts seem to misunderstand the relationship Apple announced with OpenAI at WWDC 2024.

Elon Musk threatens to ban Apple devices from his companies over Apple’s ChatGPT integrations

“We’re looking forward to doing integrations with other models, including Google Gemini, for instance, in the future,” Federighi said during WWDC 2024.

Apple confirms plans to work with Google’s Gemini ‘in the future’

When Urvashi Barooah applied to MBA programs in 2015, she focused her applications around her dream of becoming a venture capitalist. She got rejected from every school, and was told…

How Urvashi Barooah broke into venture after everyone told her she couldn’t

Slack CEO Denise Dresser is speaking at TechCrunch Disrupt 2024.

Slack CEO Denise Dresser is coming to TechCrunch Disrupt this October

Apple kicked off its weeklong Worldwide Developers Conference (WWDC 2024) event today with the customary keynote at 1 p.m. ET/10 a.m. PT. The presentation focused on the company’s software offerings…

Watch the Apple Intelligence reveal, and the rest of WWDC 2024 right here

Apple’s SDKs (software development kits) have been updated with a variety of new APIs and frameworks.

Apple brings its GenAI ‘Apple Intelligence’ to developers, will let Siri control apps

Older iPhones or iPhone 15 users won’t be able to use these features.

Apple Intelligence features will be available on iPhone 15 Pro and devices with M1 or newer chips

Soon, Siri will be able to tap ChatGPT for “expertise” where it might be helpful, Apple says.

Apple brings ChatGPT to its apps, including Siri

Apple Intelligence will have an understanding of who you’re talking with in a messaging conversation.

Apple debuts AI-generated … Bitmoji

To use InSight, Apple TV+ subscribers can swipe down on their remote to bring up a display with actor names and character information in real time.

Apple TV+ introduces InSight, a new feature similar to Amazon’s X-Ray, at WWDC 2024

Siri is now more natural, more relevant and more personal — and it has new look.

Apple gives Siri an AI makeover

The company has been pushing the feature as integral to all of its various operating system offerings, including iOS, macOS and the latest, VisionOS.

Apple Intelligence is the company’s new generative AI offering

In addition to all the features you can find in the Passwords menu today, there’s a new column on the left that lets you more easily navigate your password collection.

Apple is launching its own password manager app

With Smart Script, Apple says it’s making handwriting your notes even smoother and straighter.

Smart Script in iPadOS 18 will clean up your handwriting when using an Apple Pencil

iOS’ perennial tips calculating app is finally coming to the larger screen.

Calculator for iPad does the math for you

The new OS, announced at WWDC 2024, will allow users to mirror their iPhone screen directly on their Mac and even control it.

With macOS Sequoia, you can mirror your iPhone on your Mac

At Apple’s WWDC 2024, the company announced MacOS Sequoia.

Apple unveils macOS Sequoia

“Messages via Satellite,” announced at Apple’s WWDC 2024 keynote, works much like the SOS feature does.

iPhones will soon text via satellite

Apple says the new design will lead to less time searching for photos.

Apple revamps its Photos app for iOS 18

Users will be able to lock an app when they hand over their phone.

iOS 18 will let you hide and lock apps

Apple’s WWDC 2024 keynote was packed, including a number of key new updates for iOS 18. One of the more interesting additions is Tap to Cash, which is more or…

Tap to Cash lets you pay by touching iPhones

In iOS 18, Apple will now support long-requested functionality, like the ability to set app icons and widgets wherever you want.

iOS 18 will finally let you customize your icons and unlock them from the grid

As expected, this is a pivotal moment for the mobile platform as iOS 18 is going to focus on artificial intelligence.

Apple unveils iOS 18 with tons of AI-powered features

Apple today kicked off what it promised would be a packed WWDC 2024 with a handful of visionOS announcements. At the top of the list is the ability to turn…

visionOS can now make spatial photos out of 3D images

The Apple Vision Pro is now available in eight new countries.

Apple to release Vision Pro in international markets

VisionOS 2 will come to Vision Pro as a free update later this year.

Apple debuts visionOS 2 at WWDC 2024

The security firm said the attacks targeting Snowflake customers is “ongoing,” suggesting the number of affected companies may rise.

Mandiant says hackers stole a ‘significant volume of data’ from Snowflake customers

French startup Kelvin, which uses computer vision and machine learning to make it easier to audit homes for energy efficiency, has raised $5.1M.

Kelvin wants to help save the planet by applying AI to home energy audits