Enterprise

Modular closes $30 million seed round to simplify the process of developing AI systems

Comment

Abstract big data image
Image Credits: koto_feja / Getty Images

AI has transformative potential. But if you ask the co-founders of Modular, a startup emerging from stealth today, the software used to develop it is “monolithic,” fractured into silos piled with layers of complexity. Big Tech companies have made helpful contributions, like TensorFlow and PyTorch — AI development frameworks maintained by Google and Facebook, respectively. But these companies, the Modular co-founders posit, show a preference for their tooling and infrastructure at the expense of the AI’s progress.

Modular aims to change that. Founded by former Apple and Google engineers and execs, the company today closed a large ($30 million) seed round led by GV (formerly Google Ventures), with participation from Greylock, The Factory and SV Angel to realize its vision of a streamlined, platform-agnostic AI system development platform.

“The industry is struggling to maintain and scale fragmented, custom toolchains that differ across research and production, training and deployment, server and edge,” Modular CEO Chris Lattner told TechCrunch in an email interview. “Many of the world’s largest, non-big tech firms naively believe that the open-source community and the open-source infrastructure owned by Google, Meta, and Nvidia, will eventually provide this, when their priorities and limitations show otherwise.”

Lattner has an impressive resume, having spearheaded the creation of Swift, the programming language that powers much of the Apple ecosystem. He previously was the VP of Tesla’s self-driving division and president of engineering and product at SiFive, which provides intellectual property to chip design companies. During a tenure at Google, Lattner managed and built a range of AI-related products, including TPUs at Google Brain, one of Google’s AI-focused research divisions, and TensorFlow.

Modular’s other co-founder, Tim Davis, is accomplished in his own right, having helped set the vision, strategy and roadmaps for Google machine learning products spanning small research groups to production systems. From 2020 to early 2022, Davis was the product lead for Google machine learning APIs, compilers and runtime infrastructure for server and edge devices.

Modular
Image Credits: Modular

“The most pressing issue facing companies who aren’t ‘Big Tech’ is how to productionize AI within performance, cost, time, and talent bounds. The opportunity cost of this challenge is enormous. For individual companies, this means innovations not making it to market, inferior product experiences, and ultimately a negative impact on their bottom line,” Lattner said. “AI can change the world, but not until the fragmentation can be healed and the global developer community can focus on solving real problems, not on the infrastructure itself.”

Modular’s solution is a platform that unifies popular AI framework frontends via modular, “composable” common components. Details are a bit murky — it’s early days, Lattner cautioned — but the goal with Modular is to let developers plug in custom hardware to train AI systems, deploy those systems to edge devices or servers and otherwise “seamlessly scale [the systems] across hardware so that deploying the latest AI research into production ‘just works,’” Lattner said.

Modular stands in contrast to the emerging MLOps category of vendors, delivering tools for gathering, labeling and transforming the data needed to train AI systems as well as workflows for authoring, deploying and monitoring AI. MLOps, short for “machine learning operations,” seeks to streamline the AI life cycle by automating and standardizing development workflows, much like DevOps was meant to accomplish for software.

Driven by the accelerating adoption of AI, analytics firm Cognilytica predicts that the global market for MLOps solutions will be worth $4 billion by 2025 — up from $350 million in 2019. In a recent survey, Forrester found that 73% of companies believe MLOps adoption would keep them competitive while 24% say it would make them an industry leader.

“Modular’s main competition is the mindset that dominates AI software development within Big Tech, and Big Tech itself,” Lattner said. “The reason those companies are successful at deploying AI is that they amass armies of developers, incredibly talented AI tinkerers, and use their vast compute and financial resources to further their own efforts and products — including their own clouds and AI hardware. Despite their incredible contributions to the field, their self-preferencing highlights a deep chasm in AI and places an industry-limiting ceiling on the rest of the world’s ability to use this technology to fight some of our most significant socioeconomic and environmental problems.”

Lattner — without naming names — claims that Modular is already working with “some of the biggest [firms] in tech.” The near-term focus is expanding Modular’s 25-person team and readying the platform for launch in the coming months.

“Changing economic conditions mean that the world’s largest AI companies have spent billions on AI to focus on production — and making money — from AI, rather than tinkering,” Lattner said. “Many of the best and brightest computer scientists — effectively, the 100x engineers within organizations where 10x engineers are the norm — are fighting just to maintain and make these systems work for basic use cases — most of which are focused on revenue optimization projects, not changing the world. To that end, technical decision makers are looking for infrastructure that is more usable, flexible, and performant, streamlining e2e AI development and deployment and enabling AI research to move to production faster. They are really just looking to realize much greater value from AI at lower deployment cost.”

More TechCrunch

The TechCrunch team runs down all of the biggest news from the Apple WWDC 2024 keynote in an easy-to-skim digest.

Here’s everything Apple announced at the WWDC 2024 keynote, including Apple Intelligence, Siri makeover

Hello and welcome back to TechCrunch Space. What a week! In the same seven-day period, we watched Boeing’s Starliner launch astronauts to space for the first time, and then we…

TechCrunch Space: A week that will go down in history

Elon Musk’s posts seem to misunderstand the relationship Apple announced with OpenAI at WWDC 2024.

Elon Musk threatens to ban Apple devices from his companies over Apple’s ChatGPT integrations

“We’re looking forward to doing integrations with other models, including Google Gemini, for instance, in the future,” Federighi said during WWDC 2024.

Apple confirms plans to work with Google’s Gemini ‘in the future’

When Urvashi Barooah applied to MBA programs in 2015, she focused her applications around her dream of becoming a venture capitalist. She got rejected from every school, and was told…

How Urvashi Barooah broke into venture after everyone told her she couldn’t

Slack CEO Denise Dresser is speaking at TechCrunch Disrupt 2024.

Slack CEO Denise Dresser is coming to TechCrunch Disrupt this October

Apple kicked off its weeklong Worldwide Developers Conference (WWDC 2024) event today with the customary keynote at 1 p.m. ET/10 a.m. PT. The presentation focused on the company’s software offerings…

Watch the Apple Intelligence reveal, and the rest of WWDC 2024 right here

Apple’s SDKs (software development kits) have been updated with a variety of new APIs and frameworks.

Apple brings its GenAI ‘Apple Intelligence’ to developers, will let Siri control apps

Older iPhones or iPhone 15 users won’t be able to use these features.

Apple Intelligence features will be available on iPhone 15 Pro and devices with M1 or newer chips

Soon, Siri will be able to tap ChatGPT for “expertise” where it might be helpful, Apple says.

Apple brings ChatGPT to its apps, including Siri

Apple Intelligence will have an understanding of who you’re talking with in a messaging conversation.

Apple debuts AI-generated … Bitmoji

To use InSight, Apple TV+ subscribers can swipe down on their remote to bring up a display with actor names and character information in real time.

Apple TV+ introduces InSight, a new feature similar to Amazon’s X-Ray, at WWDC 2024

Siri is now more natural, more relevant and more personal — and it has new look.

Apple gives Siri an AI makeover

The company has been pushing the feature as integral to all of its various operating system offerings, including iOS, macOS and the latest, VisionOS.

Apple Intelligence is the company’s new generative AI offering

In addition to all the features you can find in the Passwords menu today, there’s a new column on the left that lets you more easily navigate your password collection.

Apple is launching its own password manager app

With Smart Script, Apple says it’s making handwriting your notes even smoother and straighter.

Smart Script in iPadOS 18 will clean up your handwriting when using an Apple Pencil

iOS’ perennial tips calculating app is finally coming to the larger screen.

Calculator for iPad does the math for you

The new OS, announced at WWDC 2024, will allow users to mirror their iPhone screen directly on their Mac and even control it.

With macOS Sequoia, you can mirror your iPhone on your Mac

At Apple’s WWDC 2024, the company announced MacOS Sequoia.

Apple unveils macOS Sequoia

“Messages via Satellite,” announced at Apple’s WWDC 2024 keynote, works much like the SOS feature does.

iPhones will soon text via satellite

Apple says the new design will lead to less time searching for photos.

Apple revamps its Photos app for iOS 18

Users will be able to lock an app when they hand over their phone.

iOS 18 will let you hide and lock apps

Apple’s WWDC 2024 keynote was packed, including a number of key new updates for iOS 18. One of the more interesting additions is Tap to Cash, which is more or…

Tap to Cash lets you pay by touching iPhones

In iOS 18, Apple will now support long-requested functionality, like the ability to set app icons and widgets wherever you want.

iOS 18 will finally let you customize your icons and unlock them from the grid

As expected, this is a pivotal moment for the mobile platform as iOS 18 is going to focus on artificial intelligence.

Apple unveils iOS 18 with tons of AI-powered features

Apple today kicked off what it promised would be a packed WWDC 2024 with a handful of visionOS announcements. At the top of the list is the ability to turn…

visionOS can now make spatial photos out of 3D images

The Apple Vision Pro is now available in eight new countries.

Apple to release Vision Pro in international markets

VisionOS 2 will come to Vision Pro as a free update later this year.

Apple debuts visionOS 2 at WWDC 2024

The security firm said the attacks targeting Snowflake customers is “ongoing,” suggesting the number of affected companies may rise.

Mandiant says hackers stole a ‘significant volume of data’ from Snowflake customers

French startup Kelvin, which uses computer vision and machine learning to make it easier to audit homes for energy efficiency, has raised $5.1M.

Kelvin wants to help save the planet by applying AI to home energy audits