The fact that OpenAI is expected to bring in over $10 billion in revenue next year is indicative of the rapid use of generative AI. Large AI models are difficult for most businesses to implement in production, though. It is expected that around 90% of machine learning projects will never reach production due to the high price and complexity involved.
In response to this urgent need, Simplismart is launching a $7 million investment round for its infrastructure, which makes it possible for businesses to easily implement AI models.
Similar to the change to cloud computing, which depended on programs like Terraform, and the Android-powered mobile app development industry, Simplismart is establishing itself as a key facilitator for the integration of AI into regular company operations.
Accel spearheaded the series A funding round, including participation from Titan Capital, Shastra VC, and prominent angel investors, such as Notion co-founder Akshay Kothari. This investment, which is more than ten times larger than their prior round, will support the development of their enterprise-focused MLOps orchestration platform’s R&D and expansion.
Amritanshu Jain, who addressed cloud infrastructure issues at Oracle Cloud, and Devansh Ghatak, who refined his search algorithmic skills at Google Search, co-founded the business in 2022, BrandSpur digital news platform reports.
With less than $1 million in seed money, Simplismart was able to create the fastest inference engine in the world in under two years, surpassing criteria set by the public. With the help of this engine, businesses can execute machine learning models at breakneck speed, greatly increasing efficiency and lowering expenses. The rapid inference engine of Simplismart enables customers to take advantage of improved performance for each and every model deployment. Its software-level optimisation, for instance, enables Llama3.1 (8B) to operate at an astounding throughput of >440 tokens per second.
Simplismart has developed this breakthrough in speed within a comprehensive MLOps platform that is tailored for on-premise enterprise deployments, regardless of the model and cloud platform chosen. Most rivals concentrate on hardware optimisations or cloud computing.
According to Simplismart’s Co-founder and CEO, Amritanshu Jain: “Building generative AI applications is a core need for enterprises today. However, the adoption of generative AI is far behind the rate of new developments. It’s because enterprises struggle with four bottlenecks: lack of standardised workflows, high costs leading to poor ROI, data privacy, and the need to control and customise the system to avoid downtime and limits from other services.”
The platform from Simplismart provides businesses with a declarative language (like Terraform) that makes it easier to fine-tune, deploy, and monitor genAI models at scale.
While deploying AI internally has its own set of challenges—including access to computing power, model optimisation, scaling infrastructure, CI/CD pipelines, and cost efficiency—using third-party APIs frequently raises concerns about data security, rate limits, and complete lack of flexibility. All of these tasks require highly qualified machine learning engineers. By standardising these orchestration operations, Simplismart’s end-to-end MLOps platform frees up teams’ time to concentrate on their primary product requirements rather than putting in countless manhours constructing this infrastructure.
Continuing, Jain had this to say: “Until now, enterprises could leverage off-the-shelf capabilities to orchestrate their MLOps workloads since the quantum of workloads, be it the size of data, model or compute required, was small. As the models get larger and the workload increases, it will be imperative to have command over the orchestration workflows. Every new technology goes through the same cycle: exactly what Terraform did for cloud, android studio for mobile, and Databricks/Snowflake did for data.
“As GenAI undergoes its Cambrian explosion moment, developers are starting to realise that customising & deploying open-source models on their infrastructure carries significant merit; it unlocks control over performance, costs, customisability over proprietary data, flexibility in the backend stack, and high levels of privacy/security”, said Anand Daniel, partner at Accel.
“We were happy to see that Simplismart’s team saw this opportunity quite early, but what blew us away was how their tiny team had already begun serving some of the fastest-growing GenAI companies in production. It furthered our belief that Simplismart has a shot at winning in the massive but fiercely competitive global AI infrastructure market,” he added.
More businesses will be able to deploy genAI apps with more control once MLOps workflows are solved. To meet their needs, they aim to control the performance vs. cost trade-off.
However, according to Simplismart, the secret to accelerating adoption is to give businesses granular Lego blocks with which to put together their deployment settings and inference engines.
