Why AI cost questions get bad answers
Estimating the cost to build an AI application is difficult. Most answers you will find are vague, unhelpful ranges or, worse, fixed-price offers that conceal enormous future costs. The reason for this isn't a lack of transparency; it's that most people, including many developers, focus on the wrong variable: the AI model itself.
In our engagements building AI systems for clients from funded startups to large enterprises, we observe that the choice between GPT-4o, Claude 3, or a fine-tuned Llama 3 model has a near-zero impact on the initial build cost. The model is a component, and often a commoditised one. The real costs, and the sources of variance in quotes, lie in the unglamorous work that surrounds the model.
Founders and product leaders ask "How much for an AI app?" and they are thinking about the algorithm. The engineering team hears the question and thinks about data sources, API schemas, authentication, latency requirements, legal reviews, and the dozen other factors that determine whether a project takes three weeks or nine months.
This guide provides the framework we use to build accurate cost estimates. We will break down the true cost drivers, provide worked examples with real-world 2026 budgets, and show how the total cost of ownership extends far beyond the initial build. The goal is to equip you to have a more numerate, productive conversation about your AI project budget, whether you build it internally or with a partner.
The five cost drivers of an AI application
When we scope a new project, we assess it against five key dimensions. These drivers, not the choice of large language model (LLM), determine the majority of a project's cost and timeline. Understanding where your project falls on each spectrum is the first step to a realistic budget.
1. Data readiness
This is the single largest determinant of cost. An AI system is only as good as the data it learns from or retrieves. "Data readiness" asks: is your data clean, accessible, and in a format the AI can use?
- Low Cost: Your data is in a few structured sources (e.g., a modern PostgreSQL database, a well-organised Salesforce instance) with clean schemas and available via APIs.
- High Cost: Your data is spread across dozens of legacy systems, PDF documents, scanned images, email inboxes, and proprietary formats. It requires significant effort in data engineering to extract, clean, transform, and load (ETL) before any AI work can begin. We've seen projects where data preparation accounted for 60% of the total budget.
2. Integration surface
How deeply must the AI application be woven into your existing technical and business workflows?
- Low Cost: A standalone internal tool with a simple web interface, used by a single team. It might read from one database but doesn't write back or trigger other processes.
- High Cost: A customer-facing feature embedded within your core product. It needs to respect existing user permissions, integrate with your authentication system, read from multiple microservices, write data back, and trigger notifications or actions in other parts of your ecosystem. Each integration point is a source of complexity and cost.
3. Accuracy and performance bar
What are the consequences of the AI being wrong or slow?
- Low Cost: An internal document summarisation tool. If a summary is mediocre or occasionally misses the point, the user can click through to the source. The cost of failure is low.
- High Cost: An AI agent that executes trades in a financial application or a diagnostic tool used by clinicians. Here, "good enough" is not good enough. The system requires extensive testing, validation, guardrails, and potentially human-in-the-loop review. High accuracy and low latency often require more sophisticated and expensive architectures, such as ensembles of models or optimised, self-hosted inference endpoints.
4. Compliance and security
What regulatory or security constraints apply to your application and its data?
- Low Cost: An AI chatbot that answers questions about public information from your website.
- High Cost: An application that handles personally identifiable information (PII), protected health information (PHI), or financial data. This brings GDPR, HIPAA, or other sectoral regulations into scope. Costs increase due to requirements for data residency (e.g., hosting within the EU), stricter security audits, data anonymisation, and the legal/compliance overhead of creating and reviewing data processing agreements. Choosing models or vendors that don't meet these requirements is a non-starter.
5. Scale and criticality
How many users will this serve, and what happens if it goes down?
- Low Cost: A proof-of-concept for 10 internal users. It can run on a single server and if it's down for an hour, it's an inconvenience.
- High Cost: A feature used by tens of thousands of customers. The system must be designed for high availability, scalability, and resilience. This means load balancing, redundant infrastructure, automated failover, and comprehensive monitoring and alerting. This isn't just about handling traffic; it's about the engineering discipline required to operate a business-critical service.
Build cost breakdown by role and phase
The "build cost" covers the one-time effort to get your first production version (v1) live. It's typically composed of senior engineering and product talent working in focused phases. Below is a typical breakdown for a project, using a blended senior European engineer/PM rate of €1,400 per day for 2026.
| Phase | Key Activities | AI Engineer (Person-Weeks) | Data Engineer (Person-Weeks) | Backend Engineer (Person-Weeks) | Product / QA (Person-Weeks) | Cost Range (at €7k/week) |
|---|---|---|---|---|---|---|
| Discovery & Scoping | Workshop, data audit, architecture design, risk assessment | 1 | 1 | 0.5 | 1 | €24,500 |
| Prototype / PoC | Build core logic, test model on real data, create simple UI | 2 | 1 | 1 | 1 | €35,000 |
| MVP Build | Production code, integrations, auth, logging, full UI/UX | 4-8 | 2-4 | 3-6 | 3-6 | €84,000 - €168,000 |
| Hardening & Deploy | Security review, performance testing, deployment automation | 1-2 | 0.5-1 | 1-2 | 1-2 | €24,500 - €49,000 |
| Total | 8-13 | 4.5-7 | 5.5-9.5 | 6-10 | €168,000 - €276,500 |
This table shows a mid-sized project. A simpler internal tool might only require the lower end of the MVP range, while a complex, multi-integration product will push towards or exceed the upper end. The key takeaway is that an AI project is a team sport. An AI engineer alone cannot deliver a production-ready application; they need the support of data, backend, and product specialists to succeed. This team-based approach is central to how we deliver custom AI solutions for our clients.
Run cost: inference, vector storage, observability and support
The build cost is just the beginning. Your AI application will incur ongoing operational expenses, which you should budget for as a percentage of the build cost—typically 15-25% per year.
- Inference Costs: This is the cost of executing the AI model. If you're using a commercial API like OpenAI or Anthropic, you pay per token (roughly, 1,000 tokens ≈ 750 words). For a moderately used internal tool, this might be €100–€500 per month. For a high-volume customer-facing feature, it could be thousands or tens of thousands. Self-hosting models shifts this cost from a variable API bill to a fixed cost for GPU servers (€1,500–€5,000+ per month per server).
- Vector Storage: If your application uses Retrieval-Augmented Generation (RAG), you'll need a vector database to store your data embeddings. Services like Pinecone, Weaviate, or managed Postgres with
pgvectorare common. This can range from €100 to over €1,000 per month, depending on the volume of data and query load. - Observability & Evaluation: How do you know if your AI is working well? You need tools to log requests, responses, and user feedback. Services like LangSmith or Arize help monitor performance, detect drift, and debug issues. Budget €200–€600 per month for these, plus the engineering time to analyse the results.
- Maintenance & Support: This is the most commonly forgotten cost. An AI system is not static. The underlying data changes, models are updated, and user expectations evolve. You need to budget for ongoing engineering time to retrain, fine-tune, update dependencies, and fix bugs. For a business-critical system, we recommend allocating at least 0.25 FTE of a dedicated engineer (€30k–€40k per year).
Worked example 1: Internal knowledge assistant
A 150-person scale-up wants to build an internal chatbot to answer questions based on their corporate knowledge, stored in Confluence, Google Drive, and Slack.
- Scope: A web-based chat interface where employees can ask questions. The system retrieves relevant documents and uses an LLM to generate an answer with sources.
- Cost Drivers Analysis:
- Data Readiness: Medium. Data is in three modern systems with APIs, but formats are mixed (docs, sheets, slides, PDFs). Some data cleaning will be needed.
- Integration Surface: Low. A read-only system. Integration is primarily with data sources, not business workflows. Authentication is handled via Google SSO.
- Accuracy Bar: Low. If the answer is imperfect, users can check the linked source documents. No financial or legal risk.
- Compliance: Low. All data is internal and no PII is explicitly stored by the AI system.
- Scale: Low. 150 potential users, with maybe 20-30 active daily.
Here is a simplified view of the RAG architecture we would implement:
+-------------+ +----------------+ +-------------------+ +----------------+
| User's |----->| Application |----->| Embedding Model |----->| Vector |
| Question | | Backend (API) | | (e.g., text-emb-3)| | Database |
+-------------+ +----------------+ +-------------------+ | (e.g., Pinecone)|
| | (stores doc chunks)
| V
| +--------------------+ +----------------+
+----->| LLM Provider |<-----| Relevant |
| | (e.g., GPT-4o API) | | Document Chunks|
V +--------------------+ +----------------+
+-------------+
| Generated |
| Answer with |
| Sources |
+-------------+
Build Cost Estimate (10-14 weeks): This project aligns with an accelerated MVP development approach.
- Discovery & Scoping (1.5 weeks): €10,500
- PoC & Core Logic (2 weeks): €14,000 (Build connectors, test embedding/retrieval on a sample of data)
- MVP Build (6 weeks): €42,000 (Build UI, set up data ingestion pipelines, add auth and logging)
- Hardening & Deploy (1 week): €7,000
- Total Build Cost: €73,500
The final cost would likely fall in the €45,000 to €90,000 range, depending on the true messiness of the data sources discovered during the audit.
Worked example 2: Customer-facing AI product feature
A Series B logistics platform wants to add an AI-powered "shipment risk forecaster" to its main dashboard. The feature will analyse shipment data, weather forecasts, and historical delays to predict the probability of a delay for in-progress shipments.
- Scope: An AI feature integrated into the customer dashboard. It must provide a risk score (Low, Medium, High) and a short natural language explanation for its reasoning.
- Cost Drivers Analysis:
- Data Readiness: Medium-High. Shipment data is structured in their core database, but historical data is patchy. It needs to be combined with unstructured external data (news, weather APIs). Significant feature engineering is required.
- Integration Surface: High. Must integrate with the core product's authentication, front-end, and database. It needs to update in near real-time as shipment statuses change.
- Accuracy Bar: High. Customers will make operational decisions based on these forecasts. False negatives (missing a likely delay) are costly. The reasoning must be plausible and defensible.
- Compliance: Medium. While not PII, the data is commercially sensitive. All processing must happen in a secure, private environment.
- Scale: Medium. Thousands of customers, each tracking hundreds of shipments. Needs to handle a moderate, spiky query load.
Build Cost Estimate (16-24 weeks): This is a core AI engineering project that requires a multidisciplinary team.
- Discovery & Scoping (2 weeks): €28,000 (Includes deeper data science exploration)
- Prototype / PoC (4 weeks): €56,000 (Build and evaluate multiple predictive models)
- MVP Build (10 weeks): €140,000 (Full backend/frontend integration, explanation generation, robust data pipelines)
- Hardening & Deploy (2 weeks): €28,000 (Performance testing under load, security audit)
- Total Build Cost: €252,000
The cost for such a project would realistically land between €120,000 and €260,000. The range is dictated by the complexity of the models needed to achieve the required accuracy and the number of systems that need to be integrated.
Worked example 3: Multi-team AI platform
A large European insurer wants to empower its internal product teams (e.g., claims, underwriting, marketing) to build their own AI features. Instead of funding one-off projects, they want to build a central platform.
- Scope: A set of APIs, SDKs, and infrastructure that provides shared capabilities: a secure "AI gateway" to commercial models, a managed RAG service, a feature store for underwriting data, and templates for building and deploying simple AI services.
- This is not a project; it's a product. The cost is not a one-time build but an ongoing investment in a dedicated platform team.
- Initial Build (Year 1): The initial effort to build v1 of the platform might cost €400,000–€750,000. This involves significant platform and data engineering to create secure, multi-tenant, and easy-to-use tools. The team would consist of 2-3 platform/backend engineers, 1-2 AI/MLOps engineers, and a product manager.
- Ongoing Cost (Year 2+): The platform requires a permanent "run" team of 3-5 engineers to maintain the infrastructure, add new capabilities, and support the internal teams using it. This represents an annual cost of €500,000+ in salaries and infrastructure, separate from the budgets of the teams building features on the platform.
While the initial investment is high, this approach can be cost-effective for large organisations by preventing dozens of teams from reinventing the wheel. It centralises expertise, enforces security and compliance standards, and accelerates the delivery of business value from AI. The journey from a single idea to a production system is complex, and for large organisations, a platform approach can streamline this process significantly, a topic we explore further in our guide to Generative AI Development: From Idea to Production.
How to cut 30% out of a quote without cutting quality
When faced with a quote that exceeds your budget, the temptation is to ask for a discount or shop around for a cheaper provider. These are often mistakes that lead to poor outcomes. Instead, focus on reducing the scope and complexity of the project.
- Shrink the Integration Surface: Does the MVP really need to write data back into Salesforce? Can the first version be a standalone tool that users manually reference? Every integration you defer is a significant reduction in complexity and cost.
- Lower the "Good Enough" Bar for V1: Instead of demanding 99% accuracy, could you launch with 85% accuracy and a clear feedback mechanism? For the logistics example, perhaps V1 doesn't need a natural language explanation, but just the risk score.
- Invest in Data Prep Yourself: The most expensive and unpredictable part of an AI project is often data wrangling. If you can dedicate your own internal team to cleaning and organising the source data into a single, clean API endpoint before the AI engineering team starts, you can dramatically reduce their time and your cost.
- Simplify the Scope, Not the Team: A 30% smaller scope delivered by a senior team will yield a better, more robust outcome than the full scope delivered by a cheaper, more junior team. Do not cut costs on the quality of the engineers or the discovery phase. This is the classic mistake we warn against when advising companies on how to choose an AI development company. A robust discovery phase is your best tool for de-risking the project.
Total cost of ownership over 24 months
To make a sound investment decision, you must consider the total cost over the system's life, not just the initial build. Here’s a 24-month TCO comparison for our two main worked examples.
| Cost Item | Example 1: Internal Knowledge Assistant | Example 2: Customer-Facing Feature |
|---|---|---|
| Initial Build Cost | €73,500 | €252,000 |
| Monthly Run Costs | ||
| - Inference (API calls) | €250 | €2,000 |
| - Vector DB & Hosting | €150 | €400 |
| - Observability Tools | €100 | €500 |
| Total Monthly Run Cost | €500 | €2,900 |
| Annual Run Cost | €6,000 | €34,800 |
| Annual Maintenance | ||
| - Engineering (0.1 FTE) | €15,000 | €37,500 (0.25 FTE) |
| Total Annual Cost (Run + Maint.) | €21,000 | €72,300 |
| 24-Month TCO | €73,500 (Build) + 2 * €21,000 | €252,000 (Build) + 2 * €72,300 |
| = €115,500 | = €396,600 |
This clarifies the long-term commitment. The run cost for the simpler internal tool is modest. For the customer-facing feature, the annual run and maintenance cost is nearly 30% of the initial build cost, a significant ongoing line item that must be factored into the product's overall ROI calculation.
Frequently asked questions
How much does it cost to build an AI app?
For most businesses, the first production-grade AI application costs between €45,000 and €260,000 to design and build. The wide range is not due to the AI model itself, which is a small part of the cost. The final price is dominated by the readiness of your data and the number of existing systems the application needs to connect with. A simple internal tool using clean data is at the lower end, while a customer-facing feature deeply integrated into your product is at the higher end.
What are the ongoing costs of running an AI application?
A reliable rule of thumb is to budget 15–25% of the initial build cost per year for ongoing operations. This covers variable costs like API calls for inference and vector storage, as well as fixed costs for observability tooling. Crucially, this budget must also include the cost of engineering time for maintenance, monitoring, and periodic updates. For any system that is business-critical, you should have a named engineer who is responsible for its health, which has a real cost.
Is it cheaper to use an API model or train your own?
For over 90% of business use cases we encounter, using a hosted frontier model API (like those from OpenAI, Anthropic, or Google) combined with a good retrieval system (RAG) is substantially cheaper and faster end-to-end. The cost and complexity of sourcing data, training, and especially hosting your own custom model is immense. Fine-tuning or training from scratch only becomes economically viable at extremely high volumes, for applications with strict low-latency requirements, or in rare cases where the domain vocabulary and structure are genuinely unique and not well-represented in existing models.
Key takeaways
- The AI model is not the main cost driver. The real costs are in data preparation, system integration, and ensuring accuracy and compliance.
- Budget for a team, not just an "AI guy". A production application requires data engineering, backend development, and product management alongside AI expertise.
- A typical first AI application costs between €45k and €260k to build, with costs determined by complexity, not the algorithm.
- Plan for ongoing "run" costs of 15-25% of the initial build cost per year. This includes inference, hosting, tools, and crucial engineering maintenance.
- To reduce project costs, shrink the scope. Defer integrations and relax the accuracy bar for the first version rather than compromising on the quality of the engineering team.
- Total cost of ownership over two years can be 1.5x to 2x the initial build cost, especially for business-critical applications requiring significant maintenance.
Building a successful AI application requires a clear understanding of all the costs involved, from the first line of code to long-term operation. With this numerate approach, you can create a realistic budget and a solid business case for your investment.
Ready to move from a rough estimate to a detailed, actionable project plan? Our discovery process helps you accurately map the costs and de-risk your project.

