Start with the words you need
Microsoft Foundry reuses the same vocabulary across the portal, SDK, and docs. Learn these terms first, because later concepts in this course assume you know them. Older material may still say Azure AI Studio or Azure AI Foundry; Microsoft documents those names as earlier brands for the same platform, now called Microsoft Foundry.
| Term | What it means |
|---|---|
| Model | A generative model that turns a prompt into output. Foundry exposes many models through the Foundry Models catalog from Microsoft, OpenAI, Anthropic, Meta, and others. |
| Model deployment | A named endpoint that makes a chosen model available to your app or agent. Your requests use the deployment name, not only the model name. |
| Agent | A model plus instructions, tools, and prompts, set up to handle a task across a conversation. A prompt agent is built from settings in the portal or SDK; a hosted agent runs your own code in a container that Foundry hosts for you. |
| Tool | Something the agent can call, such as file search, web search, a code interpreter, a function you define, or an MCP server connection. |
| Foundry resource | The top-level Azure account object for Foundry. It holds the shared rules: networking, security, model deployments, and connections to other services. |
| Foundry project | A workspace inside the resource where teams build and evaluate a use case. Projects reuse resource-level deployments and connections without repeating IT setup. |
| Project endpoint | The web address your code calls to reach a project's models and agents, for example https://<resource-name>.services.ai.azure.com/api/projects/<project-name>. Copy it from the welcome screen or project details in the Microsoft Foundry portal. |
What Microsoft Foundry is
Microsoft Foundry is Azure's unified place to build and run AI applications that combine models, agents, and tools. In plain terms, it is one management home for those pieces, with tracing, monitoring, and evaluations built in. You set who has access, how networking works, and which policies apply in one place, instead of opening a separate admin screen for every AI service.
Day to day, the Foundry resource sets the rules: which models are deployed, how networking works, and who has permission. Foundry projects are where builders work: agents, evaluation runs, uploaded files, and other work scoped to that project live there. Connected Azure services such as Storage, Key Vault, and Azure AI Search remain separate resources with their own rules; Foundry links to them through connections, and you manage their policies alongside the Foundry resource.
The Microsoft Foundry portal is the main website for exploring the model catalog, using playgrounds, building prompt agents, running evaluations, and administering resources. You can also use SDKs, the Azure Developer CLI, and Visual Studio Code extensions, but the portal is where most beginners find their way around before they write code.
The problem it solves
A production AI feature rarely needs only a model API. A support agent for an online shop needs instructions that stay consistent across turns, a tool that looks up orders, a way to test answers before customers see them, logs when tool calls fail, and access control so only the right people can change production settings. Without a platform, a team wires together model hosting, secret storage, search, monitoring, and identity by hand.
- Model access and deployments, including quotas and region availability.
- Agent hosting, conversation state, and tool execution through Foundry Agent Service.
- Knowledge retrieval through file search, vector stores, or Azure AI Search indexes.
- Observability through tracing, metrics, and evaluations tied to the same project.
- Governance through role-based access, guardrails, and (at scale) Foundry Control Plane fleet views.
How the resource, project, and connections fit together
Foundry uses layers on purpose. IT and security teams apply centralized controls on the Foundry resource, while product teams experiment inside projects without setting up shared model capacity again each time. Microsoft recommends a Foundry resource with one project as the default starting point for a single developer exploring the platform.
| Layer | Scope | What lives here |
|---|---|---|
| Foundry resource | Subscription / region | Model deployments, networking and security settings, connections to Storage, Key Vault, and Azure AI Search, billing for shared infrastructure. |
| Foundry project | Inside one resource | Agents, evaluations, files, and other artifacts for one team or use case; project endpoint for API calls. |
| Project assets | Inside one project | Individual agents and versions, evaluation results, uploaded files, and tool configurations scoped to that project. |
| Connected resources | Separate Azure resources | Storage accounts, Key Vault, Azure AI Search indexes, and similar services you connect to Foundry; each keeps its own access policies. |
What you do first in the portal
The agent development lifecycle in Foundry runs from creation through monitoring in production: choose an agent type, create and test in the Agents playground or in code, add tools, save versions, trace runs, evaluate quality, publish a stable endpoint, then monitor and improve. You do not need every step on day one, but the order explains why the portal groups models, agents, and evaluations together.
- Sign in to the Microsoft Foundry portal. For instant access models during preview, turn on the New Foundry toggle and work in Foundry (new), not the classic portal.
- Create or open a Foundry resource and a Foundry project. Concept 2 in this course walks through the screens; for a guided setup, use the quickstart linked under Go deeper.
- Explore models in the Foundry Models catalog or a model playground. When you deploy a model in the portal, you land on that model's playground to tune prompts and compare outputs.
- Choose how to call models: create a model deployment with a deployment name, or during preview use instant access models in a West US 3 project to call supported model names such as gpt-5-mini without creating a deployment first.
- Copy the project endpoint from the welcome screen or project details when you move to the SDK or code; sign in with Microsoft Entra instead of embedding long-lived keys in source code.
Example: order support for an online shop
Imagine a small e-commerce team wants a chat assistant that answers "Where is my order?" using real order data, stays polite and on-topic, and escalates refunds to humans. They are not ready to host their own containers, so they start with a prompt agent in Foundry Agent Service.
- Pick a model from the catalog (or an instant access model name during preview in West US 3) and set instructions that describe tone, what the agent may promise, and when to hand off to staff.
- Attach tools: file search or Azure AI Search for policy documents, plus a function or API tool that looks up order status from the shop's backend.
- Test in the Agents playground, save a version when behavior looks right, and run an evaluation dataset before exposing the agent to customers.
- Use tracing to confirm the agent calls the order tool with the right arguments, then publish when metrics look stable.
The same Foundry project holds the agent definition, evaluation runs, and traces, while the Foundry resource supplies shared model deployments and security settings. That split is the practical idea behind one management home for Foundry: builders improve work inside the project; administrators set rules at the resource level.
Costs, instant access, and the model catalog
The Foundry platform itself is free to use and explore. Each product you consume inside Foundry, such as model inference, Agent Service usage, or Azure AI Search, bills at that product's normal rate. Microsoft's pricing FAQ states that you do not need an Azure account to explore Foundry, but you need an Azure subscription before you start building agents.
- Estimate spend with the Microsoft Foundry pricing pages and the Azure pricing calculator before you run large evaluations or high-traffic deployments.
- Instant access models (preview) let you call supported models by model name with no deployment. The same SDKs and clients work; you pass a name such as gpt-5-mini instead of a deployment name.
- During preview, instant access is available only for Foundry projects in West US 3. Deployments remain the right choice when you need reserved throughput, custom content filters, data residency, or other enterprise deployment settings.
- Preview features are offered under supplemental terms and are not recommended for production workloads until you confirm support for your region and scenario.
| Source | What it says |
|---|---|
| What is Microsoft Foundry? (Learn) | Access to more than 10,000 models from Microsoft, OpenAI, Anthropic, Meta, and others. |
| Microsoft Foundry pricing (Azure) | Foundry Models access to more than 11,000 foundation, open, reasoning, multimodal, and industry-specific models. |
The catalog grows frequently, so treat the exact count as a moving target. The practical takeaway is that you compare models in the catalog and benchmarks before you commit to a deployment, and you can route requests with features such as model router when you need cost and quality trade-offs at scale (covered in later concepts).
Common mistakes and what to do next
- Assuming free to explore means free inference. Model tokens, agent runtime, and connected services still bill when you use them.
- Creating agents in the playground but never saving versions. Unsaved changes are lost if you leave the Microsoft Foundry portal; saved versions are required for full evaluation and monitoring workflows.
- Calling a model by its catalog name in production code while only a deployment exists, or the reverse during instant access preview in the wrong region.
- Treating Storage, Key Vault, or Azure AI Search as part of the Foundry resource. They are connected resources with separate networking and access rules.
- Giving everyone broad admin rights. Docs recommend the Foundry User role for developers on the resource as a common starting point; creating a deployment is an admin-style action, while running an agent is day-to-day use, and those permissions can be assigned separately.
Concept 2 in this course shows where you work inside the Microsoft Foundry portal: projects, playgrounds, Manage versus Operate, and how that maps to the resource hierarchy described here.
Go deeper
- Official overview of the platform, evolution from Azure AI Studio, and recommended paths for new developers: What is Microsoft Foundry?
- More detail on how resources, projects, roles, deployments, and connected services fit together: Microsoft Foundry architecture
- Step-by-step setup of a resource, project, and first model deployment: Create Foundry resources
- FAQ on free exploration, subscriptions, and how each service bills: Microsoft Foundry pricing