apple-foundation-models
Apple Foundation Models Skill
When to Use This Skill
Use this skill when you need help with:
- On-device AI: Building iOS/macOS apps with on-device language models
- SystemLanguageModel: Working with Apple's on-device LLM API
- Guided Generation: Generating structured Swift types from prompts
- Tool Calling: Extending model capabilities with custom tools
- Prompting: Crafting effective prompts for on-device models
- Safety: Implementing guardrails and handling sensitive content
- Localization: Supporting multilingual AI features
This skill covers iOS 26.0+, iPadOS 26.0+, macOS 26.0+, and visionOS 26.0+.
Description
Use this skill when working with Apple's Foundation Models framework for on-device AI and LLM capabilities in iOS/macOS apps. Covers SystemLanguageModel, LanguageModelSession, guided generation, tool calling, and prompting patterns.
Quick Reference
Core Components
Advanced
TranscriptTranscript.EntryTranscript.ResponseTranscript.ResponseFormatTranscript.SegmentTranscript.StructuredSegment
Api Reference
FoundationModelsGenerationIDSystemLanguageModelSystemLanguageModel.AdapterSystemLanguageModel.GuardrailsSystemLanguageModel.UseCase
Getting Started
SystemLanguageModel.Availability
Guided Generation
DynamicGenerationSchemaGenerableGenerationGuideGenerationSchemaGuide
Localization
LanguageModelFeedback
Prompting
InstructionsInstructionsBuilderInstructionsRepresentableLanguageModelSessionLanguageModelSession.GenerationErrorLanguageModelSession.ToolCallErrorPromptPromptBuilderPromptRepresentableTranscript.InstructionsTranscript.Prompt
Tool Calling
Tool
Key Concepts
Platform Support
- iOS 26.0+
- iPadOS 26.0+
- macOS 26.0+
- Mac Catalyst 26.0+
- visionOS 26.0+
On-Device AI
All models run entirely on-device, ensuring privacy and offline capability.
Usage Guidelines
- Check model availability before use
- Define clear instructions for the model's behavior
- Use guided generation for structured outputs
- Implement tool calling for dynamic capabilities
- Handle errors appropriately
Navigation
See the references/ directory for detailed API documentation organized by category:
references/advanced.md- Advancedreferences/api_reference.md- Api Referencereferences/getting_started.md- Getting Startedreferences/guided_generation.md- Guided Generationreferences/localization.md- Localizationreferences/prompting.md- Promptingreferences/tool_calling.md- Tool Calling
Best Practices
- Prompting: Be specific and clear in your prompts
- Instructions: Define the model's behavior upfront
- Safety: Enable guardrails for sensitive content
- Localization: Check supported languages for your use case
- Performance: Use prewarm() for better response times
- Streaming: Use streamResponse() for real-time user feedback
Common Patterns
Basic Session
let model = SystemLanguageModel(useCase: .general)
let session = LanguageModelSession(model: model)
let response = try await session.respond(to: Prompt("Your question"))
Guided Generation
struct Recipe: Generable {
let title: String
let ingredients: [String]
}
let recipe = try await session.respond(
generating: Recipe.self,
prompt: Prompt("Create a pasta recipe")
)
Tool Calling
struct WeatherTool: Tool {
func call(arguments: String) async throws -> String {
// Fetch weather data
}
}
let session = LanguageModelSession(
model: model,
tools: [WeatherTool()]
)
Reference Documentation
For complete API details, see the categorized documentation in the references/ directory.
More from ios-agent/iosagent.dev
metal-gpu
>
128swiftui
SwiftUI framework for building user interfaces
90widgetkit
Build iOS/macOS/watchOS/visionOS widgets, Live Activities, watch complications, and controls using Apple's WidgetKit framework. Use when creating widget extensions, timeline providers, configurable widgets, Lock Screen widgets, Smart Stack widgets, Live Activities with ActivityKit, interactive widgets with buttons/toggles, or watch complications. Covers all widget families (systemSmall/Medium/Large/ExtraLarge, accessoryCircular/Rectangular/Inline/Corner) and rendering modes.
44carplay
CarPlay framework for iOS in-car applications — audio, communication, navigation, parking, EV charging, quick food ordering, fueling, driving task, public safety, and voice-based conversational apps. Includes widgets, live activities, CarPlay Ultra, and instrument cluster support.
42apple-corelocation
>
39mapkit
Help developers integrate Apple MapKit into iOS/macOS apps. Use this skill when users ask to add a map to their app, display maps, show user location on a map, add markers/pins/annotations, implement map clustering, get directions/routing between locations, search for places/points of interest, implement MapKit features, work with MKMapView, SwiftUI Map, MKAnnotation, MKOverlay, MKDirections, MKLocalSearch, or any MapKit-related development task.
38