On-device system model

Apple Foundation Models from Java

Use Apple's OS-managed SystemLanguageModel directly inside a Java 25 application through the Models JVM inference library. Prompts and responses stay on the Mac.

Runtime: In-process Java FFM
Model weights: Managed by macOS
Artifact download: None

A different local runtime

Apple Foundation Models is not a downloadable ModelJAR. Apple supplies and updates the private model weights with the operating system. Models connects Java to Apple's Foundation Models framework through the final FFM API and a small Models-owned Swift binary.

This OS-managed runtime has its own page so it does not interfere with the searchable catalog of versioned model artifacts. It still implements Models' TextGenerationModel contract, including the LangChain4J and Spring AI adapters.

Run it from Java

Add the Apple backend

dependencies {
  implementation("com.integrallis:backend-apple:0.2.6")
}

Check availability and generate

import com.integrallis.models.backend.apple.AppleFoundationModels;

try (var client = AppleFoundationModels.create()) {
  var status = client.availability();
  if (!status.available()) {
    throw new IllegalStateException(status.reason());
  }

  var answer = client.generate(
      "Summarize this locally.").text();
}

Launch with --enable-native-access=ALL-UNNAMED. Always check availability(); hardware support, Apple Intelligence settings, and model readiness can differ by machine and user.

Requirements

Hardware: A supported Apple Silicon Mac.
Operating system: Apple Intelligence must be available, enabled, and ready for the current user.
Java: Java 25 with native access enabled for the application.

Read the Apple backend guide Apple API documentation