Skip to content

Failed to build the model after switching to .cpuAndNeuralEngine #31

@TheBonnec

Description

@TheBonnec

Model Used : StatefulMistral7BInstructInt4.mlpackage from apple/mistral-coreml
Hardware : M3 MacBook Air
macOS Version: 15.1.1

The problem occured after changing

return try LanguageModel.loadCompiled(url: lastURL, computeUnits: .cpuAndGPU)

to

return try LanguageModel.loadCompiled(url: lastURL, computeUnits: .cpuAndNeuralEngine)

in ModelLoader.swift line 45

The app builds and runs normally, but doesn't load the model.

Before that single change, the app was working without problems, and when reverting the change it worked again.
I tried to remove the files at /Users/myuser/Library/Application Support/hf-compiled-transformers/StatefulMistral7BInstructInt4.mlmodelc/model.mil but it did nothing.

Here is the error message that appeared in the terminal :
No model could be loaded: Error Domain=com.apple.CoreML Code=0 "Failed to build the model execution plan using a model architecture file '/Users/myuser/Library/Application Support/hf-compiled-transformers/StatefulMistral7BInstructInt4.mlmodelc/model.mil' with error code: 14." UserInfo={NSLocalizedDescription=Failed to build the model execution plan using a model architecture file '/Users/myuser/Library/Application Support/hf-compiled-transformers/StatefulMistral7BInstructInt4.mlmodelc/model.mil' with error code: 14.}

I can provide more info if needed

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions