Compiled with the command:
cargo build --release --no-default-features
Line 159-166 in the file /crates/larq-cli/src/commands/primary/bench_cmd.rs
Did not compile on linux. I changed the line as a workaround to:
let backend: Box<dyn larql_compute::ComputeBackend> = if metal {
/* let b = larql_compute::metal::MetalBackend::new()
.ok_or("Metal backend unavailable — rebuild with --features metal on an M-series Mac")?;
Box::new(b) */
Box::new(larql_compute::CpuBackend)
} else {
Box::new(larql_compute::CpuBackend)
};
as a workaround since I am not using a Mac. I don't know enough about Rust to create a proper workaround for this structure.
Have successfully run:
./larql --version
I saw your YouTube video explaining this and I am really excited about getting this running. I had the same thought as you, isn't LLM just running on a database? Thank you for putting in the hard work to show us this is possible!
Compiled with the command:
cargo build --release --no-default-features
Line 159-166 in the file /crates/larq-cli/src/commands/primary/bench_cmd.rs
Did not compile on linux. I changed the line as a workaround to:
/* let b = larql_compute::metal::MetalBackend::new()
.ok_or("Metal backend unavailable — rebuild with
--features metalon an M-series Mac")?;Box::new(b) */
Box::new(larql_compute::CpuBackend)
} else {
Box::new(larql_compute::CpuBackend)
};
as a workaround since I am not using a Mac. I don't know enough about Rust to create a proper workaround for this structure.
Have successfully run:
./larql --version
I saw your YouTube video explaining this and I am really excited about getting this running. I had the same thought as you, isn't LLM just running on a database? Thank you for putting in the hard work to show us this is possible!