Learning AI

This repository contains notes and code examples related to AI.

In-progress

• CUDA FA exploration: notes

Topics

• Tokenization
• Architectures
• GGML
• Llama.cpp
• Position Embeddings
• GPUs
• Vector Databases
• Vision
• llama.cpp backend sampling: notes, pull request

Examples/Exploration code

• GGML GGML C library exploration code
• Llama.cpp Llama.cpp library exploration code
• GPU CUDA, Kompute, Metal, OpenCL, ROCm, and Vulkan exploration code
• Embeddings Word embeddings examples in Rust and Python
• Huggingface API Huggingface API example written in Python
• Qdrant Vector Database Examples in Python and Rust
• LanceDB Vector Database Examples in Python and Rust