Related Posts
ai startup development
PostgreSQL WAL shipping: cross-region failover that survives a primary outage
Deep dive into WAL shipping mechanics — segment archiving vs streaming replication, replication slot retention hazards, standby lag monitoring with pg_stat_repl
· 5 min read
ai startup development
On-device speculative decoding with Phi-4-Mini on Android
Speculative decoding with a draft model on-device: how to size draft token sequences, manage KV-cache splits between draft and target models, and measure the ac
· 5 min read
ai startup development
Wiring Android's MediaPipe LLM Inference API to a Retrieval-Augmented Generation Pipeline: Embedding Models, Vector Search, and the Context Window Budget That Fits On-Device
How to combine a quantized on-device embedding model with an HNSW index stored in SQLite-vec to perform semantic retrieval before passing augmented context to a
· 5 min read