Bishwa Bastola

@fthrviwallet · AFps…pCHy

papers

ticks

crosses

Publishing on PNL since Apr 2026

The shelf

Research · May 11, 2026

Nakshatra: Vendor-Agnostic Distributed Inference on Heterogeneous Consumer Hardware

A distributed inference engine that splits one large transformer model across mismatched consumer machines (Mac, Linux, AMD, NVIDIA, CPU) by patching llama.cpp to load partial models and ship 16 KB hidden states between layers per token. v0.1 is validated against a single-machine reference. The larger goal is a personal compute realm spanning inference (Nakshatra), coordination (Sthambha), and a long-running agent (Prithvi) — surviving any one device dying.

✓1✗0

Research · Apr 30, 2026

kjoi

jh,mnjbiulgjhmn.m

✓0✗0

Research · Apr 30, 2026

sdf

sdfsdf

✓0✗0

Cited in 1 project

Nakshatra
$NAKSHATRA
thesis