GPU Engineer
Contrat, télétravail, salaire, région : indique tes envies pour voir si cette offre les respecte.
Description du poste
About Kog At Kog, we're building real-time LLM inference for AI agents. Coding agents execute sequences of tasks where each step depends on the model's previous response. The faster the model generates tokens, the faster these agents can reason, code, and act. Our approach is to co-design model architecture, the inference engine, and low-level GPU kernels to minimize generation latency on standard NVIDIA and AMD datacenter GPUs. We've developed several technologies to make this possible: Monokernel: a persistent GPU program that keeps the entire token generation loop on the GPU, avoiding CPU handoffs. KCCL: our custom inter-GPU communication layer, designed to minimize latency. Delayed…
Lire l'annonce complète sur Arbeitnow