ampere

llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx

Kindi 0.4: local LLM inference on low-cost NVIDIA GPUs, Radeon 780M and CPUs. Bonsai 2B-27B, AH-Nanbeige4.3-33B and experimental Nemotron, with an OpenAI-compatible server.

Arduino library for INA226 power sensor

GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, one-command container install

Pre-built wheels for llama-cpp-python across platforms and CUDA versions

Enable NVIDIA Smooth Motion on RTX 30-series / Ampere SM86 - one-click Windows utility, no per-game DLSS-FG integration required.

Ampere optimized llama.cpp

llama.cpp speculative decoding measured on one RTX 3090, Qwen3.6-35B-A3B UD-Q4_K_XL, commit 3737e4137. Published figures are re-derived from the committed data by a checker that fails on drift, a coverage probe reports how many of them it actually covers, and ERRATA.md lists this study's own retracted claims.

Cross-platform FlashAttention-2 Triton implementation for Turing+ GPUs with custom configuration mode

vLLM for NVIDIA CMP 170HX (Ampere sm_80): fast, repeatable model serving on one card or several

Setup instructions for running Valheim on Oracle Cloud Infrastructure using Arm also available at https://codeberg.org/husjon/valheim_server_oci_setup

AML's goal is to make benchmarking of various AI architectures on Ampere CPUs a pleasurable experience :)

DACAN (Дацан): Qwen3.8-Flash-Next (125B MoE) on any NVIDIA RTX 20/30/40/50 card and any x86-64 CPU with AVX2, AVX-512 not required. One or two cards, one or two sockets, context up to 1M (1,048,576 tokens).

Grab an Oracle Cloud ARM Ampere A1 Free Tier instance in saturated regions — calibrated timing, FD rotation, 429 backoff, Telegram notifications

One-command installer + terminal control panel for a modded Project Zomboid Build 42 dedicated server on ARM64 (Oracle Cloud Ampere / box64).

DeepSeek-V4.1-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 297 tok/s for one user, up to 868 tok/s at eight, 262K context, one-command container install

Arduino energy monitor, using SCT-013-030 current sensors

Performance characterization and analysis tool for Ampere CPUs

GPTQ optimized for Ampere (RTX 3090/3060) — Marlin JIT nvcc compatibility fixes included

We are a fosshost project which is delivering ARM-based hardware into multiple, global data centers. We document and keep a diary of our project daily.