Package: Rllm 0.1.0

Sounkou Mahamane Toure

Rllm: Native Quantized Matrix Products and LLM Inference over 'Rfmalloc' Tensors

The composition layer of the 'Rfmalloc' ecosystem: it registers 'Rggml' (a vendored 'GGML' build with runtime-SIMD-dispatched quantized kernels) as a codec-aware matrix-multiply backend for 'Rfmalloc', so that products of file-backed, quantized tensors run natively in quantized space (weights stay 'Q4_K'/'Q6_K'/... encoded, activations are quantized on the fly) instead of being decoded to double first. Combined with 'Rgguf', which exposes 'GGUF' model weights as borrowed typed spans, this lets a larger-than-memory model's linear layers be multiplied through 'GGML's SIMD-accelerated dot kernels zero-copy from the original model mapping. Typed semantic programs written through an R module-and-pipe architecture language describe llama, Qwen3.5, LFM2MoE, EmbeddingGemma, ESM-2, OpenSpliceAI, Evo 2 and Tiny Recursive Models. Bound programs join those serializable graphs to mapped parameter storage. Implemented lowerings provide persistent state, pooled embeddings, byte-level generation, and CPU or optional CUDA execution; a reference interpreter executes the same dataflow through explicit R operator tables and structured recurrence.

Authors:Sounkou Mahamane Toure [aut, cre]

Rllm_0.1.0.tar.gz
Rllm_0.1.0.zip(r-4.7-x86_64)Rllm_0.1.0.zip(r-4.7-arm64)Rllm_0.1.0.zip(r-4.6-x86_64)Rllm_0.1.0.zip(r-4.6-arm64)Rllm_0.1.0.zip(r-4.5-x86_64)
Rllm_0.1.0.tgz(r-4.6-x86_64)Rllm_0.1.0.tgz(r-4.6-arm64)Rllm_0.1.0.tgz(r-4.5-x86_64)Rllm_0.1.0.tgz(r-4.5-arm64)
Rllm_0.1.0.tar.gz(r-4.7-arm64)Rllm_0.1.0.tar.gz(r-4.7-x86_64)Rllm_0.1.0.tar.gz(r-4.6-arm64)Rllm_0.1.0.tar.gz(r-4.6-x86_64)
Rllm_0.1.0.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
Rllm/json (API)

# Install 'Rllm' in R:
install.packages('Rllm', repos = c('https://rgenomicsetl.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/sounkou-bioinfo/rfmalloc/issues

On CRAN:

Conda:

altrepblasgenomicsggmlggufllmllm-inferencemallocmemory-mappedmmapout-of-corequantizationsimd

3.54 score 4 stars 25 scripts 25 exports 3 dependencies

Last updated from:156efa6ec1. Checks:12 OK, 3 NOTE. Indexed: yes.

TargetResultTimeFilesSyslog
linux-devel-arm64OK91
linux-devel-x86_64OK105
source / vignettesOK243
linux-release-arm64OK83
linux-release-x86_64OK105
macos-release-arm64OK87
macos-release-x86_64OK223
macos-oldrel-arm64NOTE128
macos-oldrel-x86_64NOTE304
windows-devel-arm64OK181
windows-devel-x86_64OK114
windows-release-arm64OK177
windows-release-x86_64OK67
windows-oldrel-x86_64NOTE72
wasm-releaseOK89

Exports:rllm_attentionrllm_backend_enabledrllm_decoderllm_embedrllm_encoderllm_executerllm_forwardrllm_generaterllm_gguf_modelrllm_inputrllm_inputsrllm_kv_cacherllm_linearrllm_looprllm_modulerllm_normrllm_oprllm_parameterrllm_planrllm_poolrllm_programrllm_quantize_tensorrllm_residualrllm_taprllm_use_ggml

Dependencies:RfmallocRggmlRgguf