Rduckhts - 'DuckDB' High Throughput Sequencing File Formats Reader Extension
Bundles the 'duckhts' 'DuckDB' extension for reading High Throughput Sequencing file formats with 'DuckDB'. The 'DuckDB' C extension API <https://duckdb.org/docs/stable/clients/c/api> and its 'htslib' dependency are compiled from vendored sources during package installation. James K Bonfield and co-authors (2021) <doi:10.1093/gigascience/giab007>. VariantKey / RegionKey support follows Nicola Asuni (2018) <doi:10.1101/473744>.
Last updated
bamduckdb-extensionfastqhtslibvcf
6.88 score 19 stars 2 dependents 37 scripts 355 downloadsRducks - Register R User-Defined Functions in DuckDB
R package and 'DuckDB' extension bridge for registering R functions as 'DuckDB' user-defined functions (UDFs). The package is designed around a loaded 'DuckDB' extension, declarative type descriptors, direct native vector marshalling, and explicit execution discipline for safe interaction with R from 'DuckDB' execution. The inter-process worker transport uses vendored 'NNG' (nanomsg next generation).
Last updated
cduckdb-extension
5.82 score 9 stars 27 scriptsRopendal - Abstract Filesystem Access for R via 'Apache OpenDAL'
Provides a byte-oriented abstract filesystem interface for R backed by the Rust crate of 'Apache OpenDAL' <https://opendal.apache.org/>. The package is designed around filesystem primitives, asynchronous Aio-like operations inspired by 'nanonext', pluggable raw-vector serializers, and a native C API for direct async byte access by other R packages.
Last updated
filesystemopendalrustcargo
5.45 score 5 stars 25 scriptsRfmalloc - Out-of-Core Arrays with Pluggable Codecs and Compute Backends
Computes on arrays that do not fit in memory. Vectors, matrices and tensors are allocated inside a memory-mapped file through R's ALTREP interface, backed by a patched copy of the 'fmalloc' allocator, so available RAM becomes a speed gradient rather than a hard limit. Two plugin registries sit on that substrate: a codec registry deciding how bytes are stored, from lossless floating-point and sparse encodings to compressed and quantized blocks, and a matrix-multiply backend registry deciding how products are computed, defaulting to whatever 'BLAS' the R build links against. Matrix products stream in bounded panels and release the pages they have consumed, so operands larger than memory still multiply. A registered backend may decline any product, in which case the default path answers it, so results never depend on which backend is selected. Also provides persistent and scratch runtimes, durable reference-based serialization, explicit vector lifecycle management, multiple runtime handles per session, and out-of-core reductions and principal components for genomics-scale matrices.
Last updated
altrepblasgenomicsggmlggufllmllm-inferencemallocmemory-mappedmmapout-of-corequantizationsimdcpp
4.86 score 4 stars 4 dependents 43 scriptsRminibwa - Native R Bindings and SIMD Dispatch for 'minibwa'
Provides native R bindings to the 'minibwa' genomic read aligner with raw-vector query input, external-pointer alignment batches, ALTREP column views, and an installed C API for downstream packages. The package builds staged Single Instruction Multiple Data ('SIMD') KSW backends, selects portable scalar, SSE4, or AVX2 code at runtime without global instruction-set compiler flags, and on native platforms links to the exact 'htslib' build supplied by 'Rduckhts' as its alignment-format dependency.
Last updated
alignmentaltrepbioinformaticsc-apigenomicsminibwasimdzlib
4.08 score 5 scriptsRggml - Vendored 'GGML' Tensor Library with C-Callable Compute API
Vendors the core, official 'GGUF' implementation, and CPU backend of the 'GGML' tensor library (<https://github.com/ggml-org/ggml>) as a static library and exposes its core tensor-context and matrix-multiply compute path through 'R_RegisterCCallable' C-callable entry points. This is a carrier package: it has no high-level R modeling API of its own. Other R packages link to it ('LinkingTo') to build and compute 'GGML' tensor graphs (including quantized types such as Q4_K) from their own C or C++ code without re-vendoring 'GGML'. The CPU backend is always built. Native targets also build the BLAS backend for dense products; webR uses the CPU backend because its Fortran ABI differs. The 'Vulkan' and NVIDIA 'CUDA' backends are independent opt-in builds.
Last updated
altrepblasgenomicsggmlggufllmllm-inferencemallocmemory-mappedmmapout-of-corequantizationsimdopenblascpp
4.00 score 4 stars 2 dependents 12 scriptsRgguf - Official GGUF Parsing and Typed Storage Views
Reads 'GGUF' model files, the file format used by the 'llama.cpp' project (<https://github.com/ggerganov/llama.cpp>) to store large language model tensors and metadata. Tensors can be decoded into file-backed 'Rfmalloc' arrays, copied at their native codec density, or borrowed as zero-copy read-only spans over the original model mapping. Parsing, writing, and quantized decoding use the official 'GGML' GGUF implementation exposed by the sibling 'Rggml' package. Metadata key-value pairs and the tensor directory are exposed as ordinary R lists and data frames. A minimal writer is included to create 'GGUF' files containing 32-bit floating point tensors, primarily to support round-trip testing.
Last updated
altrepblasgenomicsggmlggufllmllm-inferencemallocmemory-mappedmmapout-of-corequantizationsimd
3.70 score 4 stars 1 dependents 12 scriptsCanardAbsurd - Checkpointed R Workflows over 'DuckDB' and 'Quack'
Runs durable R tasks using 'DuckDB' for state and the 'Quack' extension for remote Structured Query Language (SQL) access. Provides database hosting, leased task claims, checkpoint replay, retries, durable sleeps, and a pull-based R worker. External side effects require application-level idempotency.
Last updated
duckdbdurable-executionquackslop
3.60 score 1 starsRBCFTools - Bundled 'FastDup', 'Samtools', 'BCFtools', and 'HTSlib' Utilities
Bundles patched 'FastDup', 'Samtools', and 'BCFtools' command-line executables together with the 'HTSlib' and 'libbcftools' libraries for reading and manipulating VCF, BCF, SAM, BAM, and CRAM files. All bundled executables are built against one shared vendored 'HTSlib' source. Provides shell-free pipelines for composing bundled or external executables. Also provides streaming facilities from VCF and BCF to Apache Arrow via 'nanoarrow', export to Arrow IPC and Parquet via 'duckdb', a native 'bcf_reader' extension, and utilities for reading and writing VCF and BCF data in 'DuckLake'.
Last updated
bcftoolsduckdbducklakegenomicshtslibnanoarrowparquet
3.44 score 2 stars 25 scriptsRpgen - PLINK 2 Genotype Ingestion into File-Backed Storage
Uses the 'PLINK 2' pgenlib library and its native importers (<https://github.com/chrchang/plink-ng>) to ingest PGEN, PLINK 1 BED, PED/MAP, TPED/TFAM, VCF/BCF, BGEN, Oxford GEN, HAPS/legend, EIGENSTRAT, and legacy dosage sources into bounded, file-backed 'Rfmalloc' layouts. Hardcalls, dosages, and phase are transferred as typed record panels, allowing the destination to choose a packed codec or full-precision storage without constructing a complete R matrix. The vendored native readers are also exposed through 'R_RegisterCCallable' for sibling packages.
Last updated
altrepblasgenomicsggmlggufllmllm-inferencemallocmemory-mappedmmapout-of-corequantizationsimdlibzstdlibdeflatezlib
3.15 score 4 stars 9 scriptsRfmallocStatgen - Statistical Genetics on Rfmalloc Genotype Tensors
Runs genome-scale statistical genetics methods over Rfmalloc's file-backed, compressed genotype tensors ('bed' at 2 bits per genotype, 'dosage' at 1 byte per genotype), closing over the analysis stack popularized by 'bigsnpr' and 'bigstatsr' on denser storage with native readers, and adding haplotype methods that a genotype-only stack cannot express. Methods are implemented from published algorithms and validated against 'bigsnpr' and 'bigstatsr' as numerical oracles. The exception is the randomized-SVD workhorse, which is pinned from GPL-3 'PCAone' (Li 2023) with a deterministic dependency trim and R-console adaptation. The current surface includes streamed univariate regression and principal components, banded linkage disequilibrium, LDpred2, and an all-pairs colocalisation expressed as a single matrix multiply over any registered compute backend.
Last updated
altrepblasgenomicsggmlggufllmllm-inferencemallocmemory-mappedmmapout-of-corequantizationsimdcpp
3.15 score 4 stars 6 scriptsrho - Asynchronous R Agent and Bioinformatics Substrate
Defines asynchronous tasks, streams, HTTP and provider protocols, agent and extension runtimes, compute and transport backends, coding tools, graphics artifacts, and declared bioinformatics resources in one package.
Last updated
2.40 score 1 starsRducksassy - Approximate String Matching for 'DuckDB'
Builds and loads the 'ducksassy' extension for 'DuckDB', providing approximate DNA, IUPAC and ASCII string matching through the 'Sassy' SIMD kernels. Search scalar values, pattern panels and CRISPR guide targets from SQL. The matching method is described by Beeloo and Groot Koerkamp (2026) <doi:10.1093/bioinformatics/btag244>.
Last updated
duckdb-extensionsassysimdstring-matchingrustcargo
2.18 score