CRAN/E | crew

crew

A Distributed Worker Launcher Framework

Installation

About

In computationally demanding analysis projects, statisticians and data scientists asynchronously deploy long-running tasks to distributed systems, ranging from traditional clusters to cloud services. The 'NNG'-powered 'mirai' R package by Gao (2023) doi:10.5281/zenodo.7912722 is a sleek and sophisticated scheduler that efficiently processes these intense workloads. The 'crew' package extends 'mirai' with a unifying interface for third-party worker launchers. Inspiration also comes from packages. 'future' by Bengtsson (2021) doi:10.32614/RJ-2021-048, 'rrq' by FitzJohn and Ashton (2023) , 'clustermq' by Schubert (2019) doi:10.1093/bioinformatics/btz284), and 'batchtools' by Lang, Bischel, and Surmann (2017) doi:10.21105/joss.00135.

wlandau.github.io/crew/
github.com/wlandau/crew
Bug report File report

Key Metrics

Version 0.9.2
R ≥ 4.0.0
Published 2024-04-24 1 day ago
Needs compilation? no
License MIT
License File
CRAN checks crew results
Language en-US

Downloads

Yesterday 81 0%
Last 7 days 308 -43%
Last 30 days 2.081 +12%
Last 90 days 5.977 +26%
Last 365 days 17.413 +2778%

Maintainer

Maintainer

William Michael Landau

will.landau.oss@gmail.com

Authors

William Michael Landau

aut / cre

Daniel Woodie

ctb

Eli Lilly
Company

cph

Material

NEWS
Reference manual
Package source

In Views

HighPerformanceComputing

Vignettes

Controller groups
Introduction to crew
Launcher plugins
Integration with promises
Known risks of crew
Asynchronous Shiny apps

macOS

r-release

arm64

r-oldrel

arm64

r-release

x86_64

r-oldrel

x86_64

Windows

r-devel

x86_64

r-release

x86_64

r-oldrel

x86_64

Old Sources

crew archive

Depends

R ≥ 4.0.0

Imports

cli ≥ 3.1.0
data.table
getip
later
mirai ≥ 0.12.0
nanonext ≥ 0.12.0
processx
promises
ps
R6
rlang
stats
tibble
tidyselect
tools
utils

Suggests

knitr ≥ 1.30
markdown ≥ 1.1
rmarkdown ≥ 2.4
testthat ≥ 3.0.0

Reverse Imports

crew.aws.batch
crew.cluster

Reverse Suggests

targets