CRAN/E | sparklyr

sparklyr

R Interface to Apache Spark

Installation

About

R interface to Apache Spark, a fast and general engine for big data processing, see . This package supports connecting to local and remote Apache Spark clusters, provides a 'dplyr' compatible back-end, and provides an interface to Spark's built-in machine learning algorithms.

spark.posit.co/
System requirements Spark: 1.6.x, 2.x, or 3.x
Bug report File report

Key Metrics

Version 1.8.5
R ≥ 3.2
Published 2024-03-25 25 days ago
Needs compilation? no
License Apache License 2.0
License File
CRAN checks sparklyr results

Downloads

Yesterday 2.026
Last 7 days 8.977 -43%
Last 30 days 57.018 -4%
Last 90 days 176.181 -21%
Last 365 days 1.226.082 -67%

Maintainer

Maintainer

Edgar Ruiz

edgar@rstudio.com

Authors

Javier Luraschi

aut

Kevin Kuo

aut

Kevin Ushey

aut

JJ Allaire

aut

Samuel Macedo

ctb

Hossein Falaki

aut

Lu Wang

aut

Andy Zhang

aut

Yitao Li

aut

Jozef Hajnala

ctb

Maciej Szymkiewicz

ctb

Wil Davis

ctb

Edgar Ruiz

aut / cre

RStudio

cph

The Apache Software Foundation

aut / cph

Material

README
NEWS
Reference manual
Package source

In Views

Databases
ModelDeployment

macOS

r-release

arm64

r-oldrel

arm64

r-release

x86_64

Windows

r-devel

x86_64

r-release

x86_64

r-oldrel

x86_64

Old Sources

sparklyr archive

Depends

R ≥ 3.2

Imports

config ≥ 0.2
DBI ≥ 1.0.0
dbplyr ≥ 2.5.0
dplyr ≥1.0.9
generics
globals
glue
httr ≥ 1.2.1
jsonlite ≥1.4
methods
openssl ≥ 0.8
purrr
rlang ≥ 0.1.4
rstudioapi ≥ 0.10
tidyr ≥ 1.2.0
tidyselect
uuid
vctrs
withr
xml2

Suggests

arrow ≥ 0.17.0
broom
diffobj
foreach
ggplot2
iterators
janeaustenr
Lahman
mlbench
nnet
nycflights13
R6
r2d3
RCurl
reshape2
shiny ≥ 1.0.1
parsnip
testthat
rprojroot

Reverse Depends

s3.resourcer

Reverse Imports

apache.sedona
catalog
geospark
graphframes
MSstatsBig
pathling
pysparklyr
rsparkling
shinyML
spark.sas7bdat
sparkavro
sparkbq
sparkhail
sparklyr.flint
sparklyr.nested
sparktf
sparkwarc
sparkxgb
variantspark

Reverse Suggests

butcher
corrr
finnts
mlflow
modeltime
parsnip
pointblank
resourcer

Reverse Enhances

vip