-
Notifications
You must be signed in to change notification settings - Fork 12
/
Copy pathBindIssue.Rmd
63 lines (47 loc) · 1.18 KB
/
BindIssue.Rmd
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
---
output:
md_document:
variant: markdown_github
---
### binding rows on spark
It would be nice if `dplyr::bind_rows` could be a used on `Sparklyr` data handles.
<!-- Generated from .Rmd. Please edit that file -->
```{r, echo = FALSE}
knitr::opts_chunk$set(
collapse = TRUE,
comment = " # "
)
options(width =100)
```
OSX 10.11.6.
Spark installed as described at http://spark.rstudio.com
```
library('sparklyr')
spark_install(version = "2.0.0")
```
```{r setup}
library('dplyr')
library('sparklyr')
R.Version()$version.string
packageVersion('dplyr')
packageVersion('sparklyr')
my_db <- sparklyr::spark_connect(version='2.0.0', master = "local")
class(my_db)
my_db$spark_home
print(my_db)
```
* Expected outcome: dplyr::bind_rows to work with `Sparklyr` data reference.
* Observed outcome: can't bind.
```{r issue, error=TRUE}
support <- copy_to(my_db,
data.frame(year=2005:2010),
'support')
# This form doesn't work.
dplyr::bind_rows(support, support)
# This form doesn't work.
dplyr::bind_rows(list(support, support))
```
Submitted as [sparklyr issue 505](https://github.com/rstudio/sparklyr/issues/505).
```{r printversion}
version
```