R help - Jun 2023 - R/Spark

r-help

 

Trying to install Spark (Windows 11) and R gives me the following error:

 

spark_install(version = "3.4")

Error in validVersions[with(validVersions, order(hadoop, decreasing TRUE)),  : 

  subscript out of bounds

 

Any idea what the error is telling me. I guess I can load it manually.

 

Jeff

 


	[[alternative HTML version deleted]]

? Wed, 21 Jun 2023 21:03:02 -0500
"Jeff Reichman" <reichmanj at sbcglobal.net> ?????:
> spark_install(version = "3.4")
My psychic debugging powers tell me that you're trying to use the
sparklyr package. Is that correct?
> Error in validVersions[with(validVersions, order(hadoop, decreasing >
TRUE)),  :
> 
>   subscript out of bounds
The error seems to come from the non-CRAN package sparkinstall, last
updated in 2019:
https://github.com/rstudio/spark-install/blob/master/R/R/versions.R

Try updating all involved packages to their latest versions. If that
doesn't help, opening an issue at
<https://github.com/sparklyr/sparklyr/issues> might be a more direct
route to success.

-- 
Best regards,
Ivan