Microsoft R RxSpark Execution - Microsoft Community


hi

i trying execute below code "revo64-9.0 -f testrxspark.r" command

list.files(system.file("sampledata", package = "revoscaler"))
myhadoopcluster <- rxspark(namenode="zzz.westeurope.cloudapp.azure.com", port=8020,consoleoutput=true)
rxsetcomputecontext(myhadoopcluster)
file.exists(system.file("sampledata/airlinedemosmall.csv", package="revoscaler"))
bigdatadirroot <- "/user/revoshare" # hdfs location of example data
rxhadooplistfiles(bigdatadirroot) # there no files @ point.
source <-system.file("sampledata/airlinedemosmall.csv", package="revoscaler")
inputdir <- file.path(bigdatadirroot,"airlinedemosmall")
rxhadoopmakedir(inputdir)
rxhadooplistfiles(bigdatadirroot)
rxhadoopcopyfromlocal(source, inputdir)
rxhadooplistfiles(inputdir)
hdfsfs <- rxhdfsfilesystem(hostname="zzz.westeurope.cloudapp.azure.com", port=8020)
colinfo <- list(dayofweek = list(type = "factor", levels = c("monday", "tuesday", "wednesday", "thursday", "friday", "saturday", "sunday")))
airds <- rxtextdata(file = inputdir, missingvaluestring = "m", colinfo  = colinfo, filesystem = hdfsfs)
# adssummary <- rxsummary(~arrdelay+crsdeptime+dayofweek, data = airds)
rxsummary(~arrdelay:dayofweek, data = airds)

i got following error:

17/03/19 00:00:11 warn util.nativecodeloader: unable load native-hadoop library platform... using builtin-java classes appli$
warning: libjvm.so not found in /log/cloudera/parcels/mrs-9.0.1/hadoop, searching system-wide
internal error: cannot reset hdfs internal params while connected hdfs file system.
error in try({ :
  internal error: cannot reset hdfs internal params while connected hdfs file system.
error:  error in try({ :
  internal error: cannot reset hdfs internal params while connected hdfs file system.

the scaler library scaler-hadoop-0.1-snapshot.jar copied cloudera parcel hadoop lib folders on nodes.

please me fix @ earliest

do bing on "unable load native-hadoop library platform", & run hadoop people. there none here know of! here's sample of turn up...

http://stackoverflow.com/questions/19943766/hadoop-unable-to-load-native-hadoop-library-for-your-platform-warning

good luck.



Windows / Windows 10 / Microsoft Store / PC



Comments

Popular posts from this blog

ClipUp.exe 100% CPU at boot only - Microsoft Community

Error 8233 Microsoft Windows security -spp - Microsoft Community