srowen commented on issue #26555: [WIP] AppVeyor Arrow test (JDK8) URL: https://github.com/apache/spark/pull/26555#issuecomment-554635298 It seems like a good idea to match these, yeah. Different error now? ``` 6. Error: gapply() Arrow optimization - type specification (date and timestamp) (@test_sparkSQL_arrow.R#285) invalid 'n' argument 1: tryCatch({ ret <- gapply(df, "a", function(key, grouped) { grouped }, schema(df)) expect_equal(collect(ret), rdf) }, finally = { callJMethod(conf, "set", "spark.sql.execution.arrow.sparkr.enabled", arrowEnabled) }) at C:\projects\spark\bin\../R/pkg/tests/fulltests/test_sparkSQL_arrow.R:285 2: tryCatchList(expr, classes, parentenv, handlers) 3: expect_equal(collect(ret), rdf) at C:\projects\spark\bin\../R/pkg/tests/fulltests/test_sparkSQL_arrow.R:289 4: compare(object, expected, ...) 5: collect(ret) 6: collect(ret) 7: .local(x, ...) 8: tryCatch({ doServerAuth(conn, authSecret) arrowTable <- read_arrow(readRaw(conn)) if (useAsTibble) { as_tibble <- get("as_tibble", envir = asNamespace("arrow")) as.data.frame(as_tibble(arrowTable), stringsAsFactors = stringsAsFactors) } else { as.data.frame(arrowTable, stringsAsFactors = stringsAsFactors) } }, finally = { close(conn) }) 9: tryCatchList(expr, classes, parentenv, handlers) 10: read_arrow(readRaw(conn)) 11: as.data.frame(read_table(stream)) 12: read_table(stream) 13: readRaw(conn) 14: readBin(con, raw(), as.integer(dataLen), endian = "big") ``` Still seems like some protocol / version mismatch. I don't know much about this but looks like `readRaw` gets back info from `conn` that causes it to try to read an invalid amount, like -1. I think that kind of "-1" return has something to do with being out of memory, so maybe back where we started. Does the machine need more memory or is that irrelevant?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
