caldempsey commented on issue #448:
URL: https://github.com/apache/arrow-go/issues/448#issuecomment-3111510998
@zeroshade Hey I appreciate the fast responses. The `TableFromJSON`
function actually returns one row out of 10K in my test. Yes the initial helper
functions shouldn't have seen the issue. The `[]string{}` solution didn't work
for me due to the performance issue above (all my operations timed out). I've
updated _that_ GitHub issue with a complete standalone test you can use to
repro the DataFrame problem, ready for you to plug a Spark Connect URL in if
you do fancy testing it. This is with:
```go
table, err := array.TableFromJSON(memory.DefaultAllocator, schema,
jsonData, // one payload per line
array.WithMultipleDocs(), // without this : failed to create
Arrow table from JSON: json doc must be an array, found {
)
```
That's how I went down this performance rabbit hole, and eventually got here!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
