andygrove opened a new issue #834:
URL: https://github.com/apache/arrow-datafusion/issues/834


   **Describe the bug**
   
   We use Int32 to represent keys and at SF=1000 we generate values > 
2,147,483,647, resulting in errors like this:
   
   ```
   Error: ArrowError(ExternalError(ArrowError(ExternalError(Execution("Arrow 
error: External error: Execution error: Arrow error: External error: Execution 
error: Arrow error: Parser error: Error while parsing value 3000000002 for 
column 0 at line 1")))))
   ```
   
   **To Reproduce**
   Generate SF=1000 data set and try running queries.
   
   **Expected behavior**
   We should use a more appropriate data type for keys. Perhaps UInt64.
   
   **Additional context**
   None
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to