TheNeuralBit opened a new issue, #24091:
URL: https://github.com/apache/beam/issues/24091

   ### What happened?
   
   Pandas to_feather fails when used with a non-default index:
   ```
   ValueError: feather does not support serializing a non-default index for the 
index; you can .reset_index() to make the index into column(s)
   ```
   
   Unfortunately, our DataFrame partitions will only have a default index in 
rare cases. Typically each partition will have some hash-based index. So 
to_feather will usually fail with the above error at execution time.
   
   ### Issue Priority
   
   Priority: 2
   
   ### Issue Component
   
   Component: dsl-dataframe


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to