realonbebeto opened a new issue, #9380:
URL: https://github.com/apache/arrow-rs/issues/9380

   **Describe the bug**
   <!--
   The Format infer_schema does not update the null flag (by default it's true).
   -->
   
   **To Reproduce**
   <!--
   Run the following on any csv file and the Fields will be always null even 
when they are not supposed to.
   ```
   use std::fs::File;
   use arrow::csv::Format;
   
    let mut file = File::open(path)?;
    let (schema, _) = Format::default()
               .with_header(source.metadata.has_header)
               .infer_schema(&mut file, Some(source.metadata.num_rows))?;
   ```
   
   The line of code in infer_schema defaulting to true
   ```
           // build schema from inference results
           let fields: Fields = column_types
               .iter()
               .zip(&headers)
               .map(|(inferred, field_name)| Field::new(field_name, 
inferred.get(), true))
               .collect();
   ```
   -->
   
   **Expected behaviour**
   <!--
   On running on a csv, the null flag should be updated accordingly if the 
field inferred is actually null or not. Besides, there is a disconnect to use 
the null regex and the null flag always being true.
   -->
   
   
   
   **Additional context**
   <!--
   Add any other context about the problem here.
   -->


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to