brijrajk commented on code in PR #56248:
URL: https://github.com/apache/spark/pull/56248#discussion_r3389103448
##########
docs/sql-data-sources-json.md:
##########
@@ -201,6 +201,12 @@ Data source options of JSON can be set via:
<td>Sets the string that indicates a timestamp without timezone format.
Custom date formats follow the formats at <a
href="https://spark.apache.org/docs/latest/sql-ref-datetime-pattern.html";>Datetime
Patterns</a>. This applies to timestamp without timezone type, note that
zone-offset and time-zone components are not supported when writing or reading
this data type.</td>
<td>read/write</td>
</tr>
+ <tr>
+ <td><code>inferTimestamp</code></td>
+ <td><code>false</code></td>
+ <td>Allows inferring of <code>TimestampType</code> and
<code>TimestampNTZType</code> from strings that match the timestamp patterns
defined by the <code>timestampFormat</code> and <code>timestampNTZFormat</code>
options respectively. JSON built-in functions ignore this option.</td>
Review Comment:
Good catch, thanks! You're right — I incorrectly copied the disclaimer from
file-level I/O options like `multiLine` and `encoding`. Those are genuinely
irrelevant for string-based functions, but `inferTimestamp` controls type
inference logic which `schema_of_json` does perform. Removed the sentence.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
