[jira] [Commented] (SPARK-26711) JSON Schema inference takes 15 times longer

2019-01-25 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752304#comment-16752304 ] Bruce Robbins commented on SPARK-26711: --- [~hyukjin.kwon] Ok, that worked. I had in my mind a more

[jira] [Commented] (SPARK-26711) JSON Schema inference takes 15 times longer

2019-01-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752103#comment-16752103 ] Hyukjin Kwon commented on SPARK-26711: -- Just open a PR that replace one line after manually testing

[jira] [Commented] (SPARK-26711) JSON Schema inference takes 15 times longer

2019-01-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752102#comment-16752102 ] Hyukjin Kwon commented on SPARK-26711: -- Oh, right. Sounds a good lead to follow. We can just add

[jira] [Commented] (SPARK-26711) JSON Schema inference takes 15 times longer

2019-01-24 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751655#comment-16751655 ] Bruce Robbins commented on SPARK-26711: --- Re: 7 minutes vs. 50 seconds: Looking at the code, it

[jira] [Commented] (SPARK-26711) JSON Schema inference takes 15 times longer

2019-01-23 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750748#comment-16750748 ] Hyukjin Kwon commented on SPARK-26711: -- Hm, the results say something is wrong hm. 50 sec <> 7 mins

[jira] [Commented] (SPARK-26711) JSON Schema inference takes 15 times longer

2019-01-23 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750741#comment-16750741 ] Bruce Robbins commented on SPARK-26711: --- [~hyukjin.kwon] inferTimestamp=: ~13 min

[jira] [Commented] (SPARK-26711) JSON Schema inference takes 15 times longer

2019-01-23 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750713#comment-16750713 ] Hyukjin Kwon commented on SPARK-26711: -- So how was the time if {{inferTimestamp}} was

[jira] [Commented] (SPARK-26711) JSON Schema inference takes 15 times longer

2019-01-23 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750704#comment-16750704 ] Bruce Robbins commented on SPARK-26711: --- ping [~maxgekk] [~hyukjin.kwon] > JSON Schema inference