[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255855#comment-16255855 ] Sergey Shelukhin commented on HIVE-17714: - Initial motivation for HIVE-11985 was the field length,

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-16 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255584#comment-16255584 ] Vihang Karajgaonkar commented on HIVE-17714: [~sershe] Do you have any further thoughts or

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-14 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252765#comment-16252765 ] Vihang Karajgaonkar commented on HIVE-17714: bq. metastore would duplicate the schema from

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-14 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252656#comment-16252656 ] Vihang Karajgaonkar commented on HIVE-17714: bq. However, that means that most metastore APIs

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-14 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252660#comment-16252660 ] Sergey Shelukhin commented on HIVE-17714: - The reason people never hit it before is that before

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-14 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252091#comment-16252091 ] Sergey Shelukhin commented on HIVE-17714: - Let me summarize on the high level. Metastore not

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-14 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16251811#comment-16251811 ] Owen O'Malley commented on HIVE-17714: -- [~alangates] Thanks for watching out for adding dependencies

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-14 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16251806#comment-16251806 ] Owen O'Malley commented on HIVE-17714: -- I'm also -1 to the metastore using the Serdes to recreate the

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-13 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250271#comment-16250271 ] Sergey Shelukhin commented on HIVE-17714: - But the point is that the things are not in sync

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-13 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250273#comment-16250273 ] Alan Gates commented on HIVE-17714: --- bq. I will try bringing in TypeInfo and ObjectInspector too. What

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-13 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250261#comment-16250261 ] Alan Gates commented on HIVE-17714: --- bq. We can remove the logic that avoids storing schema in metastore

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-13 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250153#comment-16250153 ] Sergey Shelukhin commented on HIVE-17714: - Hmm... I was writing the below, when I realized

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-13 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250147#comment-16250147 ] Vihang Karajgaonkar commented on HIVE-17714: Thanks [~alangates] for the response. I have some

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-13 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249975#comment-16249975 ] Alan Gates commented on HIVE-17714: --- [~sershe] are you suggesting that all calls to the metastore should

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-12 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248970#comment-16248970 ] Vihang Karajgaonkar commented on HIVE-17714: I looked into this a bit more and followed the

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-07 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242702#comment-16242702 ] Sergey Shelukhin commented on HIVE-17714: - Hmm, the problem from the clean separation perspective

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-06 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241398#comment-16241398 ] Vihang Karajgaonkar commented on HIVE-17714: Hi [~sershe] I am still looking at the AvroSerDe

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-02 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236288#comment-16236288 ] Sergey Shelukhin commented on HIVE-17714: - Hmm, that actually seems opposite of that JIRA if I

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-02 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236064#comment-16236064 ] Alan Gates commented on HIVE-17714: --- This is very similar to what [~vihangk1] is working on in

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-10-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193642#comment-16193642 ] Sergey Shelukhin commented on HIVE-17714: - cc [~alangates] > move custom SerDe schema