Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/14531
Sure, will submit a PR for it. Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14531
@gatorsmile / @sitalkedia that idea sounds good (similar to Hive's)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/14531
@sitalkedia Yeah, I saw it. Thank you for investigation. Normally, we do
not want to add many configuration flags. It hurts the usability. Let @rxin
make a decision whether we should add another
Github user sitalkedia commented on the issue:
https://github.com/apache/spark/pull/14531
@gatorsmile - I looked into Hive code base a bit and it looks like Hive
provides a way to specify a whitelisted set of properties which are copied for
the newly created table. Spark should also
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/14531
@cloud-fan Hive does not copy the table properties in CREATE TABLE LIKE
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/14531
I suspect @sitalkedia built his application based on 2.0 and got broken in
2.0.1, @sitalkedia is that true?
@gatorsmile can you double check that Hive doesn't copy the table
properties?
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14531
@cloud-fan are you sure Hive doesn't copy the table properties? How would
@sitalkedia's case work if it does not copy?
---
If your project is set up for it, you can reply to this email and have your
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/14531
IIUC, before 2.0, we use hive to run CREATE TABLE LIKE, and hive doesn't
include the table properties. So this PR actually fixed a regression in 2.0, I
think we should keep this behaviour.
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/14531
@sitalkedia So far, you can set table properties to the new table by using
the DDL command.
@rxin @cloud-fan @yhuai Let me know if you need me to submit a PR to make
such a change. I
Github user sitalkedia commented on the issue:
https://github.com/apache/spark/pull/14531
@rxin, @gatorsmile - This PR breaks our jobs with CREATE TABLE LIKE command
since the table properties from the source tables are not propagated to the new
table anymore. We have table
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/14531
Sure, will do it. Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/14531
merging to master! @gatorsmile can you send a new PR to backport it to 2.0?
thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14531
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14531
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64763/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14531
**[Test build #64763 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64763/consoleFull)**
for PR 14531 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/14531
LGTM, pending jenkins
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14531
**[Test build #64763 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64763/consoleFull)**
for PR 14531 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14531
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64754/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14531
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14531
**[Test build #64754 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64754/consoleFull)**
for PR 14531 at commit
20 matches
Mail list logo
