GitHub user scwf opened a pull request:
https://github.com/apache/spark/pull/4380
[SPARK-4131] [SQL] [WIP] support writing data into the filesystem from
queries
Support writing data into the filesystem from queries
todos:
[ ] more tests for this
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/scwf/spark write-dir
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4380.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4380
----
commit 9888ec82bffa5453a156859cf88953c315828b9f
Author: haiyang <[email protected]>
Date: 2015-01-20T02:35:52Z
add write to local dir support
commit 8754357e1ba7bb1c124431fd267f789930d0f58c
Author: haiyang <[email protected]>
Date: 2015-01-20T03:14:00Z
add write to local dir support
commit 020b3afb5958fae1b1972e3ba2949781ded2cfc0
Author: haiyang <[email protected]>
Date: 2015-01-27T12:02:12Z
support insert overwrite local dir in hive context
commit a8748b92ae9a2ac0fde3b5486e14fbdb8bc54035
Author: haiyang <[email protected]>
Date: 2015-01-29T10:23:12Z
support insert overwrite directory
commit a6fc434eb5f685a942031bd3a8b471c6509d1f6a
Author: haiyang <[email protected]>
Date: 2015-01-29T10:37:25Z
support insert overwrite directory
commit 5c12108f5d8228b69462b246cff1cdaec63d72fe
Author: haiyang <[email protected]>
Date: 2015-01-29T11:04:50Z
support insert overwrite directory
commit b1bc66d91fb68d8af8d4b6ba0c655e9bf7449ac2
Author: haiyang <[email protected]>
Date: 2015-01-29T11:32:59Z
support insert overwrite directory
commit 33805265d1949138d9aaefbf596ccc20af009533
Author: haiyang <[email protected]>
Date: 2015-01-29T11:35:06Z
support insert overwrite directory
commit 16b186ca53a9c3b2cf8838226b963cf9b0a0d010
Author: haiyang <[email protected]>
Date: 2015-01-30T03:02:51Z
support write to directory
commit 35376f57f288dbafe5b8e763947fee9b13907b13
Author: haiyang <[email protected]>
Date: 2015-01-30T03:22:13Z
support write to directory
commit 8c273d2484fda09ed67cb074098f15dd9e651d27
Author: haiyang <[email protected]>
Date: 2015-01-30T03:34:12Z
support write to directory
commit b3a8356e877d3330d7624885573e0dc1cfacecfa
Author: haiyang <[email protected]>
Date: 2015-01-30T07:47:49Z
support write to directory
commit 8cf42b707ea764673f71e9e5ebd455b718d30bc8
Author: haiyang <[email protected]>
Date: 2015-01-30T08:13:29Z
support write to directory
commit 9d46492813df0eb8283aefbeeecbb42641f65d84
Author: haiyang <[email protected]>
Date: 2015-01-30T08:21:38Z
support write to directory
commit 9fa519d1bf24a6175c3597699d518ddbf7bf1a48
Author: haiyang <[email protected]>
Date: 2015-01-30T08:22:12Z
support write to directory
commit 709cd8d885dd9825175abdbb3eb1198bc9b52c1e
Author: haiyang <[email protected]>
Date: 2015-01-30T08:41:38Z
support write to directory
commit 15c03d75ec87720ad978de80de03e0ebea2bd746
Author: haiyang <[email protected]>
Date: 2015-01-30T09:07:44Z
support write to directory
commit c42148d1fda77a1051d146af56b15466d82b1b2d
Author: haiyang <[email protected]>
Date: 2015-01-30T09:26:40Z
support write to directory
commit e9307a83029a8df34241ebc4cec44bbd7c3fba66
Author: haiyang <[email protected]>
Date: 2015-01-30T09:45:58Z
support write to directory
commit e7a6d04512092f31fec1968181cff54c5082f7b4
Author: haiyang <[email protected]>
Date: 2015-01-31T01:14:44Z
support write to dir
commit b0bf8aaaa8dc76a013b4b4e9eb06c7cd45fa2ca0
Author: haiyang <[email protected]>
Date: 2015-01-31T01:56:54Z
add test case
commit 93356106cb6d7b1413ed62ad0df825f63d87e401
Author: haiyang <[email protected]>
Date: 2015-01-31T02:52:26Z
fix code style
commit 09267b8b2006103ed683ffd18e37d51f2db1d68e
Author: haiyang <[email protected]>
Date: 2015-01-31T03:28:16Z
remove unused code
commit 23266100722f9fb0d10c606fb0dae8ff7777fb75
Author: haiyang <[email protected]>
Date: 2015-01-31T08:08:27Z
add comment
commit 82ed88baaa58f4966770121ce23b881ad06537e1
Author: haiyang <[email protected]>
Date: 2015-01-31T08:40:17Z
add comment
commit 6ddf92accee1ca2e7de488e430d995b16b2888c7
Author: wangfei <[email protected]>
Date: 2015-02-05T02:15:56Z
conflicts fix
commit ad77c099721f2dbf341e2555f739d0e7eb154e12
Author: wangfei <[email protected]>
Date: 2015-02-05T02:20:42Z
compile fix
commit 56247ca7bb4ac95460092b27b7dfa536f28cb8b8
Author: wangfei <[email protected]>
Date: 2015-02-05T02:24:10Z
minor fix
commit cd1cd10e418cb80bf33d07eb23400496a63e5805
Author: wangfei <[email protected]>
Date: 2015-02-05T02:25:51Z
compile fix
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
