GitHub user davies opened a pull request:
https://github.com/apache/spark/pull/5350
[SPARK-6638] [SQL] Improve performance of StringType in SQL
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/davies/spark string
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/5350.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5350
----
commit 685fd071ce453cc6b956f98c897c869ad31702a9
Author: Davies Liu <[email protected]>
Date: 2015-03-31T05:42:07Z
use UTF8String instead of String for StringType
commit 21f67c6fda3504caa0b13524d4e498c6e4c9c701
Author: Davies Liu <[email protected]>
Date: 2015-03-31T07:50:11Z
cleanup
commit 4699c3ae1dab6482b26dd3d3739193e68cd77ca3
Author: Davies Liu <[email protected]>
Date: 2015-03-31T20:46:42Z
use Array[Byte] in UTF8String
commit d32abd1e8e6b7b5ef92a34a5d3a42919db58a43c
Author: Davies Liu <[email protected]>
Date: 2015-03-31T20:57:17Z
fix utf8 for python api
commit a85fb275d742dd9384e15f22878b545e9a77a106
Author: Davies Liu <[email protected]>
Date: 2015-03-31T23:42:18Z
refactor
commit 6b499ac13528f8062e1e81ddb0cd462975960067
Author: Davies Liu <[email protected]>
Date: 2015-04-01T06:19:47Z
fix style
commit 5f9e1207a3896cb779d17b4aff6c58961e54b827
Author: Davies Liu <[email protected]>
Date: 2015-04-01T06:48:58Z
fix sql tests
commit 38c303ede6a96157158a1624472a9f92035289a0
Author: Davies Liu <[email protected]>
Date: 2015-04-01T07:10:30Z
fix python sql tests
commit c7dd4d285bc08313f98334225435e77ca0f79bb9
Author: Davies Liu <[email protected]>
Date: 2015-04-01T18:40:38Z
fix some catalyst tests
commit bb52e442779c3ab46fc0dc24ac5332ae17e22ad7
Author: Davies Liu <[email protected]>
Date: 2015-04-01T20:00:03Z
fix scala style
commit 8b458644a269d9e1542a2a4ab24d735aa95ed49d
Author: Davies Liu <[email protected]>
Date: 2015-04-01T21:41:12Z
fix codegen with UTF8String
commit 23a766cf8eb9142ef641a7eb69f136a817d8fb32
Author: Davies Liu <[email protected]>
Date: 2015-04-01T22:33:28Z
refactor
commit 9dc32d1b08cd6c76a7a096beba67bcbca89b0634
Author: Davies Liu <[email protected]>
Date: 2015-04-02T04:42:34Z
fix some hive tests
commit 73e4363eb3d4f045c2509e7b601797f03e321b0b
Author: Davies Liu <[email protected]>
Date: 2015-04-02T07:20:26Z
Merge branch 'master' of github.com:apache/spark into string
Conflicts:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/literals.scala
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvaluationSuite.scala
commit 956b0a48bfccc6550f66319c4475220eb6101b23
Author: Davies Liu <[email protected]>
Date: 2015-04-02T08:12:40Z
fix hive tests
commit 9f4c194cbc44a3b163a6f2d3e1f7f831518d7776
Author: Davies Liu <[email protected]>
Date: 2015-04-02T21:28:05Z
convert data type for data source
commit 537631c09c5167dc8b13785b5aa678d5c984d73a
Author: Davies Liu <[email protected]>
Date: 2015-04-02T21:42:33Z
some comment about Date
commit 28d6f32eda151ed51f35117eb5beb1ec6b6882d1
Author: Davies Liu <[email protected]>
Date: 2015-04-02T23:38:31Z
refactor
commit 28f3d817456f7d25a50b9e47b376bd4b252e1d19
Author: Davies Liu <[email protected]>
Date: 2015-04-03T00:17:15Z
Merge branch 'master' of github.com:apache/spark into string
Conflicts:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala
sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala
sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala
sql/core/src/main/scala/org/apache/spark/sql/parquet/newParquet.scala
sql/core/src/main/scala/org/apache/spark/sql/sources/commands.scala
commit e5fa5b824b62670b8ba76399831ddd0e9e25efa5
Author: Davies Liu <[email protected]>
Date: 2015-04-03T00:50:11Z
remove clone in UTF8String
commit 8d17f21b1f4bb7daa1dcf950330e53d8aebd074b
Author: Davies Liu <[email protected]>
Date: 2015-04-03T07:39:07Z
fix hive compatibility tests
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
