GitHub user davies opened a pull request:

    https://github.com/apache/spark/pull/7592

    [SPARK-7075] [SQL] Use BytesToBytesMap for broadcast join

    This PR is based on #7480 , will rebase after it merged.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/davies/spark unsafe_map2

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/7592.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #7592
    
----
commit bea4a509b7f6097474dbee17675bd6f13da2db15
Author: Davies Liu <[email protected]>
Date:   2015-07-17T20:22:21Z

    Unsafe HashJoin

commit 95d0762b1e024f539235dbde17efa983bfbafed7
Author: Davies Liu <[email protected]>
Date:   2015-07-17T20:46:53Z

    remove println

commit 6acbb11a0c751e8d76bd97404148d09da1b8933c
Author: Davies Liu <[email protected]>
Date:   2015-07-20T19:21:39Z

    fix tests

commit 184b8524962a114637e13e21feba54a1674fdcb4
Author: Davies Liu <[email protected]>
Date:   2015-07-20T19:49:54Z

    fix style

commit a6c0b7d437736894233abef443c84417e5e09ddb
Author: Davies Liu <[email protected]>
Date:   2015-07-20T20:50:53Z

    Merge branch 'master' of github.com:apache/spark into unsafe_join

commit 60371f28e1660078d43cd58d3ec2b20c29b2ae23
Author: Davies Liu <[email protected]>
Date:   2015-07-20T21:59:34Z

    use UnsafeRow in SemiJoin

commit ab1690f4f687c1990cf6a268ac418a867f0eb928
Author: Davies Liu <[email protected]>
Date:   2015-07-20T22:16:39Z

    address comments

commit 1a40f02df481263d7dc25aa5b96157e2f6a5380f
Author: Davies Liu <[email protected]>
Date:   2015-07-20T23:15:36Z

    refactor

commit 69e38f54ba53c1bd69de596a2750f1b6e02d7355
Author: Davies Liu <[email protected]>
Date:   2015-07-21T16:33:09Z

    Merge branch 'master' of github.com:apache/spark into unsafe_join
    
    Conflicts:
        
sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeRow.java

commit 0f4380d79db4d09628cf3365b9bf2c39a5b8b107
Author: Davies Liu <[email protected]>
Date:   2015-07-21T16:51:57Z

    ada a comment

commit 68f5cd9e73828c469e510ab62f0ced7eda952c08
Author: Davies Liu <[email protected]>
Date:   2015-07-21T17:27:43Z

    Merge branch 'master' of github.com:apache/spark into unsafe_join
    
    Conflicts:
        
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/StringExpressionsSuite.scala

commit ca2b40fba72bd698a8638a8d9aaf08fc2ddf8a2e
Author: Davies Liu <[email protected]>
Date:   2015-07-21T17:38:21Z

    revert unrelated change

commit 9481ae89a98caaf63d2b7eb27ee25a0c58542ce0
Author: Davies Liu <[email protected]>
Date:   2015-07-21T19:46:13Z

    return UnsafeRow after join()

commit 611d2edd756e76218e412ce8de275d4317851579
Author: Davies Liu <[email protected]>
Date:   2015-07-21T19:46:28Z

    Merge branch 'master' of github.com:apache/spark into unsafe_join

commit a05b4f6e0eb6cf9d983120f470571cb8fdefa3ee
Author: Davies Liu <[email protected]>
Date:   2015-07-21T20:55:23Z

    support UnsafeRow in LeftSemiJoinBNL and BroadcastNestedLoopJoin

commit 84c98073b1a4a6ec6a461d6826dd04ec87a6eb96
Author: Davies Liu <[email protected]>
Date:   2015-07-21T21:47:20Z

    address comments

commit dede020a7dd8977ed0a825dfad9fc96fb7b0a53e
Author: Davies Liu <[email protected]>
Date:   2015-07-22T00:12:33Z

    fix test

commit 10583f16787fa6d55d5dbc2e6b92cd9a1b0e90ca
Author: Davies Liu <[email protected]>
Date:   2015-07-22T00:37:15Z

    Merge branch 'master' of github.com:apache/spark into unsafe_join

commit 6294b1e3de357c94646c323eba2d4bde80971c45
Author: Davies Liu <[email protected]>
Date:   2015-07-22T04:35:12Z

    fix projection

commit c1418b2f285710db1c912b4bad55dde3fa20d55f
Author: Davies Liu <[email protected]>
Date:   2015-07-22T08:23:02Z

    use BytesToBytesMap for broadcast join

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to