GitHub user gengliangwang opened a pull request:

    https://github.com/apache/spark/pull/22663

    [SPARK-25490][SQL][TEST] Refactor KryoBenchmark to use main method

    ## What changes were proposed in this pull request?
    
    Also make the scale smaller(reduce to 20%) to avoid OOM.
    Before the code changes, I tried to run it with 8G memory
    ```
    build/sbt -mem 8000  "core/testOnly 
org.apache.spark.serializer.KryoBenchmark"
    ```
    And still got OOM.
    The benchmark result is also reason compared to the original one.
    
    
    ## How was this patch tested?
    
    Unit test


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/gengliangwang/spark kyroBenchmark

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/22663.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #22663
    
----
commit 529bba722b72204c465c71f773a222fdaf8aee39
Author: Gengliang Wang <gengliang.wang@...>
Date:   2018-10-07T13:30:56Z

    refacotr KryoBenchmark

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to