[
https://issues.apache.org/jira/browse/SPARK-20241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15959495#comment-15959495
]
Kazuaki Ishizaki commented on SPARK-20241:
--
I think that this problem is ca
[
https://issues.apache.org/jira/browse/SPARK-20210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956436#comment-15956436
]
Kazuaki Ishizaki commented on SPARK-20210:
--
I run the following two t
[
https://issues.apache.org/jira/browse/SPARK-20184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956420#comment-15956420
]
Kazuaki Ishizaki commented on SPARK-20184:
--
If the number of rows are sma
opic for d...@spark.apache.org.
Kazuaki Ishizaki
From: Koert Kuipers
To: "user@spark.apache.org"
Date: 2017/04/05 05:12
Subject:how do i force unit test to do whole stage codegen
i wrote my own expression with eval and doGenCode, but doGenCode never
gets called in test
[
https://issues.apache.org/jira/browse/SPARK-20176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15954093#comment-15954093
]
Kazuaki Ishizaki commented on SPARK-20176:
--
Thanks. The code seem to work
[
https://issues.apache.org/jira/browse/SPARK-20176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15954093#comment-15954093
]
Kazuaki Ishizaki edited comment on SPARK-20176 at 4/3/17 8:1
Thank you. Yes, it is not a regression. 2.1.0 would have this failure,
too.
Regards,
Kazuaki Ishizaki
From: Sean Owen
To: Kazuaki Ishizaki/Japan/IBM@IBMJP, Michael Armbrust
Cc: "dev@spark.apache.org"
Date: 2017/04/02 18:18
Subject:Re: [VOTE] Apache Spark
0.002 sec <<< ERROR!
java.lang.IllegalArgumentException: requirement failed: No support for
unaligned Unsafe. Set spark.memory.offHeap.enabled to false.
...
Tests run: 207, Failures: 7, Errors: 16, Skipped: 0
Kazuaki Ishizaki
From: Michael Armbrust
To: "dev@spark.apache.org
[
https://issues.apache.org/jira/browse/SPARK-20176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15951473#comment-15951473
]
Kazuaki Ishizaki commented on SPARK-20176:
--
Could you please post the pro
[
https://issues.apache.org/jira/browse/SPARK-20158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949364#comment-15949364
]
Kazuaki Ishizaki edited comment on SPARK-20158 at 3/30/17 4:3
[
https://issues.apache.org/jira/browse/SPARK-20158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949364#comment-15949364
]
Kazuaki Ishizaki commented on SPARK-20158:
--
What program did you run?
>
[
https://issues.apache.org/jira/browse/SPARK-19984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949359#comment-15949359
]
Kazuaki Ishizaki edited comment on SPARK-19984 at 3/30/17 4:3
[
https://issues.apache.org/jira/browse/SPARK-19984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949359#comment-15949359
]
Kazuaki Ishizaki commented on SPARK-19984:
--
While I tried a reproduc
[
https://issues.apache.org/jira/browse/SPARK-20112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1594#comment-1594
]
Kazuaki Ishizaki commented on SPARK-20112:
--
[~MasterDDT] Thank you
[
https://issues.apache.org/jira/browse/SPARK-20112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15945389#comment-15945389
]
Kazuaki Ishizaki commented on SPARK-20112:
--
SPARK-18745 fixed integer over
Kazuaki Ishizaki created SPARK-20101:
Summary: Use OffHeapColumnVector when
"spark.memory.offHeap.enabled" is set to "true"
Key: SPARK-20101
URL: https://issues.apache.org/jir
[
https://issues.apache.org/jira/browse/SPARK-19372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939511#comment-15939511
]
Kazuaki Ishizaki commented on SPARK-19372:
--
I implemented the code to take
[
https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15937907#comment-15937907
]
Kazuaki Ishizaki commented on SPARK-14083:
--
I agree with you. I do not t
[
https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15937886#comment-15937886
]
Kazuaki Ishizaki commented on SPARK-14083:
--
[~viirya] For a while, I wil
[
https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15937883#comment-15937883
]
Kazuaki Ishizaki commented on SPARK-14083:
--
[~maropu] Thanks.
> Anal
[
https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15937783#comment-15937783
]
Kazuaki Ishizaki commented on SPARK-14083:
--
[~viirya] Thank you for
[
https://issues.apache.org/jira/browse/SPARK-20046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated SPARK-20046:
-
Issue Type: Improvement (was: Bug)
> Facilitate loop optimizations in a JIT compi
Kazuaki Ishizaki created SPARK-20046:
Summary: Facilitate loop optimizations in a JIT compiler regarding
sqlContext.read.parquet()
Key: SPARK-20046
URL: https://issues.apache.org/jira/browse/SPARK-20046
null exists in non-null column.
Any comments are appreciated.
Kazuaki Ishizaki
From: Jason White
To: dev@spark.apache.org
Date: 2017/03/21 06:31
Subject:Why are DataFrames always read with nullable=True?
If I create a dataframe in Spark with non-nullable columns, and then save
org.codehaus.janino.util.ClassFile.addConstantNameAndTypeInfo(ClassFile.java:439)
at
org.codehaus.janino.util.ClassFile.addConstantMethodrefInfo(ClassFile.java:358)
...
While this PR https://github.com/apache/spark/pull/16648 addresses the
number of the constant pool issue, it has not been merged yet.
Regards,
Kazuaki Ishizaki
[
https://issues.apache.org/jira/browse/SPARK-19984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929399#comment-15929399
]
Kazuaki Ishizaki edited comment on SPARK-19984 at 3/17/17 4:2
[
https://issues.apache.org/jira/browse/SPARK-19984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929399#comment-15929399
]
Kazuaki Ishizaki commented on SPARK-19984:
--
This problem occurs since S
Kazuaki Ishizaki created SPARK-19959:
Summary: df[java.lang.Long].collect throws NullPointerException if
df includes null
Key: SPARK-19959
URL: https://issues.apache.org/jira/browse/SPARK-19959
[
https://issues.apache.org/jira/browse/SPARK-19950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15925357#comment-15925357
]
Kazuaki Ishizaki commented on SPARK-19950:
--
[~hyukjin.kwon] Thank you
Kazuaki Ishizaki created SPARK-19950:
Summary: nullable ignored when df.load() is executed for
file-based data source
Key: SPARK-19950
URL: https://issues.apache.org/jira/browse/SPARK-19950
[
https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15904460#comment-15904460
]
Kazuaki Ishizaki commented on SPARK-14083:
--
I rebased this with master:
h
[
https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15903584#comment-15903584
]
Kazuaki Ishizaki commented on SPARK-19875:
--
I got the following stack t
[
https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896452#comment-15896452
]
Kazuaki Ishizaki commented on SPARK-14083:
--
Does anyone go forward with
[
https://issues.apache.org/jira/browse/SPARK-19503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895740#comment-15895740
]
Kazuaki Ishizaki commented on SPARK-19503:
--
Is it better to control whethe
[
https://issues.apache.org/jira/browse/SPARK-19503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891699#comment-15891699
]
Kazuaki Ishizaki commented on SPARK-19503:
--
If it is good to leave sort in
[
https://issues.apache.org/jira/browse/SPARK-19468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891658#comment-15891658
]
Kazuaki Ishizaki commented on SPARK-19468:
--
Interesting.
For {{val joi
[
https://issues.apache.org/jira/browse/SPARK-19741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891548#comment-15891548
]
Kazuaki Ishizaki edited comment on SPARK-19741 at 3/2/17 3:1
[
https://issues.apache.org/jira/browse/SPARK-19741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891548#comment-15891548
]
Kazuaki Ishizaki commented on SPARK-19741:
--
I am afraid whether my sa
[
https://issues.apache.org/jira/browse/SPARK-19741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15890712#comment-15890712
]
Kazuaki Ishizaki commented on SPARK-19741:
--
The following program cause
[
https://issues.apache.org/jira/browse/SPARK-19786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated SPARK-19786:
-
Summary: Facilitate loop optimizations in a JIT compiler regarding range()
(was
Kazuaki Ishizaki created SPARK-19786:
Summary: Facilitate loop optimization in a JIT compiler regarding
range()
Key: SPARK-19786
URL: https://issues.apache.org/jira/browse/SPARK-19786
Project
[
https://issues.apache.org/jira/browse/SPARK-19741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15885171#comment-15885171
]
Kazuaki Ishizaki commented on SPARK-19741:
--
Would it be possible to attac
[
https://issues.apache.org/jira/browse/SPARK-15678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15883035#comment-15883035
]
Kazuaki Ishizaki commented on SPARK-15678:
--
Sorry for being late to r
[
https://issues.apache.org/jira/browse/SPARK-15678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15877575#comment-15877575
]
Kazuaki Ishizaki commented on SPARK-15678:
--
How about in
[
https://issues.apache.org/jira/browse/SPARK-15678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15877575#comment-15877575
]
Kazuaki Ishizaki edited comment on SPARK-15678 at 2/22/17 6:3
t;id>10") return correct result.
f(df1).count // output 89 which is incorrect
Regards,
Kazuaki Ishizaki
From: gen tang
To: dev@spark.apache.org
Date: 2017/02/22 15:02
Subject:Re: A DataFrame cache bug
Hi All,
I might find a related issue on jira:
https://issues.apa
[
https://issues.apache.org/jira/browse/SPARK-19653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872901#comment-15872901
]
Kazuaki Ishizaki commented on SPARK-19653:
--
cc: [~cloud_fan]
> `Vecto
Congrats!
Kazuaki Ishizaki
From: Reynold Xin
To: "dev@spark.apache.org"
Date: 2017/02/14 04:18
Subject:welcoming Takuya Ueshin as a new Apache Spark committer
Hi all,
Takuya-san has recently been elected an Apache Spark committer. He's been
active in t
[
https://issues.apache.org/jira/browse/SPARK-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki resolved SPARK-16043.
--
Resolution: Fixed
Fix Version/s: 2.2.0
> Prepare GenericArrayD
[
https://issues.apache.org/jira/browse/SPARK-19372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15851472#comment-15851472
]
Kazuaki Ishizaki commented on SPARK-19372:
--
I was able to reproduce this.
Hi,
You may find several micro-benchmarks under
https://github.com/apache/spark/tree/master/sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark
.
Regards,
Kazuaki Ishizaki
From: Prasun Ratn
To: Apache Spark Dev
Date: 2017/01/10 12:52
Subject:Spark performance
Sure, I updated status of some PRs.
Regards,
Kazuaki Ishizaki
From: Sean Owen
To: dev
Date: 2017/01/04 21:37
Subject:Quick request: prolific PR openers, review your open PRs
Just saw that there are many people with >= 8 open PRs. Some are
legitimately in flight but m
[
https://issues.apache.org/jira/browse/SPARK-19008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15779544#comment-15779544
]
Kazuaki Ishizaki commented on SPARK-19008:
--
I will work for this
>
[
https://issues.apache.org/jira/browse/SPARK-19008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated SPARK-19008:
-
Description:
In a
[discussion|https://github.com/apache/spark/pull/16391
Kazuaki Ishizaki created SPARK-19008:
Summary: Avoid boxing/unboxing overhead of calling a lambda with
primitive type from Dataset program
Key: SPARK-19008
URL: https://issues.apache.org/jira/browse/SPARK
[
https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15779288#comment-15779288
]
Kazuaki Ishizaki commented on SPARK-14083:
--
[Here|https://github.com/ap
both applications supports Apache Arrow
APIs.
Other approaches could be.
What approach would be good for all of applications?
Regards,
Kazuaki Ishizaki
[
https://issues.apache.org/jira/browse/SPARK-18859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15764789#comment-15764789
]
Kazuaki Ishizaki commented on SPARK-18859:
--
I think that this is an issu
[
https://issues.apache.org/jira/browse/SPARK-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15742828#comment-15742828
]
Kazuaki Ishizaki commented on SPARK-18814:
--
I found the same e
[
https://issues.apache.org/jira/browse/SPARK-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15740807#comment-15740807
]
Kazuaki Ishizaki commented on SPARK-16073:
--
It is an interesting topic. In
[
https://issues.apache.org/jira/browse/SPARK-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15735580#comment-15735580
]
Kazuaki Ishizaki edited comment on SPARK-18745 at 12/9/16 3:2
[
https://issues.apache.org/jira/browse/SPARK-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15735580#comment-15735580
]
Kazuaki Ishizaki edited comment on SPARK-18745 at 12/9/16 3:2
[
https://issues.apache.org/jira/browse/SPARK-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15735580#comment-15735580
]
Kazuaki Ishizaki commented on SPARK-18745:
--
I identified a root cause of
The line where I pointed out would work correctly. This is because a type
of this division is double. d2i correctly handles overflow cases.
Kazuaki Ishizaki
From: Nicholas Chammas
To: Kazuaki Ishizaki/Japan/IBM@IBMJP, Reynold Xin
Cc: Spark dev list
Date: 2016/12/08 10:56
org/apache/spark/util/collection/unsafe/sort/UnsafeInMemorySorter.java#L156
Regards,
Kazuaki Ishizaki
From: Reynold Xin
To: Nicholas Chammas
Cc: Spark dev list
Date: 2016/12/07 14:27
Subject:Re: Reduce memory usage of UnsafeInMemorySorter
This is not supposed to happen. Do
[
https://issues.apache.org/jira/browse/SPARK-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated SPARK-18745:
-
Affects Version/s: 2.2.0
> java.lang.IndexOutOfBoundsException running query 68 Sp
[
https://issues.apache.org/jira/browse/SPARK-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726486#comment-15726486
]
Kazuaki Ishizaki commented on SPARK-18745:
--
I work with [~jfc...@us.ibm
Kazuaki Ishizaki created SPARK-18653:
Summary: Dataset.show() generates incorrect padding for Unicode
Character
Key: SPARK-18653
URL: https://issues.apache.org/jira/browse/SPARK-18653
Project
[
https://issues.apache.org/jira/browse/SPARK-17680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15707629#comment-15707629
]
Kazuaki Ishizaki commented on SPARK-17680:
--
Sorry, it is my mistake.
>
[
https://issues.apache.org/jira/browse/SPARK-18502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15706385#comment-15706385
]
Kazuaki Ishizaki commented on SPARK-18502:
--
I can reproduce this excep
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702760#comment-15702760
]
Kazuaki Ishizaki commented on SPARK-18492:
--
I realized that the following
[
https://issues.apache.org/jira/browse/SPARK-15950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki resolved SPARK-15950.
--
Resolution: Duplicate
> Eliminate unreachable code at projection for complex ty
Thank you for reporting the error.
I think that this is associated to
https://issues.apache.org/jira/browse/SPARK-18492
The reporter of this JIRA entry has not posted the program yet. Would it
be possible to add your program that can reproduce this issue to this JIRA
entry?
Regards,
Kazuaki
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674599#comment-15674599
]
Kazuaki Ishizaki edited comment on SPARK-18492 at 11/17/16 7:3
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674599#comment-15674599
]
Kazuaki Ishizaki commented on SPARK-18492:
--
Can you post a small program
[
https://issues.apache.org/jira/browse/SPARK-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15671237#comment-15671237
]
Kazuaki Ishizaki commented on SPARK-18458:
--
I worked with [~jfc...@us.ibm
[
https://issues.apache.org/jira/browse/SPARK-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated SPARK-18458:
-
Comment: was deleted
(was: I worked with [~jfc...@us.ibm.com]. Then, I identified that a
[
https://issues.apache.org/jira/browse/SPARK-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15671229#comment-15671229
]
Kazuaki Ishizaki commented on SPARK-18458:
--
I worked with [~jfc...@us.ibm
[
https://issues.apache.org/jira/browse/SPARK-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670828#comment-15670828
]
Kazuaki Ishizaki commented on SPARK-18458:
--
I see. I will do that.
&g
[
https://issues.apache.org/jira/browse/SPARK-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668948#comment-15668948
]
Kazuaki Ishizaki commented on SPARK-18458:
--
I work for this.
> core
[
https://issues.apache.org/jira/browse/SPARK-18284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated SPARK-18284:
-
Description:
When the following program is executed, a schema of dataframe is different
[
https://issues.apache.org/jira/browse/SPARK-18284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated SPARK-18284:
-
Affects Version/s: 2.1.0
> Scheme of DataFrame generated from RDD is diffrent betw
Kazuaki Ishizaki created SPARK-18284:
Summary: Scheme of DataFrame generated from RDD is diffrent
between master and 2.0
Key: SPARK-18284
URL: https://issues.apache.org/jira/browse/SPARK-18284
[
https://issues.apache.org/jira/browse/SPARK-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15629522#comment-15629522
]
Kazuaki Ishizaki commented on SPARK-18207:
--
I created a smaller progra
[
https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15615034#comment-15615034
]
Kazuaki Ishizaki commented on SPARK-18125:
--
I confirmed this code can repro
[
https://issues.apache.org/jira/browse/SPARK-18147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15614959#comment-15614959
]
Kazuaki Ishizaki commented on SPARK-18147:
--
This also cause the same excep
Hi Chin Wei,
Thank you for confirming this on 2.0.1 and being happy to hear it never
happens.
The performance will be improved when this PR (
https://github.com/apache/spark/pull/15219) is integrated.
Regards,
Kazuaki Ishizaki
From: Chin Wei Low
To: Kazuaki Ishizaki/Japan/IBM@IBMJP
Cc
Can you have a smaller program that can reproduce the same error? If you
also create a JIRA entry, it would be great.
Kazuaki Ishizaki
From: Efe Selcuk
To: "user @spark"
Date: 2016/10/25 10:23
Subject:[Spark 2.0.1] Error in generated code, possible
regression?
Hi Chin Wei,
I am sorry for being late to reply.
Got it. Interesting behavior. How did you measure the time between 1st and
2nd events?
Best Regards,
Kazuaki Ishizaki
From: Chin Wei Low
To: Kazuaki Ishizaki/Japan/IBM@IBMJP
Cc: user@spark.apache.org
Date: 2016/10/10 11:33
Subject
[
https://issues.apache.org/jira/browse/SPARK-15687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588641#comment-15588641
]
Kazuaki Ishizaki commented on SPARK-15687:
--
[#15219|https://github.com/ap
Kazuaki Ishizaki created SPARK-17915:
Summary: Prepare ColumnVector implementation for UnsafeData
Key: SPARK-17915
URL: https://issues.apache.org/jira/browse/SPARK-17915
Project: Spark
Kazuaki Ishizaki created SPARK-17912:
Summary: Refactor code generation to get data for
ColumnVector/ColumnarBatch
Key: SPARK-17912
URL: https://issues.apache.org/jira/browse/SPARK-17912
Project
Kazuaki Ishizaki created SPARK-17905:
Summary: Added test cases for InMemoryRelation
Key: SPARK-17905
URL: https://issues.apache.org/jira/browse/SPARK-17905
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15569493#comment-15569493
]
Kazuaki Ishizaki commented on SPARK-16845:
--
Thank you for preparing the cas
[
https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated SPARK-16845:
-
Comment: was deleted
(was: Thank you for preparing the case. I noticed that the
[
https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15569489#comment-15569489
]
Kazuaki Ishizaki commented on SPARK-16845:
--
Thank you for preparing the cas
[
https://issues.apache.org/jira/browse/SPARK-16223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki resolved SPARK-16223.
--
Resolution: Fixed
> Codegen failure with a Dataframe program using an ar
[
https://issues.apache.org/jira/browse/SPARK-16223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15557853#comment-15557853
]
Kazuaki Ishizaki commented on SPARK-16223:
--
When I rerun it with {{co
you use to get
data, cache or parquet?
val res = sqlContext.sql("table1 union table2 union table3")
res.explain(true)
res.collect()
Do I make some misunderstandings?
Best Regards,
Kazuaki Ishizaki
From: Chin Wei Low
To: Kazuaki Ishizaki/Japan/IBM@IBMJP
Cc: user@spark.apach
/spark/pull/15219) is
ready for review. It would achieve 1.2x performance improvement for a
compressed column and much performance improvement for an uncompressed
column.
Best Regards,
Kazuaki Ishizaki
From: Chin Wei Low
To: user@spark.apache.org
Date: 2016/10/07 13:05
Subject
901 - 1000 of 1143 matches
Mail list logo
