[
https://issues.apache.org/jira/browse/SPARK-26037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Damian Momot resolved SPARK-26037.
--
Resolution: Not A Problem
> ./dev/make-distribution.sh fails for Scala 2.12
>
[
https://issues.apache.org/jira/browse/SPARK-26037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685010#comment-16685010
]
Damian Momot commented on SPARK-26037:
--
Oh nevermind... it should be "-Pscala-2.12" instead of
[
https://issues.apache.org/jira/browse/SPARK-26037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684982#comment-16684982
]
Damian Momot commented on SPARK-26037:
--
[~srowen] you might be interested :)
>
Damian Momot created SPARK-26037:
Summary: ./dev/make-distribution.sh fails for Scala 2.12
Key: SPARK-26037
URL: https://issues.apache.org/jira/browse/SPARK-26037
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594546#comment-16594546
]
Damian Momot commented on SPARK-4502:
-
I can see that this ticket was closed, but by looking at
[
https://issues.apache.org/jira/browse/SPARK-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381752#comment-16381752
]
Damian Momot commented on SPARK-4502:
-
[~sameerag] any chance to put higher priority on this now, as
[
https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306316#comment-16306316
]
Damian Momot edited comment on SPARK-22918 at 1/2/18 7:37 AM:
--
As a quick
[
https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306316#comment-16306316
]
Damian Momot edited comment on SPARK-22918 at 1/2/18 7:37 AM:
--
As a quick
[
https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306316#comment-16306316
]
Damian Momot edited comment on SPARK-22918 at 12/29/17 2:56 PM:
As a
[
https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306316#comment-16306316
]
Damian Momot commented on SPARK-22918:
--
As a quick workaround following can be used in tests just
[
https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306316#comment-16306316
]
Damian Momot edited comment on SPARK-22918 at 12/29/17 2:49 PM:
As a
[
https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306297#comment-16306297
]
Damian Momot edited comment on SPARK-22918 at 12/29/17 2:01 PM:
Spark
[
https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306297#comment-16306297
]
Damian Momot commented on SPARK-22918:
--
Spark uses derby for local (test) runs - for metastore etc.
[
https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Damian Momot updated SPARK-22918:
-
Description:
After upgrading 2.2.0 -> 2.2.1 sbt test command in one of my projects started
to
[
https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306074#comment-16306074
]
Damian Momot commented on SPARK-22918:
--
Nope, everything is working fine on Spark 2.2.0 - no
[
https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Damian Momot updated SPARK-22918:
-
Description:
After upgrading 2.2.0 -> 2.2.1 sbt test command in one of my projects started
to
[
https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Damian Momot updated SPARK-22918:
-
Description:
After upgrading 2.2.0 -> 2.2.1 sbt test command started to fail with following
[
https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Damian Momot updated SPARK-22918:
-
Description:
After upgrading 2.2.0 -> 2.2.1 sbt test command started to fail with following
Damian Momot created SPARK-22918:
Summary: sbt test (spark - local) fail after upgrading to 2.2.1
with: java.security.AccessControlException: access denied
org.apache.derby.security.SystemPermission( "engine", "usederbyinternals" )
[
https://issues.apache.org/jira/browse/SPARK-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16251354#comment-16251354
]
Damian Momot commented on SPARK-4502:
-
Well this PR is ready:
[
https://issues.apache.org/jira/browse/SPARK-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154923#comment-16154923
]
Damian Momot commented on SPARK-4502:
-
Are we waiting for anything :) ? By looking at performance
[
https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Damian Momot resolved SPARK-19293.
--
Resolution: Fixed
> Spark 2.1.x unstable with spark.speculation=true
>
[
https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Damian Momot updated SPARK-19293:
-
Fix Version/s: 2.2.0
Checked that it's fixed in 2.2.0
> Spark 2.1.x unstable with
[
https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057157#comment-16057157
]
Damian Momot commented on SPARK-19293:
--
I'll try to build from 2.2 branch and test today
> Spark
[
https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057091#comment-16057091
]
Damian Momot commented on SPARK-19293:
--
Yep,
Some tasks are marked as "killed" but some become
[
https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025974#comment-16025974
]
Damian Momot commented on SPARK-19293:
--
Some additional errors for speculative tasks
{code}
[
https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16024684#comment-16024684
]
Damian Momot edited comment on SPARK-19293 at 5/25/17 12:50 PM:
>From
[
https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16024684#comment-16024684
]
Damian Momot edited comment on SPARK-19293 at 5/25/17 12:45 PM:
>From
[
https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16024684#comment-16024684
]
Damian Momot edited comment on SPARK-19293 at 5/25/17 12:44 PM:
>From
[
https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16024684#comment-16024684
]
Damian Momot commented on SPARK-19293:
--
>From what I can see speculative tasks are failing with
[
https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Damian Momot updated SPARK-19293:
-
Affects Version/s: 2.1.1
Component/s: Spark Core
Summary: Spark 2.1.x
[
https://issues.apache.org/jira/browse/SPARK-9862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020683#comment-16020683
]
Damian Momot commented on SPARK-9862:
-
Is it really "IN PROGRESS"? It looks like it's stalled
> Join:
[
https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Damian Momot updated SPARK-19293:
-
Description:
After upgrading from Spark 2.0.2 to 2.1.0 we've observed that jobs are often
Damian Momot created SPARK-19293:
Summary: Spark 2.1.0 unstable with spark.speculation=true
Key: SPARK-19293
URL: https://issues.apache.org/jira/browse/SPARK-19293
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-18717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724702#comment-15724702
]
Damian Momot commented on SPARK-18717:
--
Yep it's already workarounded this way in my code but usage
Damian Momot created SPARK-18717:
Summary: Datasets - crash (compile exception) when mapping to
immutable scala map
Key: SPARK-18717
URL: https://issues.apache.org/jira/browse/SPARK-18717
Project:
Damian Momot created SPARK-18556:
Summary: Suboptimal number of tasks when writing partitioned data
with desired number of files per directory
Key: SPARK-18556
URL:
Damian Momot created SPARK-18540:
Summary: Wholestage code-gen for ORC Hive tables
Key: SPARK-18540
URL: https://issues.apache.org/jira/browse/SPARK-18540
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-18249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15682893#comment-15682893
]
Damian Momot edited comment on SPARK-18249 at 11/21/16 8:37 AM:
Hi, nope
[
https://issues.apache.org/jira/browse/SPARK-18249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15682893#comment-15682893
]
Damian Momot commented on SPARK-18249:
--
Hi, nope it's simple case class, exactly this:
{code}
case
[
https://issues.apache.org/jira/browse/SPARK-18249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15682893#comment-15682893
]
Damian Momot edited comment on SPARK-18249 at 11/21/16 8:35 AM:
Hi, nope
[
https://issues.apache.org/jira/browse/SPARK-18484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673347#comment-15673347
]
Damian Momot edited comment on SPARK-18484 at 11/18/16 1:51 PM:
Only
[
https://issues.apache.org/jira/browse/SPARK-18249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15676734#comment-15676734
]
Damian Momot commented on SPARK-18249:
--
Just check that it also happens on 2.0.2 and 2.1.0 (latest
[
https://issues.apache.org/jira/browse/SPARK-18249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Damian Momot updated SPARK-18249:
-
Affects Version/s: 2.1.0
Summary: StackOverflowError when saving dataset to parquet
[
https://issues.apache.org/jira/browse/SPARK-18249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Damian Momot updated SPARK-18249:
-
Affects Version/s: 2.0.2
> Spark 2.0.1 - StackOverflowError when saving dataset to parquet
>
[
https://issues.apache.org/jira/browse/SPARK-18249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15676143#comment-15676143
]
Damian Momot commented on SPARK-18249:
--
We've moved several other flows and others are working fine.
[
https://issues.apache.org/jira/browse/SPARK-18491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673719#comment-15673719
]
Damian Momot edited comment on SPARK-18491 at 11/17/16 1:25 PM:
You don't
[
https://issues.apache.org/jira/browse/SPARK-18491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673719#comment-15673719
]
Damian Momot commented on SPARK-18491:
--
You don't have to break compatibility. java.sql.Timestamp
[
https://issues.apache.org/jira/browse/SPARK-18491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673685#comment-15673685
]
Damian Momot commented on SPARK-18491:
--
Good library/API is all about convenience :) If it wasn't we
[
https://issues.apache.org/jira/browse/SPARK-18491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673655#comment-15673655
]
Damian Momot commented on SPARK-18491:
--
Just to be clear - i'm not saying that spark has internal
[
https://issues.apache.org/jira/browse/SPARK-18491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673608#comment-15673608
]
Damian Momot edited comment on SPARK-18491 at 11/17/16 12:37 PM:
-
Until
[
https://issues.apache.org/jira/browse/SPARK-18491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673608#comment-15673608
]
Damian Momot commented on SPARK-18491:
--
Until Java 8 is available spark could do what all other JVM
[
https://issues.apache.org/jira/browse/SPARK-18491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673590#comment-15673590
]
Damian Momot commented on SPARK-18491:
--
I don't mean internal usage - it's about user usage related
[
https://issues.apache.org/jira/browse/SPARK-18491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Damian Momot updated SPARK-18491:
-
Description:
TimestampType is mapped to java.sql.Timestamp
DateType is mapped to java.sql.Date
Damian Momot created SPARK-18491:
Summary: Spark uses mutable classes for date/time types mapping
Key: SPARK-18491
URL: https://issues.apache.org/jira/browse/SPARK-18491
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-18484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673347#comment-15673347
]
Damian Momot commented on SPARK-18484:
--
Only thing which comes to my mind would be something like (+
[
https://issues.apache.org/jira/browse/SPARK-18484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673257#comment-15673257
]
Damian Momot commented on SPARK-18484:
--
I'm not saying it's not possible to workaround it - I'm
Damian Momot created SPARK-18484:
Summary: case class datasets - ability to specify decimal
precision and scale
Key: SPARK-18484
URL: https://issues.apache.org/jira/browse/SPARK-18484
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-18484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Damian Momot updated SPARK-18484:
-
Description:
Currently when using decimal type (BigDecimal in scala case class) there's no
way
[
https://issues.apache.org/jira/browse/SPARK-16753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15643525#comment-15643525
]
Damian Momot commented on SPARK-16753:
--
Isn't it same problem as
Damian Momot created SPARK-18249:
Summary: Spark 2.0.1 - StackOverflowError when saving dataset to
parquet
Key: SPARK-18249
URL: https://issues.apache.org/jira/browse/SPARK-18249
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204064#comment-15204064
]
Damian Momot edited comment on SPARK-11293 at 3/21/16 11:36 AM:
It looks
[
https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204064#comment-15204064
]
Damian Momot commented on SPARK-11293:
--
It looks we are getting same errors on 1.6.0 too
>
63 matches
Mail list logo
