[jira] [Created] (SPARK-19442) Unable to add column to the dataset using Dataset.WithColumn() api

Navya Krishnappa created SPARK-19442: Summary: Unable to add column to the dataset using Dataset.WithColumn() api Key: SPARK-19442 URL: https://issues.apache.org/jira/browse/SPARK-19442 Project:

[jira] [Commented] (SPARK-19442) Unable to add column to the dataset using Dataset.WithColumn() api

[ https://issues.apache.org/jira/browse/SPARK-19442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865135#comment-15865135 ] Navya Krishnappa commented on SPARK-19442: -- If the source file has 3 columns NameAge

[jira] [Comment Edited] (SPARK-19442) Unable to add column to the dataset using Dataset.WithColumn() api

[ https://issues.apache.org/jira/browse/SPARK-19442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15867357#comment-15867357 ] Navya Krishnappa edited comment on SPARK-19442 at 2/15/17 7:04 AM: ---

[jira] [Commented] (SPARK-19442) Unable to add column to the dataset using Dataset.WithColumn() api

[ https://issues.apache.org/jira/browse/SPARK-19442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15867357#comment-15867357 ] Navya Krishnappa commented on SPARK-19442: -- Thank you [~hyukjin.kwon]. It is satisfied my

[jira] [Commented] (SPARK-19442) Unable to add column to the dataset using Dataset.WithColumn() api

[ https://issues.apache.org/jira/browse/SPARK-19442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15863216#comment-15863216 ] Navya Krishnappa commented on SPARK-19442: -- Thank you for your response. It is working as

[jira] [Reopened] (SPARK-19442) Unable to add column to the dataset using Dataset.WithColumn() api

[ https://issues.apache.org/jira/browse/SPARK-19442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa reopened SPARK-19442: -- > Unable to add column to the dataset using Dataset.WithColumn() api >

[jira] [Comment Edited] (SPARK-19442) Unable to add column to the dataset using Dataset.WithColumn() api

[ https://issues.apache.org/jira/browse/SPARK-19442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15863216#comment-15863216 ] Navya Krishnappa edited comment on SPARK-19442 at 2/13/17 5:29 AM: ---

[jira] [Commented] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

[ https://issues.apache.org/jira/browse/SPARK-18877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753716#comment-15753716 ] Navya Krishnappa commented on SPARK-18877: -- I'm reading through csvReader (.csv(sourceFile)) and

[jira] [Commented] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

[ https://issues.apache.org/jira/browse/SPARK-18877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753728#comment-15753728 ] Navya Krishnappa commented on SPARK-18877: -- Precision and scale vary depending on the decimal

[jira] [Updated] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

[ https://issues.apache.org/jira/browse/SPARK-18877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa updated SPARK-18877: - Affects Version/s: 2.0.2 > Unable to read given csv data. Excepion:

[jira] [Created] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

Navya Krishnappa created SPARK-18877: Summary: Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20 Key: SPARK-18877

[jira] [Commented] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

[ https://issues.apache.org/jira/browse/SPARK-18877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15754865#comment-15754865 ] Navya Krishnappa commented on SPARK-18877: -- I'm using SparkContext.read() to read the content.

[jira] [Created] (SPARK-18962) Unable to create parquet file for the given data

Navya Krishnappa created SPARK-18962: Summary: Unable to create parquet file for the given data Key: SPARK-18962 URL: https://issues.apache.org/jira/browse/SPARK-18962 Project: Spark

[jira] [Updated] (SPARK-18962) Unable to create parquet file for the given data

[ https://issues.apache.org/jira/browse/SPARK-18962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa updated SPARK-18962: - Affects Version/s: 2.0.2 > Unable to create parquet file for the given data >

[jira] [Commented] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

[ https://issues.apache.org/jira/browse/SPARK-18877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760487#comment-15760487 ] Navya Krishnappa commented on SPARK-18877: -- Thank you [~dongjoon] > Unable to read given csv

[jira] [Comment Edited] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

[ https://issues.apache.org/jira/browse/SPARK-18877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760487#comment-15760487 ] Navya Krishnappa edited comment on SPARK-18877 at 12/19/16 7:56 AM:

[jira] [Comment Edited] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

[ https://issues.apache.org/jira/browse/SPARK-18877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760487#comment-15760487 ] Navya Krishnappa edited comment on SPARK-18877 at 12/19/16 7:56 AM:

[jira] [Commented] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

[ https://issues.apache.org/jira/browse/SPARK-18877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15756554#comment-15756554 ] Navya Krishnappa commented on SPARK-18877: -- Thank you for replying [~dongjoon]. Can you help me

[jira] [Comment Edited] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

[ https://issues.apache.org/jira/browse/SPARK-18877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15756554#comment-15756554 ] Navya Krishnappa edited comment on SPARK-18877 at 3/30/17 12:45 PM:

[jira] [Updated] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa updated SPARK-20152: - Description: When reading the below mentioned time value by specifying the

[jira] [Comment Edited] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

[ https://issues.apache.org/jira/browse/SPARK-18877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15754865#comment-15754865 ] Navya Krishnappa edited comment on SPARK-18877 at 3/30/17 12:44 PM:

[jira] [Commented] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948989#comment-15948989 ] Navya Krishnappa commented on SPARK-20152: -- According to the spark "-MM-dd'T'HH:mm:ss.SSSZZ"

[jira] [Comment Edited] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948989#comment-15948989 ] Navya Krishnappa edited comment on SPARK-20152 at 3/30/17 12:48 PM:

[jira] [Updated] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa updated SPARK-20152: - Description: When reading the below mentioned time value by specifying the

[jira] [Updated] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa updated SPARK-20152: - Description: When reading the below mentioned time value by specifying the

[jira] [Updated] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa updated SPARK-20152: - Description: When reading the below mentioned time value by specifying the

[jira] [Comment Edited] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949399#comment-15949399 ] Navya Krishnappa edited comment on SPARK-20152 at 3/30/17 4:53 PM: --- But

[jira] [Commented] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949399#comment-15949399 ] Navya Krishnappa commented on SPARK-20152: -- But if we specify timestampformat:

[jira] [Created] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

Navya Krishnappa created SPARK-20152: Summary: Time zone is not respected while parsing csv for timeStampFormat "MM-dd-'T'HH:mm:ss.SSSZZ" Key: SPARK-20152 URL:

[jira] [Updated] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa updated SPARK-20152: - Description: When reading the below mentioned time value by specifying the

[jira] [Commented] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950745#comment-15950745 ] Navya Krishnappa commented on SPARK-20152: -- [~srowen] & [~hyukjin.kwon] Thank you for your

[jira] [Comment Edited] (SPARK-18936) Infrastructure for session local timezone support

[ https://issues.apache.org/jira/browse/SPARK-18936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950748#comment-15950748 ] Navya Krishnappa edited comment on SPARK-18936 at 3/31/17 11:51 AM: I

[jira] [Commented] (SPARK-18936) Infrastructure for session local timezone support

[ https://issues.apache.org/jira/browse/SPARK-18936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950748#comment-15950748 ] Navya Krishnappa commented on SPARK-18936: -- I think this fix helps us to set the time zone in

[jira] [Created] (SPARK-20387) Permissive mode is not replacing corrupt record with null

Navya Krishnappa created SPARK-20387: Summary: Permissive mode is not replacing corrupt record with null Key: SPARK-20387 URL: https://issues.apache.org/jira/browse/SPARK-20387 Project: Spark

[jira] [Updated] (SPARK-20387) Permissive mode is not replacing corrupt record with null

[ https://issues.apache.org/jira/browse/SPARK-20387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa updated SPARK-20387: - Description: When reading the below mentioned time value by specifying "mode" as

[jira] [Created] (SPARK-21263) Exception is not thrown while converting an invalid string to float/double

Navya Krishnappa created SPARK-21263: Summary: Exception is not thrown while converting an invalid string to float/double Key: SPARK-21263 URL: https://issues.apache.org/jira/browse/SPARK-21263

[jira] [Updated] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa updated SPARK-21263: - Description: When reading a below-mentioned data by specifying user-defined schema,

[jira] [Updated] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa updated SPARK-21263: - Summary: NumberFormatException is not thrown while converting an invalid string to

[jira] [Updated] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa updated SPARK-21263: - Description: When reading a below-mentioned data by specifying user-defined schema,

[jira] [Updated] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa updated SPARK-21263: - Description: When reading a below-mentioned data by specifying user-defined schema,

[jira] [Updated] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa updated SPARK-21263: - Description: When reading a below-mentioned data by specifying user-defined schema,

[jira] [Comment Edited] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

[ https://issues.apache.org/jira/browse/SPARK-18877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16072240#comment-16072240 ] Navya Krishnappa edited comment on SPARK-18877 at 7/4/17 5:42 AM: --

[jira] [Commented] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16072234#comment-16072234 ] Navya Krishnappa commented on SPARK-21263: -- [~sowen] & [~hyukjin.kwon] Thanks for your comments.

[jira] [Comment Edited] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

[ https://issues.apache.org/jira/browse/SPARK-18877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16072240#comment-16072240 ] Navya Krishnappa edited comment on SPARK-18877 at 7/3/17 10:33 AM: ---

[jira] [Commented] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

[ https://issues.apache.org/jira/browse/SPARK-18877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16072240#comment-16072240 ] Navya Krishnappa commented on SPARK-18877: -- [~dongjoon] I have created parquet bug the invalid

[jira] [Comment Edited] (SPARK-18877) Unable to read given csv data. Excepion: java.lang.IllegalArgumentException: requirement failed: Decimal precision 28 exceeds max precision 20

[ https://issues.apache.org/jira/browse/SPARK-18877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15756554#comment-15756554 ] Navya Krishnappa edited comment on SPARK-18877 at 5/23/17 4:21 AM: ---

[jira] [Created] (SPARK-22020) Support session local timezone

Navya Krishnappa created SPARK-22020: Summary: Support session local timezone Key: SPARK-22020 URL: https://issues.apache.org/jira/browse/SPARK-22020 Project: Spark Issue Type: Bug

[jira] [Reopened] (SPARK-22020) Support session local timezone

[ https://issues.apache.org/jira/browse/SPARK-22020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa reopened SPARK-22020: -- This is not working as expected. Please refer the above-mentioned description > Support

[jira] [Comment Edited] (SPARK-20387) Permissive mode is not replacing corrupt record with null

[ https://issues.apache.org/jira/browse/SPARK-20387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249301#comment-16249301 ] Navya Krishnappa edited comment on SPARK-20387 at 11/13/17 9:44 AM:

[jira] [Reopened] (SPARK-22439) Not able to get numeric columns for the file having decimal values

[ https://issues.apache.org/jira/browse/SPARK-22439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa reopened SPARK-22439: -- > Not able to get numeric columns for the file having decimal values >

[jira] [Commented] (SPARK-22439) Not able to get numeric columns for the file having decimal values

[ https://issues.apache.org/jira/browse/SPARK-22439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249341#comment-16249341 ] Navya Krishnappa commented on SPARK-22439: -- [~sowen] Thank you for your response. According to

[jira] [Reopened] (SPARK-20387) Permissive mode is not replacing corrupt record with null

[ https://issues.apache.org/jira/browse/SPARK-20387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa reopened SPARK-20387: -- Source File: 'Col1','Col2','Col3','Col4','Col5','Col6',

[jira] [Updated] (SPARK-22439) Not able to get numeric columns for the file having decimal values

[ https://issues.apache.org/jira/browse/SPARK-22439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa updated SPARK-22439: - Summary: Not able to get numeric columns for the file having decimal values (was: Not

[jira] [Updated] (SPARK-22439) Not able to get numeric columns for the attached file

[ https://issues.apache.org/jira/browse/SPARK-22439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa updated SPARK-22439: - Summary: Not able to get numeric columns for the attached file (was: Not able to get

[jira] [Created] (SPARK-22439) Not able to get numeric column for the attached file

Navya Krishnappa created SPARK-22439: Summary: Not able to get numeric column for the attached file Key: SPARK-22439 URL: https://issues.apache.org/jira/browse/SPARK-22439 Project: Spark