[jira] [Commented] (AVRO-2306) Python 3 avro library corrupts files when using snappy codec

[Hudson (JIRA)]

[ 
https://issues.apache.org/jira/browse/AVRO-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16749721#comment-16749721
 ] 

Hudson commented on AVRO-2306:
--

FAILURE: Integrated in Jenkins build AvroJava #591 (See 
[https://builds.apache.org/job/AvroJava/591/])
AVRO-2306: Fix data corruption issue with snappy in Python 3 (iemejia: 
[https://github.com/apache/avro/commit/384061c05720287aa93a756a742aab2572b75e79])
* (edit) lang/py3/avro/datafile.py


> Python 3 avro library corrupts files when using snappy codec
> 
>
> Key: AVRO-2306
> URL: https://issues.apache.org/jira/browse/AVRO-2306
> Project: Apache Avro
>  Issue Type: Bug
>  Components: python
>Affects Versions: 1.8.2
>Reporter: Charles Chen
>Priority: Critical
> Fix For: 1.9.0
>
>
> Currently, the Python version of avro when run in Python 3 corrupts files 
> when using the snappy codec.  Specifically, this line 
> [https://github.com/apache/avro/blob/8643e3bd73cab8dbbbcac1203a19c2d2cdc62cfe/lang/py3/avro/datafile.py#L286]
>  fails to resolve to True because of a comparison between a byte and unicode 
> string returning False.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: AvroJava #591

[Apache Jenkins Server]

See 

Changes:

[iemejia] AVRO-2306: Fix data corruption issue with snappy in Python 3

[iemejia] Update surefire to version 3.0.0-M1 and enable parallel tests for some

--
[...truncated 114.42 KB...]
[INFO] [ maven-plugin ]
[INFO] 
[INFO] --- maven-source-plugin:3.0.1:jar-no-fork (default-cli) @ 
avro-maven-plugin ---
[INFO] 
[INFO] --- maven-plugin-plugin:3.6.0:helpmojo (generated-helpmojo) @ 
avro-maven-plugin ---
[INFO] Using 'UTF-8' encoding to read mojo source files.
[INFO] java-javadoc mojo extractor found 5 mojo descriptors.
[INFO] java-annotations mojo extractor found 0 mojo descriptor.
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.2.1:process (default) @ 
avro-maven-plugin ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
avro-maven-plugin ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ 
avro-maven-plugin ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 6 source files to 

[INFO] 
:
 

 uses unchecked or unsafe operations.
[INFO] 
:
 Recompile with -Xlint:unchecked for details.
[INFO] 
[INFO] --- maven-plugin-plugin:3.6.0:descriptor (default-descriptor) @ 
avro-maven-plugin ---
[INFO] Using 'UTF-8' encoding to read mojo source files.
[INFO] java-javadoc mojo extractor found 5 mojo descriptors.
[INFO] java-annotations mojo extractor found 0 mojo descriptor.
[INFO] 
[INFO] --- maven-bundle-plugin:4.1.0:manifest (bundle-manifest) @ 
avro-maven-plugin ---
[WARNING] Ignoring project type maven-plugin - supportedProjectTypes = [bundle]
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
avro-maven-plugin ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 8 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ 
avro-maven-plugin ---
[INFO] Nothing to compile - all classes are up to date
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (default-test) @ 
avro-maven-plugin ---
[INFO] 
[INFO] ---
[INFO]  T E S T S
[INFO] ---
[INFO] Running org.apache.avro.mojo.TestInduceMojo
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.619 s 
- in org.apache.avro.mojo.TestInduceMojo
[INFO] Running org.apache.avro.mojo.TestSchemaMojo
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.508 s 
- in org.apache.avro.mojo.TestSchemaMojo
[INFO] Running org.apache.avro.mojo.TestIDLProtocolMojo
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.364 s 
- in org.apache.avro.mojo.TestIDLProtocolMojo
[INFO] Running org.apache.avro.mojo.TestProtocolMojo
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.21 s - 
in org.apache.avro.mojo.TestProtocolMojo
[INFO] 
[INFO] Results:
[INFO] 
[INFO] Tests run: 11, Failures: 0, Errors: 0, Skipped: 0
[INFO] 
[INFO] 
[INFO] --- maven-checkstyle-plugin:3.0.0:check (checkstyle-check) @ 
avro-maven-plugin ---
[INFO] Starting audit...
Audit done.
[INFO] 
[INFO] --- maven-surefire-plugin:3.0.0-M3:test (test-with-custom-coders) @ 
avro-maven-plugin ---
[INFO] 
[INFO] ---
[INFO]  T E S T S
[INFO] ---
[INFO] Running org.apache.avro.mojo.TestProtocolMojo
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.925 s 
- in org.apache.avro.mojo.TestProtocolMojo
[INFO] Running org.apache.avro.mojo.TestIDLProtocolMojo
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.35 s - 
in org.apache.avro.mojo.TestIDLProtocolMojo
[INFO] Running org.apache.avro.mojo.TestSchemaMojo
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.18 s - 
in org.apache.avro.mojo.TestSchemaMojo
[INFO] Running org.apache.avro.mojo.TestInduceMojo
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.167 s 
- in org.apache.avro.mojo.TestInduceMojo
[INFO] 
[INFO] Results:
[INFO] 
[INFO] Tests r

[jira] [Resolved] (AVRO-2306) Python 3 avro library corrupts files when using snappy codec

[JIRA]

 [ 
https://issues.apache.org/jira/browse/AVRO-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ismaël Mejía resolved AVRO-2306.

Resolution: Fixed

> Python 3 avro library corrupts files when using snappy codec
> 
>
> Key: AVRO-2306
> URL: https://issues.apache.org/jira/browse/AVRO-2306
> Project: Apache Avro
>  Issue Type: Bug
>  Components: python
>Affects Versions: 1.8.2
>Reporter: Charles Chen
>Priority: Critical
> Fix For: 1.9.0
>
>
> Currently, the Python version of avro when run in Python 3 corrupts files 
> when using the snappy codec.  Specifically, this line 
> [https://github.com/apache/avro/blob/8643e3bd73cab8dbbbcac1203a19c2d2cdc62cfe/lang/py3/avro/datafile.py#L286]
>  fails to resolve to True because of a comparison between a byte and unicode 
> string returning False.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (AVRO-2306) Python 3 avro library corrupts files when using snappy codec

[JIRA]

 [ 
https://issues.apache.org/jira/browse/AVRO-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ismaël Mejía updated AVRO-2306:
---
Fix Version/s: 1.9.0

> Python 3 avro library corrupts files when using snappy codec
> 
>
> Key: AVRO-2306
> URL: https://issues.apache.org/jira/browse/AVRO-2306
> Project: Apache Avro
>  Issue Type: Bug
>  Components: python
>Affects Versions: 1.8.2
>Reporter: Charles Chen
>Priority: Critical
> Fix For: 1.9.0
>
>
> Currently, the Python version of avro when run in Python 3 corrupts files 
> when using the snappy codec.  Specifically, this line 
> [https://github.com/apache/avro/blob/8643e3bd73cab8dbbbcac1203a19c2d2cdc62cfe/lang/py3/avro/datafile.py#L286]
>  fails to resolve to True because of a comparison between a byte and unicode 
> string returning False.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (AVRO-2306) Python 3 avro library corrupts files when using snappy codec

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/AVRO-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16749680#comment-16749680
 ] 

ASF subversion and git services commented on AVRO-2306:
---

Commit 384061c05720287aa93a756a742aab2572b75e79 in avro's branch 
refs/heads/master from Charles Chen
[ https://gitbox.apache.org/repos/asf?p=avro.git;h=384061c ]

AVRO-2306: Fix data corruption issue with snappy in Python 3


> Python 3 avro library corrupts files when using snappy codec
> 
>
> Key: AVRO-2306
> URL: https://issues.apache.org/jira/browse/AVRO-2306
> Project: Apache Avro
>  Issue Type: Bug
>  Components: python
>Affects Versions: 1.8.2
>Reporter: Charles Chen
>Priority: Critical
>
> Currently, the Python version of avro when run in Python 3 corrupts files 
> when using the snappy codec.  Specifically, this line 
> [https://github.com/apache/avro/blob/8643e3bd73cab8dbbbcac1203a19c2d2cdc62cfe/lang/py3/avro/datafile.py#L286]
>  fails to resolve to True because of a comparison between a byte and unicode 
> string returning False.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)