RE: Reading/Writing Avro files using R

2013-05-06 Thread Anshuman Saini
Hi, Can anyone please help me with some examples as to how can I use make.socket(), read.socket(), write.socket(), close.socket(). With the examples in the documentation, I am getting errors in making sockets. Error: Error in make.socket(host, port) : socket not established Can anyone please

[jira] [Updated] (AVRO-1316) IDL code-generation generates too-long literals for very large schemas

2013-05-06 Thread Micah Huff (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Huff updated AVRO-1316: - Attachment: AVRO-1316.patch [~cutting] -- I've updated the parse methods for both schema and protocol to b

Reading nested specific type

2013-05-06 Thread Bernd Fondermann
Hi all, I have an avro schema with nested types, which is used to write a trevi file. When reading/iterating the file using the outer specific type (WPPage), the nested type (WPPageType, an enum) is only initialized as an int, the nested enum type itself is not used. only after changing the genera

Re: Reading nested specific type

2013-05-06 Thread Doug Cutting
This looks like a bug. I can reproduce it. Please file an issue in Jira. Thanks, Doug On Mon, May 6, 2013 at 8:55 AM, Bernd Fondermann wrote: > Hi all, > > I have an avro schema with nested types, which is used to write a trevi > file. > When reading/iterating the file using the outer specifi

[jira] [Commented] (AVRO-1316) IDL code-generation generates too-long literals for very large schemas

2013-05-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13649984#comment-13649984 ] Doug Cutting commented on AVRO-1316: We might optimize the parse methods a bit so that:

[jira] [Work started] (AVRO-1318) Python schema should store fingerprints

2013-05-06 Thread Jeremy Kahn (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AVRO-1318 started by Jeremy Kahn. > Python schema should store fingerprints > --- > > Key: AVRO-1318 >

[jira] [Created] (AVRO-1318) Python schema should store fingerprints

2013-05-06 Thread Jeremy Kahn (JIRA)
Jeremy Kahn created AVRO-1318: - Summary: Python schema should store fingerprints Key: AVRO-1318 URL: https://issues.apache.org/jira/browse/AVRO-1318 Project: Avro Issue Type: Bug Compon

[jira] [Created] (AVRO-1319) Two new tools: random & totrevni

2013-05-06 Thread Doug Cutting (JIRA)
Doug Cutting created AVRO-1319: -- Summary: Two new tools: random & totrevni Key: AVRO-1319 URL: https://issues.apache.org/jira/browse/AVRO-1319 Project: Avro Issue Type: New Feature Com

[jira] [Updated] (AVRO-1319) Two new tools: random & totrevni

2013-05-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated AVRO-1319: --- Attachment: AVRO-1319.patch > Two new tools: random & totrevni >

[jira] [Updated] (AVRO-1319) Two new tools: random & totrevni

2013-05-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated AVRO-1319: --- Fix Version/s: 1.7.5 Assignee: Doug Cutting Status: Patch Available (was: Open)

[jira] [Created] (AVRO-1320) Java: Trevni incorrectly reads specific enums.

2013-05-06 Thread Doug Cutting (JIRA)
Doug Cutting created AVRO-1320: -- Summary: Java: Trevni incorrectly reads specific enums. Key: AVRO-1320 URL: https://issues.apache.org/jira/browse/AVRO-1320 Project: Avro Issue Type: Bug

[jira] [Updated] (AVRO-1320) Java: Trevni incorrectly reads specific enums.

2013-05-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated AVRO-1320: --- Attachment: AVRO-1320.patch Here's a patch that should fix this. Bernd, can you please verify whether

[jira] [Updated] (AVRO-1320) Java: Trevni incorrectly reads specific enums.

2013-05-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated AVRO-1320: --- Fix Version/s: 1.7.5 Assignee: Doug Cutting Status: Patch Available (was: Open)

Re: Reading nested specific type

2013-05-06 Thread Doug Cutting
I filed the bug and attached a patch: https://issues.apache.org/jira/browse/AVRO-1320 Does this fix things for you? Thanks, Doug On Mon, May 6, 2013 at 10:53 AM, Doug Cutting wrote: > This looks like a bug. I can reproduce it. Please file an issue in Jira. > > Thanks, > > Doug > > On Mon, M

Re: Reading nested specific type

2013-05-06 Thread Doug Cutting
Bernd, I also note that in the schema you provided above that the "type" field contains a union containing a single element. Is that intentional? If not, you have an extra set of square brackets around "WPPageType". Doug On Mon, May 6, 2013 at 1:30 PM, Doug Cutting wrote: > I filed the bug an

[jira] [Commented] (AVRO-1275) GenericData's toString() method generates the wrong JSON encoding for the bytes type

2013-05-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650099#comment-13650099 ] Doug Cutting commented on AVRO-1275: This is a bug, but fixing it would be an incompati

[jira] [Commented] (AVRO-1275) GenericData's toString() method generates the wrong JSON encoding for the bytes type

2013-05-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650102#comment-13650102 ] Doug Cutting commented on AVRO-1275: Also note that the json_encoding mentioned in the

[jira] [Created] (AVRO-1321) Avro-ipc-tests in compile scope instead of test in Avro-mapred

2013-05-06 Thread Benyi Wang (JIRA)
Benyi Wang created AVRO-1321: Summary: Avro-ipc-tests in compile scope instead of test in Avro-mapred Key: AVRO-1321 URL: https://issues.apache.org/jira/browse/AVRO-1321 Project: Avro Issue Type

[jira] [Created] (AVRO-1322) Publish Trevni Artifacts with Hadoop version classifier

2013-05-06 Thread Matt Massie (JIRA)
Matt Massie created AVRO-1322: - Summary: Publish Trevni Artifacts with Hadoop version classifier Key: AVRO-1322 URL: https://issues.apache.org/jira/browse/AVRO-1322 Project: Avro Issue Type: Bug

[jira] [Updated] (AVRO-1322) Publish trevni-avro artifact with Hadoop version classifier

2013-05-06 Thread Matt Massie (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Massie updated AVRO-1322: -- Summary: Publish trevni-avro artifact with Hadoop version classifier (was: Publish Trevni Artifacts wit

[jira] [Updated] (AVRO-1322) Publish trevni-avro artifact with Hadoop version classifier

2013-05-06 Thread Matt Massie (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Massie updated AVRO-1322: -- Status: Patch Available (was: Open) > Publish trevni-avro artifact with Hadoop version classifier >

[jira] [Updated] (AVRO-1322) Publish trevni-avro artifact with Hadoop version classifier

2013-05-06 Thread Matt Massie (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Massie updated AVRO-1322: -- Status: Open (was: Patch Available) > Publish trevni-avro artifact with Hadoop version classifier >

[jira] [Updated] (AVRO-1322) Publish trevni-avro artifact with Hadoop version classifier

2013-05-06 Thread Matt Massie (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Massie updated AVRO-1322: -- Attachment: 0001-POM-Fixup.patch > Publish trevni-avro artifact with Hadoop version classifier > ---

[jira] [Updated] (AVRO-1322) Publish trevni-avro artifact with Hadoop version classifier

2013-05-06 Thread Matt Massie (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Massie updated AVRO-1322: -- Status: Patch Available (was: Open) > Publish trevni-avro artifact with Hadoop version classifier >

[jira] [Updated] (AVRO-1316) IDL code-generation generates too-long literals for very large schemas

2013-05-06 Thread Micah Huff (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Huff updated AVRO-1316: - Attachment: AVRO-1316.patch [~cutting]--attached is the updated patch with your comments addressed. [~tro

[jira] [Updated] (AVRO-1322) Publish trevni-avro artifact with Hadoop version classifier

2013-05-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated AVRO-1322: --- Fix Version/s: 1.7.5 Can we move the profile stuff up to lang/java/pom.xml so it's not duplicated in

[jira] [Commented] (AVRO-1322) Publish trevni-avro artifact with Hadoop version classifier

2013-05-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650184#comment-13650184 ] Doug Cutting commented on AVRO-1322: Also, the Trevni change can probably be pushed dow

[jira] [Created] (AVRO-1323) Python request schemas should report fullname

2013-05-06 Thread Jeremy Kahn (JIRA)
Jeremy Kahn created AVRO-1323: - Summary: Python request schemas should report fullname Key: AVRO-1323 URL: https://issues.apache.org/jira/browse/AVRO-1323 Project: Avro Issue Type: Bug

[jira] [Assigned] (AVRO-1323) Python request schemas should report fullname

2013-05-06 Thread Jeremy Kahn (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Kahn reassigned AVRO-1323: - Assignee: Jeremy Kahn > Python request schemas should report fullname > --

[jira] [Work started] (AVRO-1323) Python request schemas should report fullname

2013-05-06 Thread Jeremy Kahn (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AVRO-1323 started by Jeremy Kahn. > Python request schemas should report fullname > - > > Key: AVRO-132

[jira] [Updated] (AVRO-1323) Python request schemas should report fullname

2013-05-06 Thread Jeremy Kahn (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Kahn updated AVRO-1323: -- Attachment: AVRO-1323.patch > Python request schemas should report fullname > --

[jira] [Updated] (AVRO-1323) Python request schemas should report fullname

2013-05-06 Thread Jeremy Kahn (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Kahn updated AVRO-1323: -- Status: Patch Available (was: In Progress) Patch work done [here|https://github.com/jkahn/avro/tree/AVR

[jira] [Updated] (AVRO-1318) Python schema should store fingerprints

2013-05-06 Thread Jeremy Kahn (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Kahn updated AVRO-1318: -- Attachment: AVRO-1318.patch Patch from [here|https://github.com/jkahn/avro/tree/AVRO-1318]. A copy of

[jira] [Updated] (AVRO-1318) Python schema should store fingerprints

2013-05-06 Thread Jeremy Kahn (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Kahn updated AVRO-1318: -- Status: Patch Available (was: In Progress) Tests pass {{ant clean build}} for me. > Py

[jira] [Commented] (AVRO-1318) Python schema should store fingerprints

2013-05-06 Thread Jeremy Kahn (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650219#comment-13650219 ] Jeremy Kahn commented on AVRO-1318: --- Oh, to be clear: when AVRO-1323 is included, then AV

[jira] [Commented] (AVRO-1322) Publish trevni-avro artifact with Hadoop version classifier

2013-05-06 Thread Matt Massie (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650241#comment-13650241 ] Matt Massie commented on AVRO-1322: --- I'll fix this patch. 1. I'll move the new profiles

[jira] [Updated] (AVRO-1316) IDL code-generation generates too-long literals for very large schemas

2013-05-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated AVRO-1316: --- Attachment: AVRO-1316.patch Here's a version of the patch with a few modifications: - use a StringBui

[jira] [Updated] (AVRO-1316) IDL code-generation generates too-long literals for very large schemas

2013-05-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated AVRO-1316: --- Attachment: AVRO-1316.patch Version without debug print statements. > IDL code-genera

[jira] [Updated] (AVRO-1322) Publish trevni-avro artifact with Hadoop version classifier

2013-05-06 Thread Matt Massie (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Massie updated AVRO-1322: -- Attachment: 0001-AVRO-1322.-Publish-trevni-avro-artifact-with-Hadoop-.patch Tested this patch by running

[jira] [Commented] (AVRO-1322) Publish trevni-avro artifact with Hadoop version classifier

2013-05-06 Thread Matt Massie (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650340#comment-13650340 ] Matt Massie commented on AVRO-1322: --- Actually, to build the hadoop1 version the command i