JsonLoader fails the pig job in case of malformed json input

Hi all, Suppose I have a text file that contains only one line: {a, bad} This is obviously not a valid json. This input fails the this simple script: b = load 'bad.input' using JsonLoader('a0: chararray'); dump b; Same script works fine for this line: {a: good} I was expecting that it will

Re: JsonLoader fails the pig job in case of malformed json input

Definitely, please provide a patch. Alan. On Aug 8, 2013, at 4:58 AM, Demeter Sztanko wrote: Hi all, Suppose I have a text file that contains only one line: {a, bad} This is obviously not a valid json. This input fails the this simple script: b = load 'bad.input' using

[jira] [Created] (PIG-3413) JsonLoader fails the pig job in case of malformed json input

Demeter Sztanko created PIG-3413: Summary: JsonLoader fails the pig job in case of malformed json input Key: PIG-3413 URL: https://issues.apache.org/jira/browse/PIG-3413 Project: Pig Issue

[jira] [Commented] (PIG-3413) JsonLoader fails the pig job in case of malformed json input

[ https://issues.apache.org/jira/browse/PIG-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13733671#comment-13733671 ] Demeter Sztanko commented on PIG-3413: -- It is fairly trivial to fix it (just catch the

[jira] [Updated] (PIG-3379) Alias reuse in nested foreach causes PIG script to fail

[ https://issues.apache.org/jira/browse/PIG-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3379: Attachment: PIG-3379-draft.patch [~xuefuz], seems we can have a simpler fix. Attach PIG-3379-draft.patch.

[jira] [Commented] (PIG-3379) Alias reuse in nested foreach causes PIG script to fail

[ https://issues.apache.org/jira/browse/PIG-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13733919#comment-13733919 ] Xuefu Zhang commented on PIG-3379: -- [~daijy] Thanks for your suggestion. While your patch

[jira] [Commented] (PIG-3379) Alias reuse in nested foreach causes PIG script to fail

[ https://issues.apache.org/jira/browse/PIG-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13733924#comment-13733924 ] Xuefu Zhang commented on PIG-3379: -- Repost the logical plan snippet. {code}

[jira] [Assigned] (PIG-3410) LimitOptimizer is applied before PartitionFilterOptimizer

[ https://issues.apache.org/jira/browse/PIG-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi reassigned PIG-3410: --- Assignee: Aniket Mokashi LimitOptimizer is applied before PartitionFilterOptimizer

[jira] [Updated] (PIG-3410) LimitOptimizer is applied before PartitionFilterOptimizer

[ https://issues.apache.org/jira/browse/PIG-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-3410: Status: Patch Available (was: Open) LimitOptimizer is applied before PartitionFilterOptimizer

[jira] [Updated] (PIG-3410) LimitOptimizer is applied before PartitionFilterOptimizer

[ https://issues.apache.org/jira/browse/PIG-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-3410: Attachment: PIG-3410.patch LimitOptimizer is applied before PartitionFilterOptimizer

schema definition and subschema

Hi, A schema in Pig (LogicalSchema.java) is defined as an array list of LogicalFieldSchema whose class members are: - String alias - byte type - long uid - LogicalSchema schema I am wondering why is LogicalFieldShema containing a LogicalSchema member? My guess so far is that perhaps there's a

[jira] [Commented] (PIG-3299) Provide support for LazyOutputFormat to avoid creating empty files

[ https://issues.apache.org/jira/browse/PIG-3299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13734079#comment-13734079 ] Stephan Kemper commented on PIG-3299: - Has anyone taken this on? If not, it's something

[jira] [Commented] (PIG-3409) org.apache.pig.data.DefaultTuple hashcode perfomance issue

[ https://issues.apache.org/jira/browse/PIG-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13734130#comment-13734130 ] Suhas Satish commented on PIG-3409: --- Whats your suggested code fix to precomputing the

[jira] [Commented] (PIG-3379) Alias reuse in nested foreach causes PIG script to fail

[ https://issues.apache.org/jira/browse/PIG-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13734247#comment-13734247 ] Daniel Dai commented on PIG-3379: - Yes, you are right, it's not the dangling branch, it's

[jira] [Created] (PIG-3414) QueryParserDriver.parseSchema(String) silently returns a wrong result when a comma is missing in the schema definition

Cheolsoo Park created PIG-3414: -- Summary: QueryParserDriver.parseSchema(String) silently returns a wrong result when a comma is missing in the schema definition Key: PIG-3414 URL:

[jira] [Updated] (PIG-3414) QueryParserDriver.parseSchema(String) silently returns a wrong result when a comma is missing in the schema definition

[ https://issues.apache.org/jira/browse/PIG-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3414: --- Attachment: PIG-3414.patch Attached is a patch that throws an exception when a comma is missing in the

[jira] [Commented] (PIG-3285) Jobs using HBaseStorage fail to ship dependency jars

[ https://issues.apache.org/jira/browse/PIG-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13734258#comment-13734258 ] Nick Dimiduk commented on PIG-3285: --- Hi [~daijy]. Have a look at the patch on HBASE-9165.

[jira] Subscription: PIG patch available

Issue Subscription Filter: PIG patch available (16 issues) Subscriber: pigdaily Key Summary PIG-3414QueryParserDriver.parseSchema(String) silently returns a wrong result when a comma is missing in the schema definition