JIRA to support append for SortedKeyValueFiles?
Hello, I believe as of the Avro release 1.7.3 appends are not supported for SortedKeyValueFiles. Is there a plan to add it/JIRA logged for it? I have worked on a fork of SortedKeyValueFiles and can contribute append functionality if someone else hasn't already. Please let me know. Thanks -- View this message in context: http://apache-avro.679487.n3.nabble.com/JIRA-to-support-append-for-SortedKeyValueFiles-tp4027834.html Sent from the Avro - Users mailing list archive at Nabble.com.
Re: Is it possible to append to an already existing avro file
Thanks for replying. You are correct. I followed this example https://gist.github.com/QwertyManiac/4724582 -- View this message in context: http://apache-avro.679487.n3.nabble.com/Is-it-possible-to-append-to-an-already-existing-avro-file-tp3762049p4027789.html Sent from the Avro - Users mailing list archive at Nabble.com.
Re: Type cast exception
Seems like it could be. Please confirm. I am using 'avro 1.7.3'. This is what my project dependencies look like: [INFO] +- org.apache.avro:avro:jar:1.7.3:compile [INFO] +- org.apache.avro:avro-mapred:jar:1.7.3:compile [INFO] | +- org.apache.avro:avro-ipc:jar:1.7.3:compile [INFO] | \- org.apache.avro:avro-ipc:jar:tests:1.7.3:compile -- View this message in context: http://apache-avro.679487.n3.nabble.com/Type-cast-exception-tp756884p4027730.html Sent from the Avro - Users mailing list archive at Nabble.com.
Re: Type cast exception
Updated but still facing the same issue. Any ideas why? Updated project dependencies. Now pulling in: [INFO] +- org.apache.avro:avro:jar:1.7.4:compile [INFO] +- org.apache.avro:avro-mapred:jar:1.7.4:compile [INFO] | +- org.apache.avro:avro-ipc:jar:1.7.4:compile [INFO] | \- org.apache.avro:avro-ipc:jar:tests:1.7.4:compile EXCEPTION: java.lang.ClassCastException: org.apache.avro.generic.GenericData$Record cannot be cast to com.abc.kepler.datasink.DataSinkChangeLogContent -- View this message in context: http://apache-avro.679487.n3.nabble.com/Type-cast-exception-tp756884p4027732.html Sent from the Avro - Users mailing list archive at Nabble.com.
Re: Type cast exception
For now, as a work-around, we are thinking of switching to directly using the schema instead of the generated class file. So, something like this: Schema schema=Schema.parse(getClass().getResourceAsStream(ChangeLogContent.avsc)); Its still unresolved why avro 1.7.4 couldn't fix this issue though. -- View this message in context: http://apache-avro.679487.n3.nabble.com/Type-cast-exception-tp756884p4027743.html Sent from the Avro - Users mailing list archive at Nabble.com.
Re: Type cast exception
Thanks, Doug. I will track that issue for further updates. -- View this message in context: http://apache-avro.679487.n3.nabble.com/Type-cast-exception-tp756884p4027747.html Sent from the Avro - Users mailing list archive at Nabble.com.
