[jira] [Updated] (PIG-4854) Merge spark branch to trunk
[ https://issues.apache.org/jira/browse/PIG-4854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4854: -- Resolution: Fixed Status: Resolved (was: Patch Available) duplicate with PIG-5215 > Merge spark branch to trunk > --- > > Key: PIG-4854 > URL: https://issues.apache.org/jira/browse/PIG-4854 > Project: Pig > Issue Type: Bug >Reporter: Pallavi Rao > Attachments: PigOnSpark_3.patch, PIG-On-Spark.patch > > > Believe the spark branch will be shortly ready to be merged with the main > branch (couple of minor patches pending commit), given that we have addressed > most functionality gaps and have ensured the UTs are clean. There are a few > optimizations which we will take up once the branch is merged to trunk. > [~xuefuz], [~rohini], [~daijy], > Hopefully, you agree that the spark branch is ready for merge. If yes, how > would like us to go about it? Do you want me to upload a huge patch that will > be merged like any other patch or do you prefer a branch merge? -- This message was sent by Atlassian JIRA (v6.3.15#6346)
CFP for Dataworks Summit Sydney
The Australia/Pacific version of Dataworks Summit is in Sydney this year, September 20-21. This is a great place to talk about work you are doing in Apache Pig or how you are using Pig. Information on submitting an abstract is at https://dataworkssummit.com/sydney-2017/abstracts/submit-abstract/ Tracks: Apache Hadoop Apache Spark and Data Science Cloud and Applications Data Processing and Warehousing Enterprise Adoption IoT and Streaming Operations, Governance and Security Deadline: Friday, May 26th, 2017. Alan.
[jira] Subscription: PIG patch available
Issue Subscription Filter: PIG patch available (42 issues) Subscriber: pigdaily Key Summary PIG-5228Orc_2 is failing with spark exec type https://issues.apache.org/jira/browse/PIG-5228 PIG-5225Several unit tests are not annotated with @Test https://issues.apache.org/jira/browse/PIG-5225 PIG-5218Jyhton_Checkin_3 fails with spark exec type https://issues.apache.org/jira/browse/PIG-5218 PIG-5207BugFix e2e tests fail on spark https://issues.apache.org/jira/browse/PIG-5207 PIG-5199exclude jline in spark dependency https://issues.apache.org/jira/browse/PIG-5199 PIG-5194HiveUDF fails with Spark exec type https://issues.apache.org/jira/browse/PIG-5194 PIG-5186Support aggregate warnings with Spark engine https://issues.apache.org/jira/browse/PIG-5186 PIG-5185Job name show "DefaultJobName" when running a Python script https://issues.apache.org/jira/browse/PIG-5185 PIG-5184set command to view value of a variable https://issues.apache.org/jira/browse/PIG-5184 PIG-5160SchemaTupleFrontend.java is not thread safe, cause PigServer thrown NPE in multithread env https://issues.apache.org/jira/browse/PIG-5160 PIG-5135HDFS bytes read stats are always 0 in Spark mode https://issues.apache.org/jira/browse/PIG-5135 PIG-5115Builtin AvroStorage generates incorrect avro schema when the same pig field name appears in the alias https://issues.apache.org/jira/browse/PIG-5115 PIG-5106Optimize when mapreduce.input.fileinputformat.input.dir.recursive set to true https://issues.apache.org/jira/browse/PIG-5106 PIG-5081Can not run pig on spark source code distribution https://issues.apache.org/jira/browse/PIG-5081 PIG-5080Support store alias as spark table https://issues.apache.org/jira/browse/PIG-5080 PIG-5057IndexOutOfBoundsException when pig reducer processOnePackageOutput https://issues.apache.org/jira/browse/PIG-5057 PIG-5029Optimize sort case when data is skewed https://issues.apache.org/jira/browse/PIG-5029 PIG-4926Modify the content of start.xml for spark mode https://issues.apache.org/jira/browse/PIG-4926 PIG-4913Reduce jython function initiation during compilation https://issues.apache.org/jira/browse/PIG-4913 PIG-4854Merge spark branch to trunk https://issues.apache.org/jira/browse/PIG-4854 PIG-4849pig on tez will cause tez-ui to crash,because the content from timeline server is too long. https://issues.apache.org/jira/browse/PIG-4849 PIG-4750REPLACE_MULTI should compile Pattern once and reuse it https://issues.apache.org/jira/browse/PIG-4750 PIG-4748DateTimeWritable forgets Chronology https://issues.apache.org/jira/browse/PIG-4748 PIG-4745DataBag should protect content of passed list of tuples https://issues.apache.org/jira/browse/PIG-4745 PIG-4684Exception should be changed to warning when job diagnostics cannot be fetched https://issues.apache.org/jira/browse/PIG-4684 PIG-4656Improve String serialization and comparator performance in BinInterSedes https://issues.apache.org/jira/browse/PIG-4656 PIG-4598Allow user defined plan optimizer rules https://issues.apache.org/jira/browse/PIG-4598 PIG-4551Partition filter is not pushed down in case of SPLIT https://issues.apache.org/jira/browse/PIG-4551 PIG-4539New PigUnit https://issues.apache.org/jira/browse/PIG-4539 PIG-4515org.apache.pig.builtin.Distinct throws ClassCastException https://issues.apache.org/jira/browse/PIG-4515 PIG-4323PackageConverter hanging in Spark https://issues.apache.org/jira/browse/PIG-4323 PIG-4313StackOverflowError in LIMIT operation on Spark https://issues.apache.org/jira/browse/PIG-4313 PIG-4251Pig on Storm https://issues.apache.org/jira/browse/PIG-4251 PIG-4002Disable combiner when map-side aggregation is used https://issues.apache.org/jira/browse/PIG-4002 PIG-3952PigStorage accepts '-tagSplit' to return full split information https://issues.apache.org/jira/browse/PIG-3952 PIG-3911Define unique fields with @OutputSchema https://issues.apache.org/jira/browse/PIG-3911 PIG-3877Getting Geo Latitude/Longitude from Address Lines https://issues.apache.org/jira/browse/PIG-3877 PIG-3873Geo distance calculation using Haversine https://issues.apache.org/jira/browse/PIG-3873 PIG-3864ToDate(userstring, format, timezone) computes DateTime with strange handling of Daylight Saving Time with location based timezones https://issues.apache.org/jira/browse/PIG-3864 PIG-3668COR built-in function when atleast one of the coefficient values is
