The Apache AsterixDB Team is happy to announce the latest release of Apache AsterixDB 0.9.5 and its associated Hyracks release.
Apache AsterixDB is a Big Data Management System (BDMS) that can store, index, manage, and query semi-structured data at scale on a cluster. (Hyracks is its underlying dataflow runtime platform.) A short summary of improvements and bugfixes since release 0.9.4.1: [ASTERIXDB-2752][MTD] Add metadata for synonyms on upgrade [ASTERIXDB-2748][RT] CASE fails if default value is TRUE [ASTERIXDB-2751][EXT] Issue a warning if external dataset configuration returns no files [ASTERIXDB-2750][COMP] Incorrect result with unnest and join [ASTERIXDB-2744][COMP] Fix compiler error during index selection [ASTERIXDB-2730][STO] Optimize flush in GVBC [ASTERIXDB-2742] Relax Java version check [ASTERIXDB-2743][EXT] Skip not found files when querying S3 external dataset [ASTERIXDB-2741][EXT] Support include/exclude filters for S3 external datasets [ASTERIXDB-2722][EXT] Require minimum permissions + improve error reporting [ASTERIXDB-2726][EXT] Report line number in errors of JSON parser [ASTERIXDB-2738][STO] Create Mask File Before Merge Operations [ASTERIXDB-2732][FUN] Support missing and union type in get_object_field_value [ASTERIXDB-2730][STO] Do not wait on flushing metadata indexes [ASTERIXDB-2725][COMP] Check if dataverse exists before continuing the DDL execution [ASTERIXDB-2736][EXT] Ensure retrieving all objects if an S3 bucket has more than 1000 objects [ASTERIXDB-2735][EXT] Support boolean value for properties of external data [ASTERIXDB-2731][API] GET is not supported for the query service servlet [ASTERIXDB-2730][STO] Avoid Double Flushes in GVBC [ASTERIXDB-2729][LIC] Fix license warnings in newly added AWS libraries & dependencies [ASTERIXDB-2730][STO] Safely Update Flush Pointer in GVBC [ASTERIXDB-2726][EXT] Report line number instead of record number in messages of parsers [ASTERIXDB-2724][EXT] Handle passing empty defintion to external datasets [ASTERIXDB-2720][EXT] Support arrays of objects for external dataset with json format [ASTERIXDB-2719][EXT] Add .gz compressed test cases for CSV and TSV [ASTERIXDB-2176] Python UDFs [ASTERIXDB-2719][EXT] Default external datasets to read .gz and .gzip files as well [ASTERIXDB-2715][STO] Dynamic Memory Component Architecture [ASTERIXDB-2713][EXT] Change the name of the new adapter parameter for escaping [ASTERIXDB-2713][EXT] CSV & TSV support for external dataset p4 [ASTERIXDB-2718][EXT] Add more test cases to cover complex JSON formats [ASTERIXDB-2713][EXT] CSV & TSV support for external dataset p3 [ASTERIXDB-2713][EXT] CSV & TSV support for external dataset p2 [ASTERIXDB-2712][EXT] Fix ByteBuffer limit when read more data [ASTERIXDB-2713][EXT] Add CSV & TSV support for external dataset [ASTERIXDB-2709][COMP] Fix registration of st_union aggregates [ASTERIXDB-2708] Introduce batch and stateful point cursors [ASTERIXDB-2697]: Implementing AWS s3 as external data source [ASTERIXDB-2689][FUN] Agg Avg: skip and warn for invalid values [ASTERIXDB-2664][TEST] Add Run File Test [ASTERIXDB-2700][*DB][RT] Fix invalid plan caused by order-by operator in a subquery [ASTERIXDB-2696][COMP] Incorrect result with nested subplans [ASTERIXDB-2693] CREATE FUNCTION/ADAPTER ddl [ASTERIXDB-2566][TYPE][FUN] Added complete set of is_* type functions and a generic get_type function. [ASTERIXDB-2690][FUN] Agg Sum: skip and warn for invalid values [ASTERIXDB-2689][FUN] Make arithmetic functions return NULL on invalid arguments [ASTERIXDB-2689][FUN] Make numeric functions return NULL on invalid arguments p2 [ASTERIXDB-2689][FUN] Make numeric functions return NULL on invalid arguments [ASTERIXDB-2688][HYR] Fix use of a Hyracks task across join stages [ASTERIXDB-2687][RT] Issue a warning when incomparable types are compared [ASTERIXDB-2683][OTH] Add tests for filters using large (>50K) in-lists. [ASTERIXDB-2686][RT] Run files are not removed on time [ASTERIXDB-2686][RT] Delete run files eagerly [ASTERIXDB-2667][FUN] Share code base between string functions [ASTERIXDB-2680][FUN] Add support to regexp_matches() and regexp_split() [ASTERIXDB-2634][FUN] String functions to return null on data/type errors [ASTERIXDB-2658][FUN] Add support for array_except() function [ASTERIXDB-2671][FUN] Fix handling nullable inputs in OBJECT_*() [ASTERIXDB-2672][API] Change the valid values for "format" request parameter [ASTERIXDB-2665][DOC] fix typo in primer [ASTERIXDB-2656] Remove frame constraint in HHJ probe [ASTERIXDB-2659][API] validate request parameters [ASTERIXDB-2657][FUN] String 1-based functions + function aliases [ASTERIXDB-2662][FUN] Update string functions documentation [ASTERIXDB-2648][COMP] Fix dataset order in broadcast hint [ASTERIXDB-2655][STO] Default storage compression to enabled [ASTERIXDB-2651][RT][FUN] Handle matching a literal backslash properly in LIKE [ASTERIXDB-2649][FUN] TPC-DS datasource function, generate proper data types [ASTERIXDB-2634][COMP] String functions return null on data/type errors [ASTERIXDB-2647][COMP] Random partitioner shouldn't preserve input's properties [ASTERIXDB-2541][STO] Introduce GreedyScheduler [ASTERIXDB-2497][TX] Ensure Log Record Flush LSN is Set [ASTERIXDB-2635][*DB] Fix JSON plan pretty printing [ASTERIXDB-2635][*DB] Fix JSON plan pretty printing [ASTERIXDB-2600][STO] Introduce ConcurrentMergePolicy [ASTERIXDB-2540][STO] Optimize Storage Disk I/O [ASTERIXDB-2631][COMP][RT] Report count of all warnings [ASTERIXDB-2634][COMP][RT] String functions to return NULL on mismatch [ASTERIXDB-2532][RT] per-operator profiling [ASTERIXDB-2633][FUN] Fix LIKE to regex translation [ASTERIXDB-2631][COMP][RT] Limit number of reported warnings [ASTERIXDB-2625][OTH] Proper error message for invalid uuid [ASTERIXDB-2626][*DB] Ignore dup fields in record construction, issue warning [ASTERIXDB-2611][*DB] Fix GroupAll with empty input [ASTERIXDB-2577][RT] One frame per spilled partition in optimized hybrid hash join [ASTERIXDB-2623][FUN] TPC-DS revert partitioning behavior back to default [ASTERIXDB-2619][FUN] Add extra test cases for bitwise functions [ASTERIXDB-2615][*DB] Enable constant folding rule to determine when to fold [ASTERIXDB-2599][STO] Cleanup compression LAFs [ASTERIXDB-2614][TEST] Make type computer test argument count aware [ASTERIXDB-2603][FUN] Add compile/runtime warnings for bitwise functions [ASTERIXDB-2613][*DB] Fix serialization of schemaless records [ASTERIXDB-2610][RT][*DB] Improve deep comparison runtime [ASTERIXDB-2612][COMP] Incorrect result with two-step aggregate [ASTERIXDB-2608] Don't use varargs when args number is known [ASTERIXDB-2607][RT][*DB] Fix detecting duplicate fields in record construction [ASTERIXDB-2575][RT][FUN] Remove usages of ComparisonHelper [ASTERIXDB-2597] Load UDFs via HTTP [ASTERIXDB-2593][FUN] TPC-DS always parallelize + gen all tables [ASTERIXDB-2598][RT] Add Support For Runtime Warnings [ASTERIXDB-2584][FUN] Support rounding digit for round() [ASTERIXDB-2458][COMP] Fix min/max functions with group by [ASTERIXDB-2574][COMP] Fix min/max functions [ASTERIXDB-2579][DOC] Document uuid/upsert/insert behavior [ASTERIXDB-2547][COMP] Disallow passing UNION tag to get comparator [ASTERIXDB-2458][COMP] Fix InjectTypeCastForFunctionArgumentsRule [ASTERIXDB-2562][FUN] Add support for bitwise functions [ASTERIXDB-2569][TEST] Refactor type computer tests [ASTERIXDB-2288][COMP] Fix field access with UNION [ASTERIXDB-2289][COMP] Fix field access with CASE [ASTERIXDB-2567][RT] Fix serializing nullable record fields [ASTERIXDB-2555][RT][COMP] Make hash join use logical comparison [ASTERIXDB-2535][COMP] Fix uuid present in insert/upsert statement [ASTERIXDB-2563][API] Allow All Nodes To Receive Queries [ASTERIXDB-2564][RT] Too many objects created in min() and max() [ASTERIXDB-2552][RT] Reuse objects on reseting buffer manager [ASTERIXDB-2552][RT] Implement micro external sort for subplans [ASTERIXDB-2552][RT] Refactor runs generator and merger [ASTERIXDB-2554][HYR] Add UTF8 and byte array comparator factories [ASTERIXDB-2310][STO]Enforce Key Uniquness using PKIndex [ASTERIXDB-2553][SQL] Make DIV and MOD Operators Case Insensitive [ASTERIXDB-2551][*DB] Use Ordered Property in range merge POperator [ASTERIXDB-2483][FUN] Fix ClassCastException during type check [ASTERIXDB-2308][TEST] Add DDL Stress Test [ASTERIXDB-2516][RT] Prevent passing null type to comparator provider [ASTERIXDB-2450][DOC] make docs match implementation [ASTERIXDB-2545][COMP] Compiler error with window function call [ASTERIXDB-2539][COMP] Exclude LET variables from "Single Variable Resolution" rule [ASTERIXDB-2516][RT] Move primitive comparators to Hyracks and make singleton [ASTERIXDB-2388] Add nodeIDs to cluster state query failure exception [ASTERIXDB-2516][RT] Modifty range map function of parallel sort [ASTERIXDB-2537][COMP] Incorrect free variables for QuantifiedExpression [ASTERIXDB-2536][COMP] Do not push Select through RunningAggregate [ASTERIXDB-2483][COMP][FUN] Eliminate listify for distinct aggregates [ASTERIXDB-2516][RT] Make asterix types comparators singleton and stateless [ASTERIXDB-2516][COMP] Avoid writing field names & values when comparing records [ASTERIXDB-2516][COMP] Avoid writing into buffer when comparing numbers [ASTERIXDB-2530][COMP] Error computing type for numeric add [ASTERIXDB-2459][FUN] Add skewness and kurtosis aggregate function [ASTERIXDB-2529][COMP] Incorrect result with MISSING field value [ASTERIXDB-2516][COMP] Change logical comparator interface [ASTERIXDB-2528][COMP] Fix illegal state exception in the compiler [ASTERIXDB-2516][COMP] Change logical comparators handling of null/missing [ASTERIXDB-2527][COMP] Fix illegal state error [ASTERIXDB-2523][RT][COMP] add support for hashing record fields [ASTERIXDB-2491][TXN] Recovery fixes [ASTERIXDB-2525][COMP] Re-infer types after introducing aggregate combiners [ASTERIXDB-2523][RT][COMP] add support for hashing array fields [ASTERIXDB-2524][COMP] Fix name resolution for ratio_to_report() [ASTERIXDB-2521][COMP] Add rule to eliminate isomorphic subplans [ASTERIXDB-2522][TX] Skip WAIT record during lock conflicts [ASTERIXDB-2490][NET] Allow Private Key Entries With Password [ASTERIXDB-2516][RT] record deep comparison (ordering) [ASTERIXDB-2516][RT] array deep comparison (ordering) [No Issue] [COMP] Hooks to disable constant folding [ASTERIXDB-2516][RT] prepare physical comparators for deep comparison [ASTERIXDB-2516][RT] add support for record deep comparison [ASTERIXDB-2516][RT] add support for array deep comparison [ASTERIXDB-2520][RT] Make Dataset Memory Reservation Idempotent [ASTERIXDB-2519][COMP] Fix compiler error with range predicate [ASTERIXDB-2518][RT] Introduce Request Tracker [ASTERIXDB-2514] Fix BigInt display in formatted JSON [ASTERIXDB-2516][RT] add support for deep comparison 1 [ASTERIXDB-2513][FUN] Add Active_Requests Function [ASTERIXDB-2512][TEST] Changes SpiderSilk Version [ASTERIXDB-2511][COMP] Refactor LET/WHERE clauses into a single list [ASTERIXDB-2512][TEST] Adds SpiderSilk Integration [ASTERIXDB-2510][OTH] Fix Forward Operator JSON Plan [ASTERIXDB-2509][FUN] Implement CUME_DIST() and RATIO_TO_REPORT() [ASTERIXDB-2506][STO] Checkpoint Datasets [ASTERIXDB-2505][COMP] Consolidate window operators rule [ASTERIXDB-2488][COMP] Support aggregate window functions [ASTERIXDB-2498][DOC] List slice documentation for SQL++ [ASTERIXDB-2490][NET] Support Encrypted Replication Connections [ASTERIXDB-2490][NET] Support Encrypted Multiplexed Connections [ASTERIXDB-2490][NET] Support Encrypted RMI Connections [ASTERIXDB-2495][ING] Avoid LET in applying functions to feeds [ASTERIXDB-2476][COMP] Array slicing parser syntax [ASTERIXDB-2492][TXN] Skip filter update on undo [ASTERIXDB-2497][TX] Ensure Log Record Flush LSN is Set [ASTERIXDB-2494][RT] Log Allocated Datasets on Allocation Failure [ASTERIXDB-2490][NET] Support Encrypted IPC Connections [ASTERIXDB-2489][COMP] Allow Negative Compiler Parallelism [ASTERIXDB-2484][FUN] Supporting SINH, COSH and TANH functions [ASTERIXDB-2476][FUN] Support array slicing in SQL++ [ASTERIXDB-2451][DOC] Fix object_unwrap() documentation [ASTERIXDB-2463][DOC] add docs for primary index & parallel sort parameters [ASTERIXDB-2468] Extend CountVarToCountOneRule to support no group-by [ASTERIXDB-2480][ING] Fix http-feed compatibility with JSON parser [ASTERIXDB-2479][API] Add Network Diagnostics API [ASTERIXDB-2475][OTH] Reject HTTP Pipelined Requests [ASTERIXDB-2422][STO] Introduce compressed storage [ASTERIXDB-2474][COMP] Remove physical optimization static variable [ASTERIXDB-2460][FUN] Fix sum() overflow bug [ASTERIXDB-2469][TEST] Tests Can Result In False Positives For Numericals [ASTERIXDB-2472][CONF] More Restrictive Configuration Options [ASTERIXDB-2286][COMP] Parallel sort changes p.2 [ASTERIXDB-2466][FUN] Implement window functions [ASTERIXDB-2454] Remove non-unique AQL tests (pt.1) [ASTERIXDB-2459][FUN] Add var() and var_pop() aggregate function [ASTERIXDB-2467][STO] Fix locking protocol with bad tuples [ASTERIXDB-2459][FUN] Add sttdev_pop() aggregate function [ASTERIXDB-2454] Remove non-unique AQL tests [ASTERIXDB-2286][COMP][FUN][HYR] Parallel Sort Optimization [ASTERIXDB-2461][FUN] Fix LocalAvgTypeComputer [ASTERIXDB-2459][FUN] Add sttdev() aggregate function [ASTERIXDB-2264][ING] Introduce Http Feed Adapter
