[
https://issues.apache.org/jira/browse/SPARK-13858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
JESSE CHEN updated SPARK-13858:
-------------------------------
Description:
Testing Spark SQL using TPC queries. Query 21 returns wrong results compared to
official result set. This is at 1GB SF (validation run).
SparkSQL missing at least one row (grep for AAAAAAAAABDAAAAA) ; I believe 2
other rows are missing as well.
Actual results:
[null,AAAAAAAAAABDAAAA,2565,1922]
[null,AAAAAAAAAAHDAAAA,2956,2052]
[null,AAAAAAAAAALAAAAA,2042,1793]
[null,AAAAAAAAACGCAAAA,2373,1771]
[null,AAAAAAAAACKCAAAA,2321,1856]
[null,AAAAAAAAACOBAAAA,1504,1397]
[null,AAAAAAAAADKBAAAA,1820,2163]
[null,AAAAAAAAAEADAAAA,2631,1965]
[null,AAAAAAAAAEOCAAAA,1659,1798]
[null,AAAAAAAAAFACAAAA,1965,1705]
[null,AAAAAAAAAFADAAAA,1769,1313]
[null,AAAAAAAAAHDEAAAA,2700,1985]
[null,AAAAAAAAAHHAAAAA,1578,1082]
[null,AAAAAAAAAIECAAAA,1756,1804]
[null,AAAAAAAAAIMCAAAA,3603,2951]
[null,AAAAAAAAAJACAAAA,2109,1989]
[null,AAAAAAAAAJKBAAAA,2573,3540]
[null,AAAAAAAAALBEAAAA,3458,2992]
[null,AAAAAAAAALCEAAAA,1720,1810]
[null,AAAAAAAAALECAAAA,2569,1946]
[null,AAAAAAAAALNBAAAA,2552,1750]
[null,AAAAAAAAANFEAAAA,2022,2269]
[null,AAAAAAAAAOIBAAAA,2982,2540]
[null,AAAAAAAAAPJBAAAA,2344,2593]
[null,AAAAAAAABAPDAAAA,2182,2787]
[null,AAAAAAAABDCEAAAA,2844,2069]
[null,AAAAAAAABDDDAAAA,2417,2537]
[null,AAAAAAAABDJAAAAA,1584,1666]
[null,AAAAAAAABEODAAAA,2141,2649]
[null,AAAAAAAABFCCAAAA,2745,2020]
[null,AAAAAAAABFMBAAAA,1642,1364]
[null,AAAAAAAABHPCAAAA,1923,1780]
[null,AAAAAAAABIDBAAAA,1956,2836]
[null,AAAAAAAABIGBAAAA,2023,2344]
[null,AAAAAAAABIJBAAAA,1977,2728]
[null,AAAAAAAABJFEAAAA,1891,2390]
[null,AAAAAAAABLDEAAAA,1983,1797]
[null,AAAAAAAABNIDAAAA,2485,2324]
[null,AAAAAAAABNLDAAAA,2385,2786]
[null,AAAAAAAABOMBAAAA,2291,2092]
[null,AAAAAAAACAAAAAAA,2233,2560]
[null,AAAAAAAACBCDAAAA,1540,2012]
[null,AAAAAAAACBIAAAAA,2394,2122]
[null,AAAAAAAACBPBAAAA,1790,1661]
[null,AAAAAAAACCMDAAAA,2654,2691]
[null,AAAAAAAACDBCAAAA,1804,2072]
[null,AAAAAAAACFEAAAAA,1941,1567]
[null,AAAAAAAACGFDAAAA,2123,2265]
[null,AAAAAAAACHPCAAAA,2933,2174]
[null,AAAAAAAACIGDAAAA,2618,2399]
[null,AAAAAAAACJCBAAAA,2728,2367]
[null,AAAAAAAACJLAAAAA,1350,1732]
[null,AAAAAAAACLAEAAAA,2578,2329]
[null,AAAAAAAACLGAAAAA,1842,1588]
[null,AAAAAAAACLLBAAAA,3418,2657]
[null,AAAAAAAACLOBAAAA,3115,2560]
[null,AAAAAAAACMADAAAA,1991,2243]
[null,AAAAAAAACMJAAAAA,1261,1855]
[null,AAAAAAAACMLAAAAA,3288,2753]
[null,AAAAAAAACMPDAAAA,1320,1676]
[null,AAAAAAAACNGBAAAA,2340,2118]
[null,AAAAAAAACNHDAAAA,3519,3348]
[null,AAAAAAAACNPCAAAA,2561,1948]
[null,AAAAAAAADCPCAAAA,2664,2627]
[null,AAAAAAAADDHAAAAA,1313,1926]
[null,AAAAAAAADDNDAAAA,1109,835]
[null,AAAAAAAADEAAAAAA,2141,1847]
[null,AAAAAAAADEJAAAAA,3142,2723]
[null,AAAAAAAADFKBAAAA,1470,1650]
[null,AAAAAAAADGCCAAAA,2113,2331]
[null,AAAAAAAADGFCAAAA,2201,2928]
[null,AAAAAAAADHPAAAAA,2467,2133]
[null,AAAAAAAADMBAAAAA,3085,2087]
[null,AAAAAAAADPABAAAA,3494,3081]
[null,AAAAAAAAEAECAAAA,2133,2148]
[null,AAAAAAAAEAPAAAAA,1560,1275]
[null,AAAAAAAAECGCAAAA,2815,3307]
[null,AAAAAAAAEDPDAAAA,2731,1883]
[null,AAAAAAAAEEECAAAA,2024,1902]
[null,AAAAAAAAEEMCAAAA,2624,2387]
[null,AAAAAAAAEFFAAAAA,2047,1878]
[null,AAAAAAAAEGJAAAAA,2403,2633]
[null,AAAAAAAAEGMAAAAA,2784,2772]
[null,AAAAAAAAEGOCAAAA,2389,1753]
[null,AAAAAAAAEHFDAAAA,1940,1420]
[null,AAAAAAAAEHLBAAAA,2320,2057]
[null,AAAAAAAAEHPAAAAA,1898,1853]
[null,AAAAAAAAEIPBAAAA,2930,2326]
[null,AAAAAAAAEJAEAAAA,2582,1836]
[null,AAAAAAAAEJIBAAAA,2257,1681]
[null,AAAAAAAAEJJAAAAA,2791,1941]
[null,AAAAAAAAEJJDAAAA,3410,2405]
[null,AAAAAAAAEJNCAAAA,2472,2067]
[null,AAAAAAAAEJPDAAAA,1219,1229]
[null,AAAAAAAAEKEBAAAA,2047,1713]
[null,AAAAAAAAEMEAAAAA,2502,1897]
[null,AAAAAAAAEMKCAAAA,2362,2042]
[null,AAAAAAAAENACAAAA,2011,1909]
[null,AAAAAAAAENFBAAAA,2507,2162]
[null,AAAAAAAAENODAAAA,3371,2709]
Expected results:
+----------------------+------------------+------------+-----------+
| W_WAREHOUSE_NAME | I_ITEM_ID | INV_BEFORE | INV_AFTER |
+----------------------+------------------+------------+-----------+
| Bad cards must make. | AAAAAAAAAACDAAAA | 1889 | 2168 |
| Bad cards must make. | AAAAAAAAAAHDAAAA | 2739 | 2039 |
| Bad cards must make. | AAAAAAAAABDAAAAA | 1717 | 1782 |
| Bad cards must make. | AAAAAAAAACGCAAAA | 2296 | 2276 |
| Bad cards must make. | AAAAAAAAACKCAAAA | 2443 | 1878 |
| Bad cards must make. | AAAAAAAAACOBAAAA | 2705 | 2428 |
| Bad cards must make. | AAAAAAAAADGBAAAA | 2242 | 2759 |
| Bad cards must make. | AAAAAAAAADKBAAAA | 2138 | 2456 |
| Bad cards must make. | AAAAAAAAAEADAAAA | 2914 | 2237 |
| Bad cards must make. | AAAAAAAAAEOCAAAA | 1797 | 2073 |
| Bad cards must make. | AAAAAAAAAFACAAAA | 2058 | 2734 |
| Bad cards must make. | AAAAAAAAAFADAAAA | 2173 | 2515 |
| Bad cards must make. | AAAAAAAAAFDCAAAA | 2309 | 2277 |
| Bad cards must make. | AAAAAAAAAGIDAAAA | 1864 | 2197 |
| Bad cards must make. | AAAAAAAAAHDEAAAA | 2483 | 2077 |
| Bad cards must make. | AAAAAAAAAHJBAAAA | 2904 | 3312 |
| Bad cards must make. | AAAAAAAAAIECAAAA | 2239 | 2526 |
| Bad cards must make. | AAAAAAAAAIMCAAAA | 1948 | 2693 |
| Bad cards must make. | AAAAAAAAAJKBAAAA | 2184 | 2190 |
| Bad cards must make. | AAAAAAAAALECAAAA | 2539 | 3052 |
| Bad cards must make. | AAAAAAAAALNBAAAA | 1406 | 1728 |
| Bad cards must make. | AAAAAAAAAMPBAAAA | 3450 | 3033 |
| Bad cards must make. | AAAAAAAAANFEAAAA | 2255 | 1517 |
| Bad cards must make. | AAAAAAAAAPLAAAAA | 1465 | 1227 |
| Bad cards must make. | AAAAAAAABBIDAAAA | 2822 | 2125 |
| Bad cards must make. | AAAAAAAABDCEAAAA | 2068 | 2187 |
| Bad cards must make. | AAAAAAAABEFDAAAA | 1023 | 1510 |
| Bad cards must make. | AAAAAAAABFNAAAAA | 1962 | 2719 |
| Bad cards must make. | AAAAAAAABFOCAAAA | 2392 | 2520 |
| Bad cards must make. | AAAAAAAABHPCAAAA | 2945 | 3058 |
| Bad cards must make. | AAAAAAAABIDBAAAA | 1746 | 1706 |
| Bad cards must make. | AAAAAAAABJFEAAAA | 2458 | 2647 |
| Bad cards must make. | AAAAAAAABKFAAAAA | 3152 | 2529 |
| Bad cards must make. | AAAAAAAABLDEAAAA | 2439 | 2899 |
| Bad cards must make. | AAAAAAAABNHBAAAA | 2254 | 2117 |
| Bad cards must make. | AAAAAAAABNLAAAAA | 2552 | 2608 |
| Bad cards must make. | AAAAAAAABNLDAAAA | 3103 | 2489 |
| Bad cards must make. | AAAAAAAABNMCAAAA | 1752 | 2078 |
| Bad cards must make. | AAAAAAAABOCCAAAA | 1697 | 1547 |
| Bad cards must make. | AAAAAAAACAAAAAAA | 2736 | 1937 |
| Bad cards must make. | AAAAAAAACAJCAAAA | 1921 | 1806 |
| Bad cards must make. | AAAAAAAACBFAAAAA | 1237 | 1460 |
| Bad cards must make. | AAAAAAAACBIAAAAA | 2157 | 1915 |
| Bad cards must make. | AAAAAAAACBPBAAAA | 3220 | 2970 |
| Bad cards must make. | AAAAAAAACCABAAAA | 1167 | 1704 |
| Bad cards must make. | AAAAAAAACCMDAAAA | 2057 | 2563 |
| Bad cards must make. | AAAAAAAACDBCAAAA | 2017 | 1494 |
| Bad cards must make. | AAAAAAAACGFDAAAA | 2811 | 3027 |
| Bad cards must make. | AAAAAAAACHHDAAAA | 2589 | 1935 |
| Bad cards must make. | AAAAAAAACJDCAAAA | 1299 | 1807 |
| Bad cards must make. | AAAAAAAACKHAAAAA | 1484 | 2158 |
| Bad cards must make. | AAAAAAAACLKAAAAA | 2743 | 2910 |
| Bad cards must make. | AAAAAAAACMJAAAAA | 1345 | 1776 |
| Bad cards must make. | AAAAAAAACMLAAAAA | 1869 | 2372 |
| Bad cards must make. | AAAAAAAACMPDAAAA | 1480 | 2177 |
| Bad cards must make. | AAAAAAAACNBBAAAA | 2914 | 2373 |
| Bad cards must make. | AAAAAAAACNEBAAAA | 2170 | 2456 |
| Bad cards must make. | AAAAAAAACNFAAAAA | 2854 | 2071 |
| Bad cards must make. | AAAAAAAACNGBAAAA | 1830 | 2659 |
| Bad cards must make. | AAAAAAAACNHDAAAA | 1507 | 1643 |
| Bad cards must make. | AAAAAAAACNPCAAAA | 2756 | 2402 |
| Bad cards must make. | AAAAAAAADCBEAAAA | 2403 | 2684 |
| Bad cards must make. | AAAAAAAADCPCAAAA | 2112 | 1881 |
| Bad cards must make. | AAAAAAAADDNDAAAA | 3404 | 2652 |
| Bad cards must make. | AAAAAAAADEJDAAAA | 1719 | 1822 |
| Bad cards must make. | AAAAAAAADFLAAAAA | 3242 | 2344 |
| Bad cards must make. | AAAAAAAADGCCAAAA | 2435 | 2159 |
| Bad cards must make. | AAAAAAAADGFCAAAA | 2350 | 1867 |
| Bad cards must make. | AAAAAAAADGGBAAAA | 2686 | 3567 |
| Bad cards must make. | AAAAAAAADGKAAAAA | 2927 | 2595 |
| Bad cards must make. | AAAAAAAADHPAAAAA | 2639 | 2216 |
| Bad cards must make. | AAAAAAAADKPDAAAA | 2476 | 3512 |
| Bad cards must make. | AAAAAAAADMBAAAAA | 2472 | 2301 |
| Bad cards must make. | AAAAAAAADNLBAAAA | 2792 | 2077 |
| Bad cards must make. | AAAAAAAADPABAAAA | 1719 | 1667 |
| Bad cards must make. | AAAAAAAAEAICAAAA | 1420 | 2094 |
| Bad cards must make. | AAAAAAAAEAPAAAAA | 1875 | 2244 |
| Bad cards must make. | AAAAAAAAEBCEAAAA | 2241 | 1924 |
| Bad cards must make. | AAAAAAAAEBPCAAAA | 2544 | 2281 |
| Bad cards must make. | AAAAAAAAECGCAAAA | 2039 | 1848 |
| Bad cards must make. | AAAAAAAAEDOCAAAA | 2401 | 1770 |
| Bad cards must make. | AAAAAAAAEDPDAAAA | 3041 | 2119 |
| Bad cards must make. | AAAAAAAAEGGBAAAA | 2717 | 2032 |
| Bad cards must make. | AAAAAAAAEGJAAAAA | 2996 | 2092 |
| Bad cards must make. | AAAAAAAAEGMAAAAA | 3051 | 2982 |
| Bad cards must make. | AAAAAAAAEGOCAAAA | 2086 | 1958 |
| Bad cards must make. | AAAAAAAAEHECAAAA | 1993 | 1498 |
| Bad cards must make. | AAAAAAAAEHFDAAAA | 2217 | 2151 |
| Bad cards must make. | AAAAAAAAEHLBAAAA | 1417 | 2034 |
| Bad cards must make. | AAAAAAAAEIDEAAAA | 1804 | 1474 |
| Bad cards must make. | AAAAAAAAEJAEAAAA | 2287 | 2006 |
| Bad cards must make. | AAAAAAAAEJJDAAAA | 2080 | 1660 |
| Bad cards must make. | AAAAAAAAEJPDAAAA | 1788 | 2188 |
| Bad cards must make. | AAAAAAAAEKCAAAAA | 2451 | 2182 |
| Bad cards must make. | AAAAAAAAENFBAAAA | 2123 | 2294 |
| Bad cards must make. | AAAAAAAAEONAAAAA | 2706 | 1887 |
| Bad cards must make. | AAAAAAAAEPHCAAAA | 1332 | 1209 |
| Bad cards must make. | AAAAAAAAEPKCAAAA | 2445 | 1824 |
| Bad cards must make. | AAAAAAAAFAKBAAAA | 843 | 1256 |
| Bad cards must make. | AAAAAAAAFALDAAAA | 2391 | 2019 |
+----------------------+------------------+------------+-----------+
was:
Majority of the TPCDS queries ran faster in 1.6.0 than in 1.4.1, average about
9% faster. There are a few degraded, and one that is definitely not within
error margin is query 66.
Query 66 in 1.4.1: 699 seconds
Query 66 in 1.6.0: 918 seconds
30% worse.
Collected the physical plans from both versions - drastic difference maybe
partially from using Tungsten in 1.6, but anything else at play here?
Please see plans here:
https://ibm.box.com/spark-sql-q66-debug-160plan
https://ibm.box.com/spark-sql-q66-debug-141plan
> TPCDS query 21 returns wrong results compared to TPC official result set
> -------------------------------------------------------------------------
>
> Key: SPARK-13858
> URL: https://issues.apache.org/jira/browse/SPARK-13858
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.6.0
> Reporter: JESSE CHEN
>
> Testing Spark SQL using TPC queries. Query 21 returns wrong results compared
> to official result set. This is at 1GB SF (validation run).
> SparkSQL missing at least one row (grep for AAAAAAAAABDAAAAA) ; I believe 2
> other rows are missing as well.
> Actual results:
> [null,AAAAAAAAAABDAAAA,2565,1922]
> [null,AAAAAAAAAAHDAAAA,2956,2052]
> [null,AAAAAAAAAALAAAAA,2042,1793]
> [null,AAAAAAAAACGCAAAA,2373,1771]
> [null,AAAAAAAAACKCAAAA,2321,1856]
> [null,AAAAAAAAACOBAAAA,1504,1397]
> [null,AAAAAAAAADKBAAAA,1820,2163]
> [null,AAAAAAAAAEADAAAA,2631,1965]
> [null,AAAAAAAAAEOCAAAA,1659,1798]
> [null,AAAAAAAAAFACAAAA,1965,1705]
> [null,AAAAAAAAAFADAAAA,1769,1313]
> [null,AAAAAAAAAHDEAAAA,2700,1985]
> [null,AAAAAAAAAHHAAAAA,1578,1082]
> [null,AAAAAAAAAIECAAAA,1756,1804]
> [null,AAAAAAAAAIMCAAAA,3603,2951]
> [null,AAAAAAAAAJACAAAA,2109,1989]
> [null,AAAAAAAAAJKBAAAA,2573,3540]
> [null,AAAAAAAAALBEAAAA,3458,2992]
> [null,AAAAAAAAALCEAAAA,1720,1810]
> [null,AAAAAAAAALECAAAA,2569,1946]
> [null,AAAAAAAAALNBAAAA,2552,1750]
> [null,AAAAAAAAANFEAAAA,2022,2269]
> [null,AAAAAAAAAOIBAAAA,2982,2540]
> [null,AAAAAAAAAPJBAAAA,2344,2593]
> [null,AAAAAAAABAPDAAAA,2182,2787]
> [null,AAAAAAAABDCEAAAA,2844,2069]
> [null,AAAAAAAABDDDAAAA,2417,2537]
> [null,AAAAAAAABDJAAAAA,1584,1666]
> [null,AAAAAAAABEODAAAA,2141,2649]
> [null,AAAAAAAABFCCAAAA,2745,2020]
> [null,AAAAAAAABFMBAAAA,1642,1364]
> [null,AAAAAAAABHPCAAAA,1923,1780]
> [null,AAAAAAAABIDBAAAA,1956,2836]
> [null,AAAAAAAABIGBAAAA,2023,2344]
> [null,AAAAAAAABIJBAAAA,1977,2728]
> [null,AAAAAAAABJFEAAAA,1891,2390]
> [null,AAAAAAAABLDEAAAA,1983,1797]
> [null,AAAAAAAABNIDAAAA,2485,2324]
> [null,AAAAAAAABNLDAAAA,2385,2786]
> [null,AAAAAAAABOMBAAAA,2291,2092]
> [null,AAAAAAAACAAAAAAA,2233,2560]
> [null,AAAAAAAACBCDAAAA,1540,2012]
> [null,AAAAAAAACBIAAAAA,2394,2122]
> [null,AAAAAAAACBPBAAAA,1790,1661]
> [null,AAAAAAAACCMDAAAA,2654,2691]
> [null,AAAAAAAACDBCAAAA,1804,2072]
> [null,AAAAAAAACFEAAAAA,1941,1567]
> [null,AAAAAAAACGFDAAAA,2123,2265]
> [null,AAAAAAAACHPCAAAA,2933,2174]
> [null,AAAAAAAACIGDAAAA,2618,2399]
> [null,AAAAAAAACJCBAAAA,2728,2367]
> [null,AAAAAAAACJLAAAAA,1350,1732]
> [null,AAAAAAAACLAEAAAA,2578,2329]
> [null,AAAAAAAACLGAAAAA,1842,1588]
> [null,AAAAAAAACLLBAAAA,3418,2657]
> [null,AAAAAAAACLOBAAAA,3115,2560]
> [null,AAAAAAAACMADAAAA,1991,2243]
> [null,AAAAAAAACMJAAAAA,1261,1855]
> [null,AAAAAAAACMLAAAAA,3288,2753]
> [null,AAAAAAAACMPDAAAA,1320,1676]
> [null,AAAAAAAACNGBAAAA,2340,2118]
> [null,AAAAAAAACNHDAAAA,3519,3348]
> [null,AAAAAAAACNPCAAAA,2561,1948]
> [null,AAAAAAAADCPCAAAA,2664,2627]
> [null,AAAAAAAADDHAAAAA,1313,1926]
> [null,AAAAAAAADDNDAAAA,1109,835]
> [null,AAAAAAAADEAAAAAA,2141,1847]
> [null,AAAAAAAADEJAAAAA,3142,2723]
> [null,AAAAAAAADFKBAAAA,1470,1650]
> [null,AAAAAAAADGCCAAAA,2113,2331]
> [null,AAAAAAAADGFCAAAA,2201,2928]
> [null,AAAAAAAADHPAAAAA,2467,2133]
> [null,AAAAAAAADMBAAAAA,3085,2087]
> [null,AAAAAAAADPABAAAA,3494,3081]
> [null,AAAAAAAAEAECAAAA,2133,2148]
> [null,AAAAAAAAEAPAAAAA,1560,1275]
> [null,AAAAAAAAECGCAAAA,2815,3307]
> [null,AAAAAAAAEDPDAAAA,2731,1883]
> [null,AAAAAAAAEEECAAAA,2024,1902]
> [null,AAAAAAAAEEMCAAAA,2624,2387]
> [null,AAAAAAAAEFFAAAAA,2047,1878]
> [null,AAAAAAAAEGJAAAAA,2403,2633]
> [null,AAAAAAAAEGMAAAAA,2784,2772]
> [null,AAAAAAAAEGOCAAAA,2389,1753]
> [null,AAAAAAAAEHFDAAAA,1940,1420]
> [null,AAAAAAAAEHLBAAAA,2320,2057]
> [null,AAAAAAAAEHPAAAAA,1898,1853]
> [null,AAAAAAAAEIPBAAAA,2930,2326]
> [null,AAAAAAAAEJAEAAAA,2582,1836]
> [null,AAAAAAAAEJIBAAAA,2257,1681]
> [null,AAAAAAAAEJJAAAAA,2791,1941]
> [null,AAAAAAAAEJJDAAAA,3410,2405]
> [null,AAAAAAAAEJNCAAAA,2472,2067]
> [null,AAAAAAAAEJPDAAAA,1219,1229]
> [null,AAAAAAAAEKEBAAAA,2047,1713]
> [null,AAAAAAAAEMEAAAAA,2502,1897]
> [null,AAAAAAAAEMKCAAAA,2362,2042]
> [null,AAAAAAAAENACAAAA,2011,1909]
> [null,AAAAAAAAENFBAAAA,2507,2162]
> [null,AAAAAAAAENODAAAA,3371,2709]
> Expected results:
> +----------------------+------------------+------------+-----------+
> | W_WAREHOUSE_NAME | I_ITEM_ID | INV_BEFORE | INV_AFTER |
> +----------------------+------------------+------------+-----------+
> | Bad cards must make. | AAAAAAAAAACDAAAA | 1889 | 2168 |
> | Bad cards must make. | AAAAAAAAAAHDAAAA | 2739 | 2039 |
> | Bad cards must make. | AAAAAAAAABDAAAAA | 1717 | 1782 |
> | Bad cards must make. | AAAAAAAAACGCAAAA | 2296 | 2276 |
> | Bad cards must make. | AAAAAAAAACKCAAAA | 2443 | 1878 |
> | Bad cards must make. | AAAAAAAAACOBAAAA | 2705 | 2428 |
> | Bad cards must make. | AAAAAAAAADGBAAAA | 2242 | 2759 |
> | Bad cards must make. | AAAAAAAAADKBAAAA | 2138 | 2456 |
> | Bad cards must make. | AAAAAAAAAEADAAAA | 2914 | 2237 |
> | Bad cards must make. | AAAAAAAAAEOCAAAA | 1797 | 2073 |
> | Bad cards must make. | AAAAAAAAAFACAAAA | 2058 | 2734 |
> | Bad cards must make. | AAAAAAAAAFADAAAA | 2173 | 2515 |
> | Bad cards must make. | AAAAAAAAAFDCAAAA | 2309 | 2277 |
> | Bad cards must make. | AAAAAAAAAGIDAAAA | 1864 | 2197 |
> | Bad cards must make. | AAAAAAAAAHDEAAAA | 2483 | 2077 |
> | Bad cards must make. | AAAAAAAAAHJBAAAA | 2904 | 3312 |
> | Bad cards must make. | AAAAAAAAAIECAAAA | 2239 | 2526 |
> | Bad cards must make. | AAAAAAAAAIMCAAAA | 1948 | 2693 |
> | Bad cards must make. | AAAAAAAAAJKBAAAA | 2184 | 2190 |
> | Bad cards must make. | AAAAAAAAALECAAAA | 2539 | 3052 |
> | Bad cards must make. | AAAAAAAAALNBAAAA | 1406 | 1728 |
> | Bad cards must make. | AAAAAAAAAMPBAAAA | 3450 | 3033 |
> | Bad cards must make. | AAAAAAAAANFEAAAA | 2255 | 1517 |
> | Bad cards must make. | AAAAAAAAAPLAAAAA | 1465 | 1227 |
> | Bad cards must make. | AAAAAAAABBIDAAAA | 2822 | 2125 |
> | Bad cards must make. | AAAAAAAABDCEAAAA | 2068 | 2187 |
> | Bad cards must make. | AAAAAAAABEFDAAAA | 1023 | 1510 |
> | Bad cards must make. | AAAAAAAABFNAAAAA | 1962 | 2719 |
> | Bad cards must make. | AAAAAAAABFOCAAAA | 2392 | 2520 |
> | Bad cards must make. | AAAAAAAABHPCAAAA | 2945 | 3058 |
> | Bad cards must make. | AAAAAAAABIDBAAAA | 1746 | 1706 |
> | Bad cards must make. | AAAAAAAABJFEAAAA | 2458 | 2647 |
> | Bad cards must make. | AAAAAAAABKFAAAAA | 3152 | 2529 |
> | Bad cards must make. | AAAAAAAABLDEAAAA | 2439 | 2899 |
> | Bad cards must make. | AAAAAAAABNHBAAAA | 2254 | 2117 |
> | Bad cards must make. | AAAAAAAABNLAAAAA | 2552 | 2608 |
> | Bad cards must make. | AAAAAAAABNLDAAAA | 3103 | 2489 |
> | Bad cards must make. | AAAAAAAABNMCAAAA | 1752 | 2078 |
> | Bad cards must make. | AAAAAAAABOCCAAAA | 1697 | 1547 |
> | Bad cards must make. | AAAAAAAACAAAAAAA | 2736 | 1937 |
> | Bad cards must make. | AAAAAAAACAJCAAAA | 1921 | 1806 |
> | Bad cards must make. | AAAAAAAACBFAAAAA | 1237 | 1460 |
> | Bad cards must make. | AAAAAAAACBIAAAAA | 2157 | 1915 |
> | Bad cards must make. | AAAAAAAACBPBAAAA | 3220 | 2970 |
> | Bad cards must make. | AAAAAAAACCABAAAA | 1167 | 1704 |
> | Bad cards must make. | AAAAAAAACCMDAAAA | 2057 | 2563 |
> | Bad cards must make. | AAAAAAAACDBCAAAA | 2017 | 1494 |
> | Bad cards must make. | AAAAAAAACGFDAAAA | 2811 | 3027 |
> | Bad cards must make. | AAAAAAAACHHDAAAA | 2589 | 1935 |
> | Bad cards must make. | AAAAAAAACJDCAAAA | 1299 | 1807 |
> | Bad cards must make. | AAAAAAAACKHAAAAA | 1484 | 2158 |
> | Bad cards must make. | AAAAAAAACLKAAAAA | 2743 | 2910 |
> | Bad cards must make. | AAAAAAAACMJAAAAA | 1345 | 1776 |
> | Bad cards must make. | AAAAAAAACMLAAAAA | 1869 | 2372 |
> | Bad cards must make. | AAAAAAAACMPDAAAA | 1480 | 2177 |
> | Bad cards must make. | AAAAAAAACNBBAAAA | 2914 | 2373 |
> | Bad cards must make. | AAAAAAAACNEBAAAA | 2170 | 2456 |
> | Bad cards must make. | AAAAAAAACNFAAAAA | 2854 | 2071 |
> | Bad cards must make. | AAAAAAAACNGBAAAA | 1830 | 2659 |
> | Bad cards must make. | AAAAAAAACNHDAAAA | 1507 | 1643 |
> | Bad cards must make. | AAAAAAAACNPCAAAA | 2756 | 2402 |
> | Bad cards must make. | AAAAAAAADCBEAAAA | 2403 | 2684 |
> | Bad cards must make. | AAAAAAAADCPCAAAA | 2112 | 1881 |
> | Bad cards must make. | AAAAAAAADDNDAAAA | 3404 | 2652 |
> | Bad cards must make. | AAAAAAAADEJDAAAA | 1719 | 1822 |
> | Bad cards must make. | AAAAAAAADFLAAAAA | 3242 | 2344 |
> | Bad cards must make. | AAAAAAAADGCCAAAA | 2435 | 2159 |
> | Bad cards must make. | AAAAAAAADGFCAAAA | 2350 | 1867 |
> | Bad cards must make. | AAAAAAAADGGBAAAA | 2686 | 3567 |
> | Bad cards must make. | AAAAAAAADGKAAAAA | 2927 | 2595 |
> | Bad cards must make. | AAAAAAAADHPAAAAA | 2639 | 2216 |
> | Bad cards must make. | AAAAAAAADKPDAAAA | 2476 | 3512 |
> | Bad cards must make. | AAAAAAAADMBAAAAA | 2472 | 2301 |
> | Bad cards must make. | AAAAAAAADNLBAAAA | 2792 | 2077 |
> | Bad cards must make. | AAAAAAAADPABAAAA | 1719 | 1667 |
> | Bad cards must make. | AAAAAAAAEAICAAAA | 1420 | 2094 |
> | Bad cards must make. | AAAAAAAAEAPAAAAA | 1875 | 2244 |
> | Bad cards must make. | AAAAAAAAEBCEAAAA | 2241 | 1924 |
> | Bad cards must make. | AAAAAAAAEBPCAAAA | 2544 | 2281 |
> | Bad cards must make. | AAAAAAAAECGCAAAA | 2039 | 1848 |
> | Bad cards must make. | AAAAAAAAEDOCAAAA | 2401 | 1770 |
> | Bad cards must make. | AAAAAAAAEDPDAAAA | 3041 | 2119 |
> | Bad cards must make. | AAAAAAAAEGGBAAAA | 2717 | 2032 |
> | Bad cards must make. | AAAAAAAAEGJAAAAA | 2996 | 2092 |
> | Bad cards must make. | AAAAAAAAEGMAAAAA | 3051 | 2982 |
> | Bad cards must make. | AAAAAAAAEGOCAAAA | 2086 | 1958 |
> | Bad cards must make. | AAAAAAAAEHECAAAA | 1993 | 1498 |
> | Bad cards must make. | AAAAAAAAEHFDAAAA | 2217 | 2151 |
> | Bad cards must make. | AAAAAAAAEHLBAAAA | 1417 | 2034 |
> | Bad cards must make. | AAAAAAAAEIDEAAAA | 1804 | 1474 |
> | Bad cards must make. | AAAAAAAAEJAEAAAA | 2287 | 2006 |
> | Bad cards must make. | AAAAAAAAEJJDAAAA | 2080 | 1660 |
> | Bad cards must make. | AAAAAAAAEJPDAAAA | 1788 | 2188 |
> | Bad cards must make. | AAAAAAAAEKCAAAAA | 2451 | 2182 |
> | Bad cards must make. | AAAAAAAAENFBAAAA | 2123 | 2294 |
> | Bad cards must make. | AAAAAAAAEONAAAAA | 2706 | 1887 |
> | Bad cards must make. | AAAAAAAAEPHCAAAA | 1332 | 1209 |
> | Bad cards must make. | AAAAAAAAEPKCAAAA | 2445 | 1824 |
> | Bad cards must make. | AAAAAAAAFAKBAAAA | 843 | 1256 |
> | Bad cards must make. | AAAAAAAAFALDAAAA | 2391 | 2019 |
> +----------------------+------------------+------------+-----------+
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
