Hello David,

Thank you for your reply.

> Can you share if these times were to run EXPLAIN ANALYZE or if they
> were just the queries being executed normally?

These times were to run EXPLAIN ANALYZE. I executed each query twice,
and the **average** execution time was shown in the table of the last
e-mail. Therefore, the result of the table is not simply equal to that
of the attached file. I'm sorry for the insufficient explanation.

> It would be really great if you could show the EXPLAIN (ANALYZE,
> TIMING OFF) for query 62.   There's a chance that the slowdown comes
> from the additional EXPLAIN ANALYZE timing overhead with the Result
> Cache version.

I ran query 62 by "EXPLAIN (ANALYZE, TIMING OFF)" and normally. I
attached these execution results to this e-mail. At this time, I
executed each query only once (not twice). The results are as follows.

Method |  Execution time with result cache (s) |  Execution time
without result cache (s) | Speedup ratio
EXPLAIN (ANALYZE, TIMING ON)      67.161     59.615    -12.66%
EXPLAIN (ANALYZE, TIMING OFF)     66.142     60.660     -9.04%
Normal                            66.611     60.955     -9.28%

Although there is variation in the execution time, the speedup ratio
is around -10%. So, the result cache has a 10% regression in query 62.
The overhead of EXPLAIN ANALYZE and TIMING ON do not seem to be high.

Best regards,
Yuya Watari

On Tue, Apr 13, 2021 at 7:13 PM David Rowley <dgrowle...@gmail.com> wrote:
>
> On Tue, 13 Apr 2021 at 21:29, Yuya Watari <watari.y...@gmail.com> wrote:
> > I used the TPC-DS scale factor 100 in the evaluation. I executed all
> > of the 99 queries in the TPC-DS, and the result cache worked in the 21
> > queries of them. However, some queries took too much time, so I
> > skipped their execution. I set work_mem to 256MB, and
> > max_parallel_workers_per_gather to 0.
>
> Many thanks for testing this.
>
> > As you can see from these results, many queries have a negative
> > speedup ratio, which means that there are negative impacts on the
> > query performance. In query 62, the execution time increased by
> > 11.36%. I guess these regressions are due to the misestimation of the
> > cost in the planner. I attached the execution plan of query 62.
>
> Can you share if these times were to run EXPLAIN ANALYZE or if they
> were just the queries being executed normally?
>
> The times in the two files you attached do look very similar to the
> times in your table, so I suspect either TIMING ON is not that high an
> overhead on your machine, or the results are that of EXPLAIN ANALYZE.
>
> It would be really great if you could show the EXPLAIN (ANALYZE,
> TIMING OFF) for query 62.   There's a chance that the slowdown comes
> from the additional EXPLAIN ANALYZE timing overhead with the Result
> Cache version.
>
> > The result cache is currently enabled by default. However, if this
> > kind of performance regression is common, we have to change its
> > default behavior.
>
> Yes, the feedback we get during the beta period will help drive that
> decision or if the costing needs to be adjusted.
>
> David
SET
                                                                   QUERY PLAN   
                                                                
------------------------------------------------------------------------------------------------------------------------------------------------
 Limit  (cost=2816266.54..2816267.79 rows=100 width=110) (actual rows=100 
loops=1)
   ->  Sort  (cost=2816266.54..2816267.38 rows=336 width=110) (actual rows=100 
loops=1)
         Sort Key: (substr((warehouse.w_warehouse_name)::text, 1, 20)), 
ship_mode.sm_type, web_site.web_name
         Sort Method: top-N heapsort  Memory: 49kB
         ->  HashAggregate  (cost=2816248.24..2816252.44 rows=336 width=110) 
(actual rows=360 loops=1)
               Group Key: substr((warehouse.w_warehouse_name)::text, 1, 20), 
ship_mode.sm_type, web_site.web_name
               Batches: 1  Memory Usage: 157kB
               ->  Hash Join  (cost=2510.74..2794150.54 rows=368295 width=78) 
(actual rows=14336926 loops=1)
                     Hash Cond: (web_sales.ws_ship_mode_sk = 
ship_mode.sm_ship_mode_sk)
                     ->  Hash Join  (cost=2509.29..2792056.55 rows=368356 
width=36) (actual rows=14337390 loops=1)
                           Hash Cond: (web_sales.ws_web_site_sk = 
web_site.web_site_sk)
                           ->  Hash Join  (cost=2506.75..2790916.14 rows=368430 
width=33) (actual rows=14338265 loops=1)
                                 Hash Cond: (web_sales.ws_warehouse_sk = 
warehouse.w_warehouse_sk)
                                 ->  Hash Join  (cost=2505.41..2789674.19 
rows=368516 width=20) (actual rows=14340028 loops=1)
                                       Hash Cond: (web_sales.ws_ship_date_sk = 
date_dim.d_date_sk)
                                       ->  Seq Scan on web_sales  
(cost=0.00..2598153.08 rows=72001808 width=20) (actual rows=72001237 loops=1)
                                       ->  Hash  (cost=2500.73..2500.73 
rows=374 width=4) (actual rows=365 loops=1)
                                             Buckets: 1024  Batches: 1  Memory 
Usage: 21kB
                                             ->  Seq Scan on date_dim  
(cost=0.00..2500.73 rows=374 width=4) (actual rows=365 loops=1)
                                                   Filter: ((d_month_seq >= 
1212) AND (d_month_seq <= 1223))
                                                   Rows Removed by Filter: 72684
                                 ->  Hash  (cost=1.15..1.15 rows=15 width=21) 
(actual rows=15 loops=1)
                                       Buckets: 1024  Batches: 1  Memory Usage: 
9kB
                                       ->  Seq Scan on warehouse  
(cost=0.00..1.15 rows=15 width=21) (actual rows=15 loops=1)
                           ->  Hash  (cost=2.24..2.24 rows=24 width=11) (actual 
rows=24 loops=1)
                                 Buckets: 1024  Batches: 1  Memory Usage: 10kB
                                 ->  Seq Scan on web_site  (cost=0.00..2.24 
rows=24 width=11) (actual rows=24 loops=1)
                     ->  Hash  (cost=1.20..1.20 rows=20 width=35) (actual 
rows=20 loops=1)
                           Buckets: 1024  Batches: 1  Memory Usage: 10kB
                           ->  Seq Scan on ship_mode  (cost=0.00..1.20 rows=20 
width=35) (actual rows=20 loops=1)
 Planning Time: 7.620 ms
 Execution Time: 60660.509 ms
(32 rows)

SET
                                                                     QUERY PLAN 
                                                                    
----------------------------------------------------------------------------------------------------------------------------------------------------
 Limit  (cost=2839568.89..2839570.14 rows=100 width=110) (actual rows=100 
loops=1)
   ->  Sort  (cost=2839568.89..2839569.73 rows=336 width=110) (actual rows=100 
loops=1)
         Sort Key: (substr((web_sales.ws_ship_date_sk)::text, 1, 20)), 
warehouse.w_warehouse_name, ship_mode.sm_carrier
         Sort Method: top-N heapsort  Memory: 49kB
         ->  HashAggregate  (cost=2839550.59..2839554.79 rows=336 width=110) 
(actual rows=360 loops=1)
               Group Key: substr((web_sales.ws_ship_date_sk)::text, 1, 20), 
warehouse.w_warehouse_name, ship_mode.sm_carrier
               Batches: 1  Memory Usage: 157kB
               ->  Nested Loop  (cost=2505.85..2817452.89 rows=368295 width=78) 
(actual rows=14336926 loops=1)
                     ->  Nested Loop  (cost=2505.70..2807569.94 rows=368356 
width=36) (actual rows=14337390 loops=1)
                           ->  Nested Loop  (cost=2505.55..2798567.14 
rows=368430 width=33) (actual rows=14338265 loops=1)
                                 ->  Hash Join  (cost=2505.41..2789674.19 
rows=368516 width=20) (actual rows=14340028 loops=1)
                                       Hash Cond: (web_sales.ws_ship_date_sk = 
date_dim.d_date_sk)
                                       ->  Seq Scan on web_sales  
(cost=0.00..2598153.08 rows=72001808 width=20) (actual rows=72001237 loops=1)
                                       ->  Hash  (cost=2500.73..2500.73 
rows=374 width=4) (actual rows=365 loops=1)
                                             Buckets: 1024  Batches: 1  Memory 
Usage: 21kB
                                             ->  Seq Scan on date_dim  
(cost=0.00..2500.73 rows=374 width=4) (actual rows=365 loops=1)
                                                   Filter: ((d_month_seq >= 
1212) AND (d_month_seq <= 1223))
                                                   Rows Removed by Filter: 72684
                                 ->  Result Cache  (cost=0.15..0.16 rows=1 
width=21) (actual rows=1 loops=14340028)
                                       Cache Key: web_sales.ws_warehouse_sk
                                       Hits: 14340012  Misses: 16  Evictions: 0 
 Overflows: 0  Memory Usage: 2kB
                                       ->  Index Scan using warehouse_pkey on 
warehouse  (cost=0.14..0.15 rows=1 width=21) (actual rows=1 loops=16)
                                             Index Cond: (w_warehouse_sk = 
web_sales.ws_warehouse_sk)
                           ->  Result Cache  (cost=0.15..0.17 rows=1 width=11) 
(actual rows=1 loops=14338265)
                                 Cache Key: web_sales.ws_web_site_sk
                                 Hits: 14338248  Misses: 17  Evictions: 0  
Overflows: 0  Memory Usage: 2kB
                                 ->  Index Scan using web_site_pkey on web_site 
 (cost=0.14..0.16 rows=1 width=11) (actual rows=1 loops=17)
                                       Index Cond: (web_site_sk = 
web_sales.ws_web_site_sk)
                     ->  Result Cache  (cost=0.15..0.17 rows=1 width=35) 
(actual rows=1 loops=14337390)
                           Cache Key: web_sales.ws_ship_mode_sk
                           Hits: 14337369  Misses: 21  Evictions: 0  Overflows: 
0  Memory Usage: 3kB
                           ->  Index Scan using ship_mode_pkey on ship_mode  
(cost=0.14..0.16 rows=1 width=35) (actual rows=1 loops=21)
                                 Index Cond: (sm_ship_mode_sk = 
web_sales.ws_ship_mode_sk)
 Planning Time: 10.396 ms
 Execution Time: 66142.932 ms
(35 rows)

SET
Timing is on.
        substr        |            sm_type             | web_name | 30 days | 
31-60 days | 61-90 days | 91-120 days | >120 days 
----------------------+--------------------------------+----------+---------+------------+------------+-------------+-----------
 Bad cards must make. | EXPRESS                        | site_0   |   11835 |   
   11998 |      11919 |       11881 |         0
 Bad cards must make. | EXPRESS                        | site_1   |   12030 |   
   12272 |      11959 |       11921 |         0
 Bad cards must make. | EXPRESS                        | site_2   |   11991 |   
   11946 |      11745 |       11948 |         0
 Bad cards must make. | EXPRESS                        | site_3   |   12050 |   
   11889 |      11857 |       12016 |         0
 Bad cards must make. | LIBRARY                        | site_0   |    9057 |   
    8923 |       8827 |        8810 |         0
 Bad cards must make. | LIBRARY                        | site_1   |    9107 |   
    8838 |       8925 |        8954 |         0
 Bad cards must make. | LIBRARY                        | site_2   |    8915 |   
    8995 |       9007 |        8931 |         0
 Bad cards must make. | LIBRARY                        | site_3   |    9165 |   
    8965 |       8936 |        8743 |         0
 Bad cards must make. | NEXT DAY                       | site_0   |   11891 |   
   11959 |      11895 |       12070 |         0
 Bad cards must make. | NEXT DAY                       | site_1   |   11843 |   
   12088 |      12045 |       12027 |         0
 Bad cards must make. | NEXT DAY                       | site_2   |   11894 |   
   12038 |      11736 |       12108 |         0
 Bad cards must make. | NEXT DAY                       | site_3   |   11852 |   
   11823 |      11836 |       12071 |         0
 Bad cards must make. | OVERNIGHT                      | site_0   |    8859 |   
    8850 |       9016 |        8944 |         0
 Bad cards must make. | OVERNIGHT                      | site_1   |    9113 |   
    8709 |       8939 |        8985 |         0
 Bad cards must make. | OVERNIGHT                      | site_2   |    9067 |   
    8917 |       9297 |        8831 |         0
 Bad cards must make. | OVERNIGHT                      | site_3   |    8881 |   
    8898 |       8980 |        8790 |         0
 Bad cards must make. | REGULAR                        | site_0   |    9048 |   
    9043 |       9044 |        8833 |         0
 Bad cards must make. | REGULAR                        | site_1   |    9064 |   
    8795 |       9005 |        8974 |         0
 Bad cards must make. | REGULAR                        | site_2   |    9198 |   
    8883 |       8981 |        8858 |         0
 Bad cards must make. | REGULAR                        | site_3   |    8915 |   
    8971 |       9069 |        9001 |         0
 Bad cards must make. | TWO DAY                        | site_0   |    8904 |   
    9035 |       9042 |        9109 |         0
 Bad cards must make. | TWO DAY                        | site_1   |    9246 |   
    8889 |       8848 |        8948 |         0
 Bad cards must make. | TWO DAY                        | site_2   |    9229 |   
    8899 |       8918 |        8810 |         0
 Bad cards must make. | TWO DAY                        | site_3   |    8968 |   
    8984 |       9109 |        8848 |         0
 Conventional childr  | EXPRESS                        | site_0   |   12172 |   
   11914 |      11988 |       12019 |         0
 Conventional childr  | EXPRESS                        | site_1   |   12053 |   
   11806 |      11966 |       11878 |         0
 Conventional childr  | EXPRESS                        | site_2   |   12026 |   
   12137 |      11956 |       12029 |         0
 Conventional childr  | EXPRESS                        | site_3   |   12175 |   
   11877 |      11981 |       11852 |         0
 Conventional childr  | LIBRARY                        | site_0   |    8951 |   
    9128 |       8945 |        8916 |         0
 Conventional childr  | LIBRARY                        | site_1   |    8814 |   
    8998 |       9104 |        8981 |         0
 Conventional childr  | LIBRARY                        | site_2   |    9057 |   
    8996 |       9016 |        8944 |         0
 Conventional childr  | LIBRARY                        | site_3   |    8981 |   
    9035 |       8983 |        9045 |         0
 Conventional childr  | NEXT DAY                       | site_0   |   11990 |   
   11939 |      12016 |       11905 |         0
 Conventional childr  | NEXT DAY                       | site_1   |   11934 |   
   12050 |      11962 |       12076 |         0
 Conventional childr  | NEXT DAY                       | site_2   |   11946 |   
   11827 |      12035 |       11856 |         0
 Conventional childr  | NEXT DAY                       | site_3   |   12050 |   
   11954 |      11991 |       11783 |         0
 Conventional childr  | OVERNIGHT                      | site_0   |    9005 |   
    8850 |       8982 |        9050 |         0
 Conventional childr  | OVERNIGHT                      | site_1   |    9086 |   
    9031 |       8887 |        9126 |         0
 Conventional childr  | OVERNIGHT                      | site_2   |    8861 |   
    8833 |       8961 |        9101 |         0
 Conventional childr  | OVERNIGHT                      | site_3   |    9046 |   
    9096 |       8983 |        8954 |         0
 Conventional childr  | REGULAR                        | site_0   |    8874 |   
    8975 |       8961 |        8965 |         0
 Conventional childr  | REGULAR                        | site_1   |    8722 |   
    8931 |       8904 |        8831 |         0
 Conventional childr  | REGULAR                        | site_2   |    8954 |   
    8843 |       8925 |        8840 |         0
 Conventional childr  | REGULAR                        | site_3   |    9103 |   
    8975 |       8947 |        8863 |         0
 Conventional childr  | TWO DAY                        | site_0   |    8816 |   
    8946 |       8994 |        9031 |         0
 Conventional childr  | TWO DAY                        | site_1   |    8741 |   
    8945 |       8859 |        8856 |         0
 Conventional childr  | TWO DAY                        | site_2   |    8803 |   
    9012 |       8985 |        8968 |         0
 Conventional childr  | TWO DAY                        | site_3   |    8773 |   
    9039 |       9035 |        8951 |         0
 Doors canno          | EXPRESS                        | site_0   |   11776 |   
   12009 |      11911 |       11775 |         0
 Doors canno          | EXPRESS                        | site_1   |   11979 |   
   12147 |      12002 |       12194 |         0
 Doors canno          | EXPRESS                        | site_2   |   11830 |   
   11918 |      11960 |       12054 |         0
 Doors canno          | EXPRESS                        | site_3   |   12112 |   
   11805 |      11931 |       12006 |         0
 Doors canno          | LIBRARY                        | site_0   |    8930 |   
    9049 |       9018 |        8752 |         0
 Doors canno          | LIBRARY                        | site_1   |    8945 |   
    9109 |       8937 |        8979 |         0
 Doors canno          | LIBRARY                        | site_2   |    8914 |   
    8827 |       9129 |        9040 |         0
 Doors canno          | LIBRARY                        | site_3   |    9028 |   
    9054 |       9063 |        8985 |         0
 Doors canno          | NEXT DAY                       | site_0   |   11990 |   
   11958 |      12047 |       11761 |         0
 Doors canno          | NEXT DAY                       | site_1   |   12107 |   
   11975 |      11936 |       11914 |         0
 Doors canno          | NEXT DAY                       | site_2   |   12013 |   
   11843 |      11916 |       12030 |         0
 Doors canno          | NEXT DAY                       | site_3   |   12067 |   
   12083 |      12015 |       11778 |         0
 Doors canno          | OVERNIGHT                      | site_0   |    8882 |   
    8911 |       8922 |        8882 |         0
 Doors canno          | OVERNIGHT                      | site_1   |    9017 |   
    8882 |       8972 |        8995 |         0
 Doors canno          | OVERNIGHT                      | site_2   |    9040 |   
    8884 |       8896 |        8976 |         0
 Doors canno          | OVERNIGHT                      | site_3   |    9076 |   
    8978 |       8958 |        8798 |         0
 Doors canno          | REGULAR                        | site_0   |    8904 |   
    8907 |       9045 |        9069 |         0
 Doors canno          | REGULAR                        | site_1   |    8972 |   
    8961 |       8908 |        8897 |         0
 Doors canno          | REGULAR                        | site_2   |    8986 |   
    8981 |       8936 |        8863 |         0
 Doors canno          | REGULAR                        | site_3   |    8834 |   
    8976 |       8808 |        9014 |         0
 Doors canno          | TWO DAY                        | site_0   |    8811 |   
    8965 |       8998 |        8996 |         0
 Doors canno          | TWO DAY                        | site_1   |    8915 |   
    9008 |       8928 |        8944 |         0
 Doors canno          | TWO DAY                        | site_2   |    9063 |   
    8867 |       8886 |        8977 |         0
 Doors canno          | TWO DAY                        | site_3   |    9083 |   
    9020 |       8983 |        9099 |         0
 Friendly, suitable   | EXPRESS                        | site_0   |   12162 |   
   12022 |      12015 |       11960 |         0
 Friendly, suitable   | EXPRESS                        | site_1   |   11836 |   
   11847 |      11897 |       12034 |         0
 Friendly, suitable   | EXPRESS                        | site_2   |   12052 |   
   11952 |      12122 |       11924 |         0
 Friendly, suitable   | EXPRESS                        | site_3   |   11936 |   
   11739 |      11918 |       11648 |         0
 Friendly, suitable   | LIBRARY                        | site_0   |    9049 |   
    9031 |       8996 |        8939 |         0
 Friendly, suitable   | LIBRARY                        | site_1   |    8984 |   
    9018 |       8947 |        8836 |         0
 Friendly, suitable   | LIBRARY                        | site_2   |    9037 |   
    9038 |       8947 |        9192 |         0
 Friendly, suitable   | LIBRARY                        | site_3   |    8949 |   
    8931 |       8842 |        9036 |         0
 Friendly, suitable   | NEXT DAY                       | site_0   |   11870 |   
   11828 |      11856 |       11717 |         0
 Friendly, suitable   | NEXT DAY                       | site_1   |   12125 |   
   11768 |      12078 |       11822 |         0
 Friendly, suitable   | NEXT DAY                       | site_2   |   12209 |   
   11912 |      12014 |       11965 |         0
 Friendly, suitable   | NEXT DAY                       | site_3   |   12027 |   
   11846 |      12107 |       12240 |         0
 Friendly, suitable   | OVERNIGHT                      | site_0   |    8898 |   
    9001 |       8926 |        9175 |         0
 Friendly, suitable   | OVERNIGHT                      | site_1   |    8841 |   
    8851 |       8921 |        9057 |         0
 Friendly, suitable   | OVERNIGHT                      | site_2   |    8939 |   
    8943 |       8941 |        9096 |         0
 Friendly, suitable   | OVERNIGHT                      | site_3   |    8720 |   
    8895 |       9044 |        9098 |         0
 Friendly, suitable   | REGULAR                        | site_0   |    8905 |   
    9121 |       8946 |        8904 |         0
 Friendly, suitable   | REGULAR                        | site_1   |    8994 |   
    8931 |       8922 |        8990 |         0
 Friendly, suitable   | REGULAR                        | site_2   |    8940 |   
    9163 |       8965 |        9057 |         0
 Friendly, suitable   | REGULAR                        | site_3   |    8968 |   
    9001 |       8956 |        9070 |         0
 Friendly, suitable   | TWO DAY                        | site_0   |    8865 |   
    9019 |       8955 |        8858 |         0
 Friendly, suitable   | TWO DAY                        | site_1   |    9074 |   
    9101 |       8756 |        8888 |         0
 Friendly, suitable   | TWO DAY                        | site_2   |    8757 |   
    8929 |       8874 |        8997 |         0
 Friendly, suitable   | TWO DAY                        | site_3   |    8943 |   
    9184 |       8831 |        8978 |         0
 Important dem        | EXPRESS                        | site_0   |   11904 |   
   12162 |      11749 |       11866 |         0
 Important dem        | EXPRESS                        | site_1   |   11942 |   
   11964 |      11866 |       11984 |         0
 Important dem        | EXPRESS                        | site_2   |   11842 |   
   11842 |      12015 |       12085 |         0
 Important dem        | EXPRESS                        | site_3   |   11770 |   
   11735 |      11752 |       12042 |         0
(100 rows)

Time: 60955.751 ms (01:00.956)
SET
Timing is on.
        substr        |            sm_type             | web_name | 30 days | 
31-60 days | 61-90 days | 91-120 days | >120 days 
----------------------+--------------------------------+----------+---------+------------+------------+-------------+-----------
 Bad cards must make. | EXPRESS                        | site_0   |   11835 |   
   11998 |      11919 |       11881 |         0
 Bad cards must make. | EXPRESS                        | site_1   |   12030 |   
   12272 |      11959 |       11921 |         0
 Bad cards must make. | EXPRESS                        | site_2   |   11991 |   
   11946 |      11745 |       11948 |         0
 Bad cards must make. | EXPRESS                        | site_3   |   12050 |   
   11889 |      11857 |       12016 |         0
 Bad cards must make. | LIBRARY                        | site_0   |    9057 |   
    8923 |       8827 |        8810 |         0
 Bad cards must make. | LIBRARY                        | site_1   |    9107 |   
    8838 |       8925 |        8954 |         0
 Bad cards must make. | LIBRARY                        | site_2   |    8915 |   
    8995 |       9007 |        8931 |         0
 Bad cards must make. | LIBRARY                        | site_3   |    9165 |   
    8965 |       8936 |        8743 |         0
 Bad cards must make. | NEXT DAY                       | site_0   |   11891 |   
   11959 |      11895 |       12070 |         0
 Bad cards must make. | NEXT DAY                       | site_1   |   11843 |   
   12088 |      12045 |       12027 |         0
 Bad cards must make. | NEXT DAY                       | site_2   |   11894 |   
   12038 |      11736 |       12108 |         0
 Bad cards must make. | NEXT DAY                       | site_3   |   11852 |   
   11823 |      11836 |       12071 |         0
 Bad cards must make. | OVERNIGHT                      | site_0   |    8859 |   
    8850 |       9016 |        8944 |         0
 Bad cards must make. | OVERNIGHT                      | site_1   |    9113 |   
    8709 |       8939 |        8985 |         0
 Bad cards must make. | OVERNIGHT                      | site_2   |    9067 |   
    8917 |       9297 |        8831 |         0
 Bad cards must make. | OVERNIGHT                      | site_3   |    8881 |   
    8898 |       8980 |        8790 |         0
 Bad cards must make. | REGULAR                        | site_0   |    9048 |   
    9043 |       9044 |        8833 |         0
 Bad cards must make. | REGULAR                        | site_1   |    9064 |   
    8795 |       9005 |        8974 |         0
 Bad cards must make. | REGULAR                        | site_2   |    9198 |   
    8883 |       8981 |        8858 |         0
 Bad cards must make. | REGULAR                        | site_3   |    8915 |   
    8971 |       9069 |        9001 |         0
 Bad cards must make. | TWO DAY                        | site_0   |    8904 |   
    9035 |       9042 |        9109 |         0
 Bad cards must make. | TWO DAY                        | site_1   |    9246 |   
    8889 |       8848 |        8948 |         0
 Bad cards must make. | TWO DAY                        | site_2   |    9229 |   
    8899 |       8918 |        8810 |         0
 Bad cards must make. | TWO DAY                        | site_3   |    8968 |   
    8984 |       9109 |        8848 |         0
 Conventional childr  | EXPRESS                        | site_0   |   12172 |   
   11914 |      11988 |       12019 |         0
 Conventional childr  | EXPRESS                        | site_1   |   12053 |   
   11806 |      11966 |       11878 |         0
 Conventional childr  | EXPRESS                        | site_2   |   12026 |   
   12137 |      11956 |       12029 |         0
 Conventional childr  | EXPRESS                        | site_3   |   12175 |   
   11877 |      11981 |       11852 |         0
 Conventional childr  | LIBRARY                        | site_0   |    8951 |   
    9128 |       8945 |        8916 |         0
 Conventional childr  | LIBRARY                        | site_1   |    8814 |   
    8998 |       9104 |        8981 |         0
 Conventional childr  | LIBRARY                        | site_2   |    9057 |   
    8996 |       9016 |        8944 |         0
 Conventional childr  | LIBRARY                        | site_3   |    8981 |   
    9035 |       8983 |        9045 |         0
 Conventional childr  | NEXT DAY                       | site_0   |   11990 |   
   11939 |      12016 |       11905 |         0
 Conventional childr  | NEXT DAY                       | site_1   |   11934 |   
   12050 |      11962 |       12076 |         0
 Conventional childr  | NEXT DAY                       | site_2   |   11946 |   
   11827 |      12035 |       11856 |         0
 Conventional childr  | NEXT DAY                       | site_3   |   12050 |   
   11954 |      11991 |       11783 |         0
 Conventional childr  | OVERNIGHT                      | site_0   |    9005 |   
    8850 |       8982 |        9050 |         0
 Conventional childr  | OVERNIGHT                      | site_1   |    9086 |   
    9031 |       8887 |        9126 |         0
 Conventional childr  | OVERNIGHT                      | site_2   |    8861 |   
    8833 |       8961 |        9101 |         0
 Conventional childr  | OVERNIGHT                      | site_3   |    9046 |   
    9096 |       8983 |        8954 |         0
 Conventional childr  | REGULAR                        | site_0   |    8874 |   
    8975 |       8961 |        8965 |         0
 Conventional childr  | REGULAR                        | site_1   |    8722 |   
    8931 |       8904 |        8831 |         0
 Conventional childr  | REGULAR                        | site_2   |    8954 |   
    8843 |       8925 |        8840 |         0
 Conventional childr  | REGULAR                        | site_3   |    9103 |   
    8975 |       8947 |        8863 |         0
 Conventional childr  | TWO DAY                        | site_0   |    8816 |   
    8946 |       8994 |        9031 |         0
 Conventional childr  | TWO DAY                        | site_1   |    8741 |   
    8945 |       8859 |        8856 |         0
 Conventional childr  | TWO DAY                        | site_2   |    8803 |   
    9012 |       8985 |        8968 |         0
 Conventional childr  | TWO DAY                        | site_3   |    8773 |   
    9039 |       9035 |        8951 |         0
 Doors canno          | EXPRESS                        | site_0   |   11776 |   
   12009 |      11911 |       11775 |         0
 Doors canno          | EXPRESS                        | site_1   |   11979 |   
   12147 |      12002 |       12194 |         0
 Doors canno          | EXPRESS                        | site_2   |   11830 |   
   11918 |      11960 |       12054 |         0
 Doors canno          | EXPRESS                        | site_3   |   12112 |   
   11805 |      11931 |       12006 |         0
 Doors canno          | LIBRARY                        | site_0   |    8930 |   
    9049 |       9018 |        8752 |         0
 Doors canno          | LIBRARY                        | site_1   |    8945 |   
    9109 |       8937 |        8979 |         0
 Doors canno          | LIBRARY                        | site_2   |    8914 |   
    8827 |       9129 |        9040 |         0
 Doors canno          | LIBRARY                        | site_3   |    9028 |   
    9054 |       9063 |        8985 |         0
 Doors canno          | NEXT DAY                       | site_0   |   11990 |   
   11958 |      12047 |       11761 |         0
 Doors canno          | NEXT DAY                       | site_1   |   12107 |   
   11975 |      11936 |       11914 |         0
 Doors canno          | NEXT DAY                       | site_2   |   12013 |   
   11843 |      11916 |       12030 |         0
 Doors canno          | NEXT DAY                       | site_3   |   12067 |   
   12083 |      12015 |       11778 |         0
 Doors canno          | OVERNIGHT                      | site_0   |    8882 |   
    8911 |       8922 |        8882 |         0
 Doors canno          | OVERNIGHT                      | site_1   |    9017 |   
    8882 |       8972 |        8995 |         0
 Doors canno          | OVERNIGHT                      | site_2   |    9040 |   
    8884 |       8896 |        8976 |         0
 Doors canno          | OVERNIGHT                      | site_3   |    9076 |   
    8978 |       8958 |        8798 |         0
 Doors canno          | REGULAR                        | site_0   |    8904 |   
    8907 |       9045 |        9069 |         0
 Doors canno          | REGULAR                        | site_1   |    8972 |   
    8961 |       8908 |        8897 |         0
 Doors canno          | REGULAR                        | site_2   |    8986 |   
    8981 |       8936 |        8863 |         0
 Doors canno          | REGULAR                        | site_3   |    8834 |   
    8976 |       8808 |        9014 |         0
 Doors canno          | TWO DAY                        | site_0   |    8811 |   
    8965 |       8998 |        8996 |         0
 Doors canno          | TWO DAY                        | site_1   |    8915 |   
    9008 |       8928 |        8944 |         0
 Doors canno          | TWO DAY                        | site_2   |    9063 |   
    8867 |       8886 |        8977 |         0
 Doors canno          | TWO DAY                        | site_3   |    9083 |   
    9020 |       8983 |        9099 |         0
 Friendly, suitable   | EXPRESS                        | site_0   |   12162 |   
   12022 |      12015 |       11960 |         0
 Friendly, suitable   | EXPRESS                        | site_1   |   11836 |   
   11847 |      11897 |       12034 |         0
 Friendly, suitable   | EXPRESS                        | site_2   |   12052 |   
   11952 |      12122 |       11924 |         0
 Friendly, suitable   | EXPRESS                        | site_3   |   11936 |   
   11739 |      11918 |       11648 |         0
 Friendly, suitable   | LIBRARY                        | site_0   |    9049 |   
    9031 |       8996 |        8939 |         0
 Friendly, suitable   | LIBRARY                        | site_1   |    8984 |   
    9018 |       8947 |        8836 |         0
 Friendly, suitable   | LIBRARY                        | site_2   |    9037 |   
    9038 |       8947 |        9192 |         0
 Friendly, suitable   | LIBRARY                        | site_3   |    8949 |   
    8931 |       8842 |        9036 |         0
 Friendly, suitable   | NEXT DAY                       | site_0   |   11870 |   
   11828 |      11856 |       11717 |         0
 Friendly, suitable   | NEXT DAY                       | site_1   |   12125 |   
   11768 |      12078 |       11822 |         0
 Friendly, suitable   | NEXT DAY                       | site_2   |   12209 |   
   11912 |      12014 |       11965 |         0
 Friendly, suitable   | NEXT DAY                       | site_3   |   12027 |   
   11846 |      12107 |       12240 |         0
 Friendly, suitable   | OVERNIGHT                      | site_0   |    8898 |   
    9001 |       8926 |        9175 |         0
 Friendly, suitable   | OVERNIGHT                      | site_1   |    8841 |   
    8851 |       8921 |        9057 |         0
 Friendly, suitable   | OVERNIGHT                      | site_2   |    8939 |   
    8943 |       8941 |        9096 |         0
 Friendly, suitable   | OVERNIGHT                      | site_3   |    8720 |   
    8895 |       9044 |        9098 |         0
 Friendly, suitable   | REGULAR                        | site_0   |    8905 |   
    9121 |       8946 |        8904 |         0
 Friendly, suitable   | REGULAR                        | site_1   |    8994 |   
    8931 |       8922 |        8990 |         0
 Friendly, suitable   | REGULAR                        | site_2   |    8940 |   
    9163 |       8965 |        9057 |         0
 Friendly, suitable   | REGULAR                        | site_3   |    8968 |   
    9001 |       8956 |        9070 |         0
 Friendly, suitable   | TWO DAY                        | site_0   |    8865 |   
    9019 |       8955 |        8858 |         0
 Friendly, suitable   | TWO DAY                        | site_1   |    9074 |   
    9101 |       8756 |        8888 |         0
 Friendly, suitable   | TWO DAY                        | site_2   |    8757 |   
    8929 |       8874 |        8997 |         0
 Friendly, suitable   | TWO DAY                        | site_3   |    8943 |   
    9184 |       8831 |        8978 |         0
 Important dem        | EXPRESS                        | site_0   |   11904 |   
   12162 |      11749 |       11866 |         0
 Important dem        | EXPRESS                        | site_1   |   11942 |   
   11964 |      11866 |       11984 |         0
 Important dem        | EXPRESS                        | site_2   |   11842 |   
   11842 |      12015 |       12085 |         0
 Important dem        | EXPRESS                        | site_3   |   11770 |   
   11735 |      11752 |       12042 |         0
(100 rows)

Time: 66611.049 ms (01:06.611)

Reply via email to