[jira] [Created] (DRILL-4492) TestMergeJoinWithSchemaChanges depends on order files in a directory are read to pass, should be refactored

[Jason Altekruse (JIRA)]

Jason Altekruse created DRILL-4492:
--------------------------------------

             Summary: TestMergeJoinWithSchemaChanges depends on order files in 
a directory are read to pass, should be refactored
                 Key: DRILL-4492
                 URL: https://issues.apache.org/jira/browse/DRILL-4492
             Project: Apache Drill
          Issue Type: Bug
            Reporter: Jason Altekruse
            Assignee: amit hadke


I was running unit tests and saw a failure that seemed unrelated to the changes 
I was making. The test runs fine in isolation both from IntelliJ and the maven 
command line (with -Dtest=TestMergeJoinWithSchemaChanges in the java-exec 
module).

Not sure what about the particular test run made it change the order the files 
were read, but we cannot rely on any particular system to read the files in a 
given order. The test should be updated to remove this assumption.

This is the error I received on one run of the full unit tests:
{code}
testMissingAndNewColumns(TestMergeJoinWithSchemaChanges.java:265)
Caused by: org.apache.drill.common.exceptions.UserRemoteException: 
UNSUPPORTED_OPERATION ERROR: Sort doesn't currently support    sorts with 
changing schemas

Fragment 0:0

[Error Id: bf84bffb-f643-493b-9ed5-720eb18d55f2 on 10.1.10.225:31010]

  (org.apache.drill.exec.exception.SchemaChangeException) Sort currently only 
supports a single schema.
    org.apache.drill.exec.physical.impl.sort.SortRecordBatchBuilder.build():146
    org.apache.drill.exec.physical.impl.xsort.ExternalSortBatch.innerNext():442
    org.apache.drill.exec.record.AbstractRecordBatch.next():162
    
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():215
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():109
    org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
    
org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.innerNext():94
    org.apache.drill.exec.record.AbstractRecordBatch.next():162
    
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():215
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.RecordIterator.nextBatch():97
    org.apache.drill.exec.record.RecordIterator.next():183
    org.apache.drill.exec.record.RecordIterator.prepare():167
    org.apache.drill.exec.physical.impl.join.JoinStatus.prepare():87
    org.apache.drill.exec.physical.impl.join.MergeJoinBatch.innerNext():162
    org.apache.drill.exec.record.AbstractRecordBatch.next():162
    
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():215
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():109
    org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
    
org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():129
    org.apache.drill.exec.record.AbstractRecordBatch.next():162

{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)