[jira] [Updated] (DRILL-7349) ClusterTest dfs.tmp storage inconsistence with cluster size > 1

2019-08-15 Thread Arina Ielchiieva (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arina Ielchiieva updated DRILL-7349:

Affects Version/s: (was: 1.17.0)
   1.16.0

> ClusterTest dfs.tmp storage inconsistence with cluster size > 1
> ---
>
> Key: DRILL-7349
> URL: https://issues.apache.org/jira/browse/DRILL-7349
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Tools, Build  Test
>Affects Versions: 1.16.0
>Reporter: Oleg Zinoviev
>Priority: Minor
>
> ClusterTest#dirTestWatcher works inconsistent if cluster size is greater when 
> 1.
> For example, test
> {code:java}
> public class TestClusterTest extends ClusterTest {
>   @BeforeClass
>   public static void setUp() throws Exception {
> startCluster(ClusterFixture.builder(dirTestWatcher).clusterSize(2));
>   }
>   @Test
>   public void testWriteFile() throws Exception {
> final String outputFileName = "some_file_name";
> final File outputFile = 
> FileUtils.getFile(dirTestWatcher.getDfsTestTmpDir(), outputFileName);
> queryBuilder().sql("CREATE TABLE dfs.tmp.%s AS SELECT * FROM 
> cp.`employee.json` limit 1", outputFileName).run();
> assertTrue(outputFile.exists());
>   }
> }
> {code}
> may fail on assertion. 
> Reason: several directories for the storage `dfs.tmp` (possibly 1 for each 
> node) was created, and dirTestWatcher.getDfsTestTmpDir () may return the 
> wrong one.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (DRILL-7349) ClusterTest dfs.tmp storage inconsistence with cluster size > 1

2019-08-15 Thread Oleg Zinoviev (JIRA)


 [ 
https://issues.apache.org/jira/browse/DRILL-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Oleg Zinoviev updated DRILL-7349:
-
Description: 
ClusterTest#dirTestWatcher works inconsistent if cluster size is greater when 1.

For example, test

{code:java}
public class TestClusterTest extends ClusterTest {

  @BeforeClass
  public static void setUp() throws Exception {
startCluster(ClusterFixture.builder(dirTestWatcher).clusterSize(2));
  }

  @Test
  public void testWriteFile() throws Exception {
final String outputFileName = "some_file_name";
final File outputFile = 
FileUtils.getFile(dirTestWatcher.getDfsTestTmpDir(), outputFileName);

queryBuilder().sql("CREATE TABLE dfs.tmp.%s AS SELECT * FROM 
cp.`employee.json` limit 1", outputFileName).run();
assertTrue(outputFile.exists());
  }
}
{code}

may fail on assertion. 
Reason: several directories for the storage `dfs.tmp` (possibly 1 for each 
node) was created, and dirTestWatcher.getDfsTestTmpDir () may return the wrong 
one.

  was:
ClusterTest#dirTestWatcher works inconsistent if cluster size is greater when 1.

For example, test

{code:java}
public class TestClusterTest extends ClusterTest {

  @BeforeClass
  public static void setUp() throws Exception {
startCluster(ClusterFixture.builder(dirTestWatcher).clusterSize(2));
  }

  @Test
  public void testWriteFile() throws Exception {
final String outputFileName = 
"testparquetwriteremptyfiles_testwriteemptyfile";
final File outputFile = 
FileUtils.getFile(dirTestWatcher.getDfsTestTmpDir(), outputFileName);

queryBuilder().sql("CREATE TABLE dfs.tmp.%s AS SELECT * FROM 
cp.`employee.json` limit 1", outputFileName).run();
assertTrue(outputFile.exists());
  }
}
{code}

may fail on assertion. 
Reason: several directories for the storage `dfs.tmp` (possibly 1 for each 
node) was created, and dirTestWatcher.getDfsTestTmpDir () may return the wrong 
one.


> ClusterTest dfs.tmp storage inconsistence with cluster size > 1
> ---
>
> Key: DRILL-7349
> URL: https://issues.apache.org/jira/browse/DRILL-7349
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Tools, Build  Test
>Affects Versions: 1.17.0
>Reporter: Oleg Zinoviev
>Priority: Minor
>
> ClusterTest#dirTestWatcher works inconsistent if cluster size is greater when 
> 1.
> For example, test
> {code:java}
> public class TestClusterTest extends ClusterTest {
>   @BeforeClass
>   public static void setUp() throws Exception {
> startCluster(ClusterFixture.builder(dirTestWatcher).clusterSize(2));
>   }
>   @Test
>   public void testWriteFile() throws Exception {
> final String outputFileName = "some_file_name";
> final File outputFile = 
> FileUtils.getFile(dirTestWatcher.getDfsTestTmpDir(), outputFileName);
> queryBuilder().sql("CREATE TABLE dfs.tmp.%s AS SELECT * FROM 
> cp.`employee.json` limit 1", outputFileName).run();
> assertTrue(outputFile.exists());
>   }
> }
> {code}
> may fail on assertion. 
> Reason: several directories for the storage `dfs.tmp` (possibly 1 for each 
> node) was created, and dirTestWatcher.getDfsTestTmpDir () may return the 
> wrong one.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)