[
https://issues.apache.org/jira/browse/TAJO-1669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611382#comment-14611382
]
Jihoon Son commented on TAJO-1669:
----------------------------------
In our original design, the query progress can be dropped when there are some
task failures.
So, if there aren't any other problems, dropping progress can be regarded as
one of the expected error cases, and thus it is not weird.
I think that we need to figure out whether this problem is the expected error
case or not.
To do so, we should investigate the logs of tajo master and query master
basically. In addition, we need to further investigate workers' problems if
this is the case of an unexpected error.
You can find the *tajo master*'s log at here.
{noformat}
${TAJO_MASTER}:${TAJO_LOG_DIR}/tajo-${user}-master-xxx.log
{noformat}
You may configure $TAJO_LOG_DIR at here.
{noformat}
${TAJO_HOME}/conf/tajo-env.sh.
{noformat}
Regarding query master's log, you should first figure out who was the query
master of the erroneous query among tajo workers. You can easily find it in the
Query tab of our Web UI. After you find it, you can find the *query master*'s
log at here.
{noformat}
${QUERY_MASTER}:${TAJO_LOG_DIR}/tajo-${user}-worker-xxx.log
{noformat}
Please note that you should find a *WORKER*'s log instead of master because
query master runs on one of tajo workers.
Figuring out which workers ran failed tasks requires some steps, but is not
complex. When you click the failed query ID on the Web UI, you can see several
links started with "eb_". They represents query execution stages in tajo, so
the last one must be the failed stage. Once you find who ran failed tasks,
again you can find those workers' log at here.
{noformat}
${WORKER}:${TAJO_LOG_DIR}/tajo-${user}-worker-xxx.log
{noformat}
> TSQL prints wrong progress occasionally
> ---------------------------------------
>
> Key: TAJO-1669
> URL: https://issues.apache.org/jira/browse/TAJO-1669
> Project: Tajo
> Issue Type: Bug
> Components: SQL Shell
> Reporter: DongPhil Kim
>
> Currently, tsql prints wrong progress occasionally.I found that rate of
> progress had updated 64 percent to 63 percent as following:
> {code:xml}
> Progress: 0%, response time: 2.189 sec
> Progress: 0%, response time: 2.197 sec
> Progress: 0%, response time: 2.602 sec
> Progress: 0%, response time: 3.405 sec
> Progress: 0%, response time: 4.408 sec
> Progress: 0%, response time: 5.416 sec
> Progress: 0%, response time: 6.423 sec
> Progress: 0%, response time: 7.428 sec
> Progress: 5%, response time: 8.436 sec
> Progress: 5%, response time: 9.44 sec
> Progress: 24%, response time: 10.449 sec
> Progress: 24%, response time: 11.461 sec
> Progress: 31%, response time: 12.476 sec
> Progress: 31%, response time: 13.485 sec
> Progress: 32%, response time: 14.488 sec
> Progress: 32%, response time: 15.49 sec
> Progress: 32%, response time: 16.492 sec
> Progress: 32%, response time: 17.495 sec
> Progress: 32%, response time: 18.497 sec
> Progress: 32%, response time: 19.5 sec
> Progress: 32%, response time: 20.502 sec
> Progress: 32%, response time: 21.506 sec
> Progress: 32%, response time: 22.514 sec
> Progress: 32%, response time: 23.525 sec
> Progress: 32%, response time: 24.533 sec
> Progress: 32%, response time: 25.538 sec
> Progress: 33%, response time: 26.545 sec
> Progress: 33%, response time: 27.55 sec
> Progress: 33%, response time: 28.556 sec
> Progress: 33%, response time: 29.559 sec
> Progress: 33%, response time: 30.563 sec
> Progress: 33%, response time: 31.566 sec
> Progress: 33%, response time: 32.567 sec
> Progress: 33%, response time: 33.569 sec
> Progress: 33%, response time: 34.57 sec
> Progress: 33%, response time: 35.572 sec
> Progress: 33%, response time: 36.574 sec
> Progress: 33%, response time: 37.576 sec
> Progress: 33%, response time: 38.577 sec
> Progress: 33%, response time: 39.579 sec
> Progress: 33%, response time: 40.581 sec
> Progress: 33%, response time: 41.583 sec
> Progress: 33%, response time: 42.585 sec
> Progress: 33%, response time: 43.587 sec
> Progress: 33%, response time: 44.591 sec
> Progress: 33%, response time: 45.594 sec
> Progress: 33%, response time: 46.601 sec
> Progress: 33%, response time: 47.608 sec
> Progress: 33%, response time: 48.613 sec
> Progress: 33%, response time: 49.622 sec
> Progress: 33%, response time: 50.628 sec
> Progress: 33%, response time: 51.633 sec
> Progress: 33%, response time: 52.638 sec
> Progress: 33%, response time: 53.64 sec
> Progress: 33%, response time: 54.642 sec
> Progress: 33%, response time: 55.644 sec
> Progress: 33%, response time: 56.646 sec
> Progress: 33%, response time: 57.651 sec
> Progress: 33%, response time: 58.657 sec
> Progress: 33%, response time: 59.66 sec
> Progress: 33%, response time: 60.665 sec
> Progress: 33%, response time: 61.671 sec
> Progress: 33%, response time: 62.677 sec
> Progress: 33%, response time: 63.683 sec
> Progress: 33%, response time: 64.689 sec
> Progress: 33%, response time: 65.694 sec
> Progress: 33%, response time: 66.696 sec
> Progress: 33%, response time: 67.701 sec
> Progress: 33%, response time: 68.706 sec
> Progress: 33%, response time: 69.708 sec
> Progress: 33%, response time: 70.71 sec
> Progress: 33%, response time: 71.712 sec
> Progress: 33%, response time: 72.714 sec
> Progress: 33%, response time: 73.717 sec
> Progress: 33%, response time: 74.726 sec
> Progress: 33%, response time: 75.734 sec
> Progress: 33%, response time: 76.739 sec
> Progress: 33%, response time: 77.743 sec
> Progress: 33%, response time: 78.745 sec
> Progress: 33%, response time: 79.746 sec
> Progress: 33%, response time: 80.748 sec
> Progress: 33%, response time: 81.75 sec
> Progress: 33%, response time: 82.752 sec
> Progress: 33%, response time: 83.754 sec
> Progress: 33%, response time: 84.757 sec
> Progress: 33%, response time: 85.763 sec
> Progress: 33%, response time: 86.765 sec
> Progress: 33%, response time: 87.769 sec
> Progress: 33%, response time: 88.775 sec
> Progress: 33%, response time: 89.779 sec
> Progress: 33%, response time: 90.783 sec
> Progress: 33%, response time: 91.791 sec
> Progress: 33%, response time: 92.795 sec
> Progress: 33%, response time: 93.797 sec
> Progress: 33%, response time: 94.799 sec
> Progress: 33%, response time: 95.801 sec
> Progress: 35%, response time: 96.804 sec
> Progress: 35%, response time: 97.805 sec
> Progress: 43%, response time: 98.807 sec
> Progress: 43%, response time: 99.809 sec
> Progress: 44%, response time: 100.815 sec
> Progress: 44%, response time: 101.82 sec
> Progress: 55%, response time: 102.839 sec
> Progress: 55%, response time: 103.861 sec
> Progress: 55%, response time: 104.891 sec
> Progress: 55%, response time: 105.898 sec
> Progress: 61%, response time: 106.905 sec
> Progress: 61%, response time: 107.913 sec
> Progress: 62%, response time: 108.92 sec
> Progress: 62%, response time: 109.922 sec
> Progress: 63%, response time: 110.924 sec
> Progress: 63%, response time: 111.925 sec
> Progress: 65%, response time: 112.927 sec
> Progress: 65%, response time: 113.929 sec
> Progress: 64%, response time: 114.931 sec
> Progress: 64%, response time: 115.933 sec
> Progress: 63%, response time: 116.935 sec
> Progress: 63%, response time: 117.937 sec
> Progress: 62%, response time: 118.939 sec
> Progress: 62%, response time: 119.945 sec
> Progress: 61%, response time: 120.955 sec
> Progress: 61%, response time: 121.961 sec
> Progress: 61%, response time: 122.969 sec
> Progress: 61%, response time: 123.974 sec
> Progress: 61%, response time: 124.977 sec
> Progress: 61%, response time: 125.979 sec
> Progress: 62%, response time: 126.981 sec
> Progress: 62%, response time: 127.982 sec
> Progress: 63%, response time: 128.984 sec
> Progress: 63%, response time: 129.986 sec
> Progress: 64%, response time: 130.988 sec
> Progress: 64%, response time: 131.99 sec
> Progress: 64%, response time: 132.993 sec
> Progress: 64%, response time: 133.994 sec
> Progress: 64%, response time: 134.996 sec
> Progress: 64%, response time: 135.998 sec
> Progress: 64%, response time: 137.0 sec
> Progress: 64%, response time: 138.002 sec
> Progress: 64%, response time: 139.006 sec
> Progress: 64%, response time: 140.013 sec
> Progress: 64%, response time: 141.02 sec
> Progress: 64%, response time: 142.027 sec
> Progress: 64%, response time: 143.034 sec
> Progress: 64%, response time: 144.04 sec
> Progress: 65%, response time: 145.042 sec
> Progress: 65%, response time: 146.046 sec
> Progress: 65%, response time: 147.051 sec
> Progress: 65%, response time: 148.053 sec
> Progress: 66%, response time: 149.055 sec
> Progress: 66%, response time: 150.058 sec
> Progress: 66%, response time: 151.089 sec
> Progress: 66%, response time: 152.094 sec
> Progress: 70%, response time: 153.104 sec
> Progress: 70%, response time: 154.135 sec
> Progress: 74%, response time: 155.142 sec
> Progress: 74%, response time: 156.148 sec
> Progress: 88%, response time: 157.153 sec
> Progress: 88%, response time: 158.174 sec
> Progress: 89%, response time: 159.176 sec
> Progress: 89%, response time: 160.179 sec
> Progress: 93%, response time: 161.181 sec
> Progress: 93%, response time: 162.183 sec
> Progress: 96%, response time: 163.186 sec
> Progress: 96%, response time: 164.188 sec
> Progress: 97%, response time: 165.19 sec
> Progress: 97%, response time: 166.195 sec
> Progress: 98%, response time: 167.199 sec
> Progress: 98%, response time: 168.201 sec
> Progress: 97%, response time: 169.207 sec
> Progress: 97%, response time: 170.215 sec
> Progress: 96%, response time: 171.222 sec
> Progress: 96%, response time: 172.231 sec
> Progress: 95%, response time: 173.236 sec
> Progress: 95%, response time: 174.239 sec
> Progress: 100%, response time: 175.174 sec
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
