[
https://issues.apache.org/jira/browse/FLINK-29881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17628723#comment-17628723
]
yuzelin edited comment on FLINK-29881 at 11/4/22 6:53 AM:
----------------------------------------------------------
Hi,
Maybe it is a little misleading, let me explain.
Currently, the `resultType` of the `ResultSet` has three value[1]: NOT_READY,
PAYLOAD and EOS. If the result is NOT_READY, it doesn't mean the execution has
error or there doesn't have result, but means the result is not ready yet, but
you may get it from `nextResultUri`. PAYLOAD result means there is data in
result , and EOS means all the result has been fetched (and the EOS result
doesn't contain data).
The result has a `Token`, means the location of the result. Let's see, in
`nextResultUri`, you can see your first nextResultUri is "xxxx/1", but your
second nextResultUri is "xxxxx/0". The first result's next token said you can
move to fetch result 1, indicating the result 0 has been fetched (so the result
is PAY_LOAD), and the second result's next token is still 0, means the data is
not ready, so you have to try to fetch the result 0 again and this result is
NOT_READY result (and has no data).
You better use such codes to get all result and judge if you get all the
results for complex query (that may return much results) follows:
{code:java}
// Pseudo code
Response response = fetch(xxx, 0L);
SomeResultCollection allResults = xxx;
allResults.add(response.getData());
Long nextToken = response.getNextToken(); // maybe you should parse from
nextResultUri
while (nextToken != null) { // which means there still has result
response = fetch(xxx, nextToken);
allResults.add(response.getData());
nextToken = response.getNextToken();
}{code}
[1] [ResultType
|https://github.com/apache/flink/blob/8e66be89dfcb54b7256d51e9d89222ae6701061f/flink-table/flink-sql-gateway-api/src/main/java/org/apache/flink/table/gateway/api/results/ResultSet.java#L146]
was (Author: JIRAUSER293222):
Hi,
Maybe it is a little misleading, let me explain.
Currently, the `resultType` of the `ResultSet` has three value[1]: NOT_READY,
PAYLOAD and EOS. If the result is NOT_READY, it doesn't mean the execution has
error or there doesn't have result, but means the result is not ready yet, but
you may get it from `nextResultUri`. PAYLOAD result means there is data in
result , and EOS means all the result has been fetched (and the EOS result
doesn't contain data).
The result has a `Token`, means the location of the result. Let's see, in
`nextResultUri`, you can see your first nextResultUri is "xxxx/1", but your
second nextResultUri is "xxxxx/0". The first result's next token said you can
move to fetch result 1, indicating the result 0 has been fetched (so the result
is PAY_LOAD), and the second result's next token is still 0, means the data is
not ready, so you have to try to fetch the result 0 again and this result is
NOT_READY result (and has no data).
You better use such codes to get all result and judge if you get all the
results for complex query (that may return much results) follows:
{code:java}
// Pseudo code
Response response = fetch(xxx, 0L);
SomeResultCollection allResults = xxx;
allResults.add(response.getData());
Long nextToken = response.getNextToken();
while (nextToken != null) { // which means there still has result
response = fetch(xxx, nextToken);
allResults.add(response.getData());
nextToken = response.getNextToken();
}{code}
[1] [ResultType |
https://github.com/apache/flink/blob/8e66be89dfcb54b7256d51e9d89222ae6701061f/flink-table/flink-sql-gateway-api/src/main/java/org/apache/flink/table/gateway/api/results/ResultSet.java#L146]
> when Fetch results in sql gateway, the result using open api is different
> from using restful api
> ---------------------------------------------------------------------------------------------------
>
> Key: FLINK-29881
> URL: https://issues.apache.org/jira/browse/FLINK-29881
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Gateway
> Affects Versions: 1.16.0
> Reporter: yiwei93
> Priority: Major
> Attachments: image-2022-11-04-14-47-00-762.png
>
>
> use restful api , fetch result from
> {code:java}
>
> http://hermes02:8083/v1/sessions/9a8fcf37-73e5-43ca-bcc3-d44d8b71a24c/operations/b40085c1-a2c5-42f4-80e7-0971c5ef9710/result/0{code}
> the result is
> {code:java}
> {
> "results": {
> "columns": [
> {
> "name": "localtimestamp",
> "logicalType": {
> "type": "TIMESTAMP_WITHOUT_TIME_ZONE",
> "nullable": false,
> "precision": 3
> },
> "comment": null
> }
> ],
> "data": [
> {
> "kind": "INSERT",
> "fields": [
> "2022-11-04T11:41:40.036"
> ]
> }
> ]
> },
> "resultType": "PAYLOAD",
> "nextResultUri":
> "/v1/sessions/9a8fcf37-73e5-43ca-bcc3-d44d8b71a24c/operations/b40085c1-a2c5-42f4-80e7-0971c5ef9710/result/1"
> }{code}
> use api to fetch ,the code is
> {code:java}
> ApiClient client = new ApiClient();
> client.setHost("hermes02");
> client.setPort(8083);
> client.setScheme("http");
> defaultApi = new DefaultApi(client);
> OpenSessionRequestBody openSessionRequestBody = new OpenSessionRequestBody();
> OpenSessionResponseBody openSessionResponseBody =
> defaultApi.openSession(openSessionRequestBody);
> SessionHandle sessionHandle = new
> SessionHandle().identifier(UUID.fromString(openSessionResponseBody.getSessionHandle()));
> ExecuteStatementRequestBody executeStatementRequestBody = new
> ExecuteStatementRequestBody().statement("select localtimestamp");
> ExecuteStatementResponseBody executeStatementResponseBody =
> defaultApi.executeStatement(sessionHandle.getIdentifier(),
> executeStatementRequestBody);
> FetchResultsResponseBody fetchResultsResponseBody =
> defaultApi.fetchResults(sessionHandle.getIdentifier(),
> UUID.fromString(executeStatementResponseBody.getOperationHandle()), 0L);{code}
> the result is
> {code:java}
> class FetchResultsResponseBody {
> results: class ResultSet {
> resultType: null
> nextToken: null
> resultSchema: null
> data: []
> }
> resultType: NOT_READY
> nextResultUri:
> /v1/sessions/9a8fcf37-73e5-43ca-bcc3-d44d8b71a24c/operations/b40085c1-a2c5-42f4-80e7-0971c5ef9710/result/0
> }{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
