[
https://issues.apache.org/jira/browse/FLINK-20725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lijie Wang updated FLINK-20725:
-------------------------------
Description:
I found that TableFunction#getTypeInference is not work well for
JdbcRowDataLookupFunction , it's always throws Exception.
When I add following test in JdbcLookupFunctionTest and run it:
{code:java}
@Test
public void testTypeInference() {
final TableEnvironment env = TableEnvironment.create(EnvironmentSettings
.newInstance().build());
final DataTypeFactory dataTypeFactory = ((TableEnvironmentInternal) env)
.getCatalogManager()
.getDataTypeFactory();
JdbcLookupFunction lookupFunction = buildLookupFunction();
lookupFunction.getTypeInference(dataTypeFactory);
}
{code}
it always throws following exception:
{code:java}
Caused by: org.apache.flink.table.api.ValidationException: Error in extracting
a signature to output mapping.
at
org.apache.flink.table.types.extraction.ExtractionUtils.extractionError(ExtractionUtils.java:359)
at
org.apache.flink.table.types.extraction.FunctionMappingExtractor.extractOutputMapping(FunctionMappingExtractor.java:118)
at
org.apache.flink.table.types.extraction.TypeInferenceExtractor.extractTypeInferenceOrError(TypeInferenceExtractor.java:170)
at
org.apache.flink.table.types.extraction.TypeInferenceExtractor.extractTypeInference(TypeInferenceExtractor.java:158)
... 32 more
Caused by: org.apache.flink.table.api.ValidationException: Unable to extract a
type inference from method:public void
org.apache.flink.connector.jdbc.table.JdbcLookupFunction.eval(java.lang.Object[])
at
org.apache.flink.table.types.extraction.ExtractionUtils.extractionError(ExtractionUtils.java:359)
at
org.apache.flink.table.types.extraction.FunctionMappingExtractor.extractResultMappings(FunctionMappingExtractor.java:175)
at
org.apache.flink.table.types.extraction.FunctionMappingExtractor.extractOutputMapping(FunctionMappingExtractor.java:113)
... 34 more
Caused by: org.apache.flink.table.api.ValidationException: Could not extract a
data type from 'class org.apache.flink.types.Row' in generic class
'org.apache.flink.table.functions.TableFunction' in class
org.apache.flink.connector.jdbc.table.JdbcLookupFunction. Please pass the
required data type manually or allow RAW types.
at
org.apache.flink.table.types.extraction.ExtractionUtils.extractionError(ExtractionUtils.java:359)
at
org.apache.flink.table.types.extraction.DataTypeExtractor.extractDataTypeOrRawWithTemplate(DataTypeExtractor.java:273)
at
org.apache.flink.table.types.extraction.DataTypeExtractor.extractDataTypeOrRaw(DataTypeExtractor.java:249)
at
org.apache.flink.table.types.extraction.DataTypeExtractor.extractDataTypeWithClassContext(DataTypeExtractor.java:223)
at
org.apache.flink.table.types.extraction.DataTypeExtractor.extractFromGeneric(DataTypeExtractor.java:144)
at
org.apache.flink.table.types.extraction.FunctionMappingExtractor.lambda$createGenericResultExtraction$13(FunctionMappingExtractor.java:467)
at
org.apache.flink.table.types.extraction.FunctionMappingExtractor.putExtractedResultMappings(FunctionMappingExtractor.java:312)
at
org.apache.flink.table.types.extraction.FunctionMappingExtractor.collectMethodMappings(FunctionMappingExtractor.java:255)
at
org.apache.flink.table.types.extraction.FunctionMappingExtractor.extractResultMappings(FunctionMappingExtractor.java:167)
... 35 more
Caused by: org.apache.flink.table.api.ValidationException: Cannot extract a
data type from a pure 'org.apache.flink.types.Row' class. Please use
annotations to define field names and field types.
at
org.apache.flink.table.types.extraction.ExtractionUtils.extractionError(ExtractionUtils.java:359)
at
org.apache.flink.table.types.extraction.ExtractionUtils.extractionError(ExtractionUtils.java:351)
at
org.apache.flink.table.types.extraction.DataTypeExtractor.checkForCommonErrors(DataTypeExtractor.java:390)
at
org.apache.flink.table.types.extraction.DataTypeExtractor.extractDataTypeOrError(DataTypeExtractor.java:304)
at
org.apache.flink.table.types.extraction.DataTypeExtractor.extractDataTypeOrRawWithTemplate(DataTypeExtractor.java:265)
... 42 more
{code}
I guess this problem also exists in other LookupFunction implementations. And
the reason why there is no problem when running itcase(JdbcLookupTableITCase)
is that the exception is catched and handled in
LookupJoinCodeGenerator#createLookupTypeInference.
was:
I find that TableFunction#getTypeInference is not work well for
JdbcRowDataLookupFunction , it's always throws Exception.
When I add following test in JdbcLookupFunctionTest and run it:
{code:java}
@Test
public void testTypeInference() {
final TableEnvironment env = TableEnvironment.create(EnvironmentSettings
.newInstance().build());
final DataTypeFactory dataTypeFactory = ((TableEnvironmentInternal) env)
.getCatalogManager()
.getDataTypeFactory();
JdbcLookupFunction lookupFunction = buildLookupFunction();
lookupFunction.getTypeInference(dataTypeFactory);
}
{code}
it always throws following exception:
{code:java}
Caused by: org.apache.flink.table.api.ValidationException: Error in extracting
a signature to output mapping.
at
org.apache.flink.table.types.extraction.ExtractionUtils.extractionError(ExtractionUtils.java:359)
at
org.apache.flink.table.types.extraction.FunctionMappingExtractor.extractOutputMapping(FunctionMappingExtractor.java:118)
at
org.apache.flink.table.types.extraction.TypeInferenceExtractor.extractTypeInferenceOrError(TypeInferenceExtractor.java:170)
at
org.apache.flink.table.types.extraction.TypeInferenceExtractor.extractTypeInference(TypeInferenceExtractor.java:158)
... 32 more
Caused by: org.apache.flink.table.api.ValidationException: Unable to extract a
type inference from method:public void
org.apache.flink.connector.jdbc.table.JdbcLookupFunction.eval(java.lang.Object[])
at
org.apache.flink.table.types.extraction.ExtractionUtils.extractionError(ExtractionUtils.java:359)
at
org.apache.flink.table.types.extraction.FunctionMappingExtractor.extractResultMappings(FunctionMappingExtractor.java:175)
at
org.apache.flink.table.types.extraction.FunctionMappingExtractor.extractOutputMapping(FunctionMappingExtractor.java:113)
... 34 more
Caused by: org.apache.flink.table.api.ValidationException: Could not extract a
data type from 'class org.apache.flink.types.Row' in generic class
'org.apache.flink.table.functions.TableFunction' in class
org.apache.flink.connector.jdbc.table.JdbcLookupFunction. Please pass the
required data type manually or allow RAW types.
at
org.apache.flink.table.types.extraction.ExtractionUtils.extractionError(ExtractionUtils.java:359)
at
org.apache.flink.table.types.extraction.DataTypeExtractor.extractDataTypeOrRawWithTemplate(DataTypeExtractor.java:273)
at
org.apache.flink.table.types.extraction.DataTypeExtractor.extractDataTypeOrRaw(DataTypeExtractor.java:249)
at
org.apache.flink.table.types.extraction.DataTypeExtractor.extractDataTypeWithClassContext(DataTypeExtractor.java:223)
at
org.apache.flink.table.types.extraction.DataTypeExtractor.extractFromGeneric(DataTypeExtractor.java:144)
at
org.apache.flink.table.types.extraction.FunctionMappingExtractor.lambda$createGenericResultExtraction$13(FunctionMappingExtractor.java:467)
at
org.apache.flink.table.types.extraction.FunctionMappingExtractor.putExtractedResultMappings(FunctionMappingExtractor.java:312)
at
org.apache.flink.table.types.extraction.FunctionMappingExtractor.collectMethodMappings(FunctionMappingExtractor.java:255)
at
org.apache.flink.table.types.extraction.FunctionMappingExtractor.extractResultMappings(FunctionMappingExtractor.java:167)
... 35 more
Caused by: org.apache.flink.table.api.ValidationException: Cannot extract a
data type from a pure 'org.apache.flink.types.Row' class. Please use
annotations to define field names and field types.
at
org.apache.flink.table.types.extraction.ExtractionUtils.extractionError(ExtractionUtils.java:359)
at
org.apache.flink.table.types.extraction.ExtractionUtils.extractionError(ExtractionUtils.java:351)
at
org.apache.flink.table.types.extraction.DataTypeExtractor.checkForCommonErrors(DataTypeExtractor.java:390)
at
org.apache.flink.table.types.extraction.DataTypeExtractor.extractDataTypeOrError(DataTypeExtractor.java:304)
at
org.apache.flink.table.types.extraction.DataTypeExtractor.extractDataTypeOrRawWithTemplate(DataTypeExtractor.java:265)
... 42 more
{code}
I guess this problem also exists in other LookupFunction implementations. And
the reason why there is no problem when running itcase(JdbcLookupTableITCase)
is that the exception is catched and handled in
LookupJoinCodeGenerator#createLookupTypeInference.
> TableFunction#getTypeInference is not work well for
> JdbcRowDataLookupFunction, it's always throws Exception
> -----------------------------------------------------------------------------------------------------------
>
> Key: FLINK-20725
> URL: https://issues.apache.org/jira/browse/FLINK-20725
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / API
> Affects Versions: 1.13.0
> Reporter: Lijie Wang
> Priority: Major
>
> I found that TableFunction#getTypeInference is not work well for
> JdbcRowDataLookupFunction , it's always throws Exception.
>
> When I add following test in JdbcLookupFunctionTest and run it:
> {code:java}
> @Test
> public void testTypeInference() {
> final TableEnvironment env = TableEnvironment.create(EnvironmentSettings
> .newInstance().build());
> final DataTypeFactory dataTypeFactory = ((TableEnvironmentInternal) env)
> .getCatalogManager()
> .getDataTypeFactory();
> JdbcLookupFunction lookupFunction = buildLookupFunction();
> lookupFunction.getTypeInference(dataTypeFactory);
> }
> {code}
>
> it always throws following exception:
>
> {code:java}
> Caused by: org.apache.flink.table.api.ValidationException: Error in
> extracting a signature to output mapping.
> at
> org.apache.flink.table.types.extraction.ExtractionUtils.extractionError(ExtractionUtils.java:359)
> at
> org.apache.flink.table.types.extraction.FunctionMappingExtractor.extractOutputMapping(FunctionMappingExtractor.java:118)
>
> at
> org.apache.flink.table.types.extraction.TypeInferenceExtractor.extractTypeInferenceOrError(TypeInferenceExtractor.java:170)
>
> at
> org.apache.flink.table.types.extraction.TypeInferenceExtractor.extractTypeInference(TypeInferenceExtractor.java:158)
> ... 32 more
> Caused by: org.apache.flink.table.api.ValidationException: Unable to extract
> a type inference from method:public void
> org.apache.flink.connector.jdbc.table.JdbcLookupFunction.eval(java.lang.Object[])
>
> at
> org.apache.flink.table.types.extraction.ExtractionUtils.extractionError(ExtractionUtils.java:359)
>
> at
> org.apache.flink.table.types.extraction.FunctionMappingExtractor.extractResultMappings(FunctionMappingExtractor.java:175)
>
> at
> org.apache.flink.table.types.extraction.FunctionMappingExtractor.extractOutputMapping(FunctionMappingExtractor.java:113)
> ... 34 more
> Caused by: org.apache.flink.table.api.ValidationException: Could not extract
> a data type from 'class org.apache.flink.types.Row' in generic class
> 'org.apache.flink.table.functions.TableFunction' in class
> org.apache.flink.connector.jdbc.table.JdbcLookupFunction. Please pass the
> required data type manually or allow RAW types.
> at
> org.apache.flink.table.types.extraction.ExtractionUtils.extractionError(ExtractionUtils.java:359)
>
> at
> org.apache.flink.table.types.extraction.DataTypeExtractor.extractDataTypeOrRawWithTemplate(DataTypeExtractor.java:273)
>
> at
> org.apache.flink.table.types.extraction.DataTypeExtractor.extractDataTypeOrRaw(DataTypeExtractor.java:249)
> at
> org.apache.flink.table.types.extraction.DataTypeExtractor.extractDataTypeWithClassContext(DataTypeExtractor.java:223)
>
> at
> org.apache.flink.table.types.extraction.DataTypeExtractor.extractFromGeneric(DataTypeExtractor.java:144)
> at
> org.apache.flink.table.types.extraction.FunctionMappingExtractor.lambda$createGenericResultExtraction$13(FunctionMappingExtractor.java:467)
>
> at
> org.apache.flink.table.types.extraction.FunctionMappingExtractor.putExtractedResultMappings(FunctionMappingExtractor.java:312)
>
> at
> org.apache.flink.table.types.extraction.FunctionMappingExtractor.collectMethodMappings(FunctionMappingExtractor.java:255)
>
> at
> org.apache.flink.table.types.extraction.FunctionMappingExtractor.extractResultMappings(FunctionMappingExtractor.java:167)
> ... 35 more
> Caused by: org.apache.flink.table.api.ValidationException: Cannot extract a
> data type from a pure 'org.apache.flink.types.Row' class. Please use
> annotations to define field names and field types.
> at
> org.apache.flink.table.types.extraction.ExtractionUtils.extractionError(ExtractionUtils.java:359)
>
> at
> org.apache.flink.table.types.extraction.ExtractionUtils.extractionError(ExtractionUtils.java:351)
>
> at
> org.apache.flink.table.types.extraction.DataTypeExtractor.checkForCommonErrors(DataTypeExtractor.java:390)
>
> at
> org.apache.flink.table.types.extraction.DataTypeExtractor.extractDataTypeOrError(DataTypeExtractor.java:304)
>
> at
> org.apache.flink.table.types.extraction.DataTypeExtractor.extractDataTypeOrRawWithTemplate(DataTypeExtractor.java:265)
> ... 42 more
> {code}
>
> I guess this problem also exists in other LookupFunction implementations. And
> the reason why there is no problem when running itcase(JdbcLookupTableITCase)
> is that the exception is catched and handled in
> LookupJoinCodeGenerator#createLookupTypeInference.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
