[jira] [Commented] (HAWQ-1490) PXF dummy text profile for non-hadoop testing.
[ https://issues.apache.org/jira/browse/HAWQ-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069239#comment-16069239 ] John Gaskin commented on HAWQ-1490: --- We will be introducing a demo profile which returns text and a profile for a custom format. > PXF dummy text profile for non-hadoop testing. > -- > > Key: HAWQ-1490 > URL: https://issues.apache.org/jira/browse/HAWQ-1490 > Project: Apache HAWQ > Issue Type: New Feature > Components: PXF, Tests >Reporter: John Gaskin >Assignee: Shivram Mani > Fix For: 2.3.0.0-incubating > > > A user should be able to create a PXF ext table with Demo profile that allows > her to check whether PXF service is functional in a given system without > relying on any backend data source. > This would serve as a profile to test PXF service/framework. The demo profile > could return some configured static data while invoking all the necessary > APIs/functions for the smoke test. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HAWQ-1490) PXF dummy text profile for non-hadoop testing.
[ https://issues.apache.org/jira/browse/HAWQ-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Gaskin updated HAWQ-1490: -- Description: A user should be able to create a PXF ext table with Demo profile that allows her to check whether PXF service is functional in a given system without relying on any backend data source. The demo profile could return some configured static data while invoking all the necessary APIs/functions for the smoke test. User may wish to modify this preconfigured data file such that the query then returns the modified content of the file (was: To test PXF right now, users have to set up, or have access to, a hadoop cluster. The purpose of this profile is so that any consumer can test PXF without needing to set up hadoop.) > PXF dummy text profile for non-hadoop testing. > -- > > Key: HAWQ-1490 > URL: https://issues.apache.org/jira/browse/HAWQ-1490 > Project: Apache HAWQ > Issue Type: New Feature > Components: PXF, Tests >Reporter: John Gaskin >Assignee: Vineet Goel > Fix For: 2.3.0.0-incubating > > > A user should be able to create a PXF ext table with Demo profile that allows > her to check whether PXF service is functional in a given system without > relying on any backend data source. The demo profile could return some > configured static data while invoking all the necessary APIs/functions for > the smoke test. User may wish to modify this preconfigured data file such > that the query then returns the modified content of the file -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HAWQ-1490) PXF dummy text profile for non-hadoop testing.
[ https://issues.apache.org/jira/browse/HAWQ-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Gaskin updated HAWQ-1490: -- Fix Version/s: 2.3.0.0-incubating > PXF dummy text profile for non-hadoop testing. > -- > > Key: HAWQ-1490 > URL: https://issues.apache.org/jira/browse/HAWQ-1490 > Project: Apache HAWQ > Issue Type: New Feature > Components: PXF, Tests >Reporter: John Gaskin >Assignee: Vineet Goel > Fix For: 2.3.0.0-incubating > > > A user should be able to create a PXF ext table with Demo profile that allows > her to check whether PXF service is functional in a given system without > relying on any backend data source. The demo profile could return some > configured static data while invoking all the necessary APIs/functions for > the smoke test. User may wish to modify this preconfigured data file such > that the query then returns the modified content of the file -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HAWQ-1490) PXF dummy text profile for non-hadoop testing.
John Gaskin created HAWQ-1490: - Summary: PXF dummy text profile for non-hadoop testing. Key: HAWQ-1490 URL: https://issues.apache.org/jira/browse/HAWQ-1490 Project: Apache HAWQ Issue Type: New Feature Components: PXF, Tests Reporter: John Gaskin Assignee: Vineet Goel To test PXF right now, users have to set up, or have access to, a hadoop cluster. The purpose of this profile is so that any consumer can test PXF without needing to set up hadoop. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HAWQ-1486) PANIC accessing PXF HDFS table
John Gaskin created HAWQ-1486:
-
Summary: PANIC accessing PXF HDFS table
Key: HAWQ-1486
URL: https://issues.apache.org/jira/browse/HAWQ-1486
Project: Apache HAWQ
Issue Type: Bug
Components: External Tables, PXF
Reporter: John Gaskin
Assignee: Vineet Goel
Fix For: 2.3.0.0-incubating
This code doesn't catch the case when churl_init_download() returns NULL. This
seems to trigger a segfault at libcurl level.
{code}
Looks like we failed to connect to PXF (?).
Piece of code in HAWQ handling cUrl calls (pxfutils.c):
100 static void process_request(ClientContext* client_context, char *uri)
101 {
102 size_t n = 0;
103 char buffer[RAW_BUF_SIZE];
104
105 print_http_headers(client_context->http_headers);
106 client_context->handle = churl_init_download(uri,
client_context->http_headers);
107 memset(buffer, 0, RAW_BUF_SIZE);
108 resetStringInfo(&(client_context->the_rest_buf));
109
110 /*
111 * This try-catch ensures that in case of an exception during the
"communication with PXF and the accumulation of
112 * PXF data in client_context->the_rest_buf", we still get to
terminate the libcurl connection nicely and avoid
113 * leaving the PXF server connection hung.
114 */
115 PG_TRY();
116 {
117 /* read some bytes to make sure the connection is established */
118 churl_read_check_connectivity(client_context->handle);
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
