Re: [DISCUSS] Drop Java 8 support

2024-04-25 Thread James Duong
If we dropped JDK 8, we could use the JDK to compile module-info.java files. Then we could remove the custom maven plugin we’re using for compiling module-info.java files for JPMS support and get better IDE integration (as what we’re doing currently somewhat shoe-horns module information

Re: Unsupported/Other Type

2024-04-10 Thread James Duong
It’s worth noting that this maps well to the User data type field in the XdbcTypeInfo APIs for Flight SQL. From: David Li Date: Wednesday, April 10, 2024 at 3:23 PM To: dev@arrow.apache.org Subject: Re: Unsupported/Other Type I think this should be an extension type, yes. It could be

[DISCUSS] Flight SQL Experimental status in docs

2024-03-21 Thread James Duong
Hi, We fairly recently merged a PR to remove the experimental status for Flight SQL from maven: https://github.com/apache/arrow/pull/39040 However our public documentation still has a warning saying Flight SQL is experimental: https://arrow.apache.org/docs/format/FlightSql.html “Flight SQL is

Re: [VOTE] Stateless prepared statements in FlightSQL

2024-03-21 Thread James Duong
+1 (non-binding) Thanks for the work on this Adam and Andrew! Get Outlook for Android From: David Li Sent: Thursday, March 21, 2024 8:40:10 AM To: dev@arrow.apache.org Subject: Re: [VOTE] Stateless prepared statements in FlightSQL +1

Re: [ANNOUNCE] New Arrow committer: Bryce Mecum

2024-03-18 Thread James Duong
Congratulations Bryce! From: Dane Pitkin Date: Monday, March 18, 2024 at 7:28 AM To: dev@arrow.apache.org Subject: Re: [ANNOUNCE] New Arrow committer: Bryce Mecum Congratulations, Bryce!! On Mon, Mar 18, 2024 at 9:18 AM David Li wrote: > Congrats Bryce! > > On Mon, Mar 18, 2024, at 08:52,

Re: [VOTE] Explicit session management for Flight RPC

2024-02-15 Thread James Duong
+1 From: Sutou Kouhei Date: Thursday, February 15, 2024 at 12:58 PM To: dev@arrow.apache.org Subject: Re: [VOTE] Explicit session management for Flight RPC +1 In "[VOTE] Explicit session management for Flight RPC" on Wed, 14 Feb 2024 11:38:24 -0500, "David Li" wrote: > Paul Nienaber

Re: [DISCUSS] Flight RPC: add 'fallback' URI scheme

2024-02-12 Thread James Duong
This seems like a good idea, and also improves consistency with clients that erroneously assumed that the service endpoint was always in the list of endpoints. From: Antoine Pitrou Date: Monday, February 12, 2024 at 6:05 AM To: dev@arrow.apache.org Subject: Re: [DISCUSS] Flight RPC: add

Re: [VOTE] Accept donation of Comet Spark native engine

2024-01-27 Thread James Duong
+1 (non-binding) Get Outlook for Android From: Matt Topol Sent: Saturday, January 27, 2024 3:22:01 PM To: dev@arrow.apache.org Subject: Re: [VOTE] Accept donation of Comet Spark native engine +1 (binding) On Sat, Jan 27, 2024, 6:00 PM

Re: ADBC: xdbc_data_type and xdbc_sql_data_type

2024-01-11 Thread James Duong
data always comes back as Arrow (unlike ODBC and JDBC where you can get a cell as whatever the ODBC/JDBC conversion tables allow). From: Curt Hagenlocher Date: Thursday, January 11, 2024 at 11:04 AM To: dev@arrow.apache.org Cc: James Duong Subject: Re: ADBC: xdbc_data_type and xdbc_sql_data_type

Re: [VOTE] Accept donation of flightsql-odbc

2024-01-05 Thread James Duong
+1 From: Santiago Mota Date: Friday, January 5, 2024 at 7:49 AM To: dev@arrow.apache.org Subject: Re: [VOTE] Accept donation of flightsql-odbc +1 Enviado desde Yahoo Mail con Android El vie, ene 5, 2024 a 16:41, David Li escribió: Hello, This vote is to determine if the Arrow PMC is in

Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System

2023-12-13 Thread James Duong
r the memory > module) that would be best. > > On Wed, Dec 13, 2023, at 12:33, James Duong wrote: > > For the work on modularization, I’ve merged the flight-grpc and > > flight-core modules. I haven’t moved any other packages. > > > > I also encountered this problem w

Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System

2023-12-13 Thread James Duong
not clear to > me anyways that the current split would actually be helpful if we do ever > want to support Flight without gRPC. > > On Tue, Dec 12, 2023, at 14:21, James Duong wrote: > > An update on this work. > > > > I’ve been able to update the following to JPMS modules now: >

Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System

2023-12-12 Thread James Duong
of this (currently we only have Flight using grpc in Java). After Flight I’d take a look at the modules that have native code: * arrow-c-data * arrow-orc * arrow-dataset * arrow-gandiva From: James Duong Date: Tuesday, December 5, 2023 at 1:39 PM To: dev@arrow.apache.org Subject

Re: [DISCUSS] Flight SQL as experimental

2023-12-06 Thread James Duong
+1 from me. It's used in a good number of databases now. Get Outlook for Android From: David Li Sent: Wednesday, December 6, 2023 9:59:54 AM To: dev@arrow.apache.org Subject: [DISCUSS] Flight SQL as experimental Flight SQL has been

Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System

2023-12-05 Thread James Duong
wrote: > Thanks James for delving into this mess. > > It looks like this change is unavoidable if we want to modularize? I think > this is OK. Will the CLI argument change as we continue modularizing, or is > this the only change that will be needed? > > On Mon, Dec 4, 2023,

Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System

2023-12-04 Thread James Duong
and requires refactoring much of the memory module code and implementing a module using the foreign memory interface. From: James Duong Date: Tuesday, November 28, 2023 at 6:48 PM To: dev@arrow.apache.org Subject: Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System Hi, I’ve

Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System

2023-11-28 Thread James Duong
movement, new command-line argument requirements) happens within one major Arrow version. From: James Duong Date: Tuesday, November 21, 2023 at 1:16 PM To: dev@arrow.apache.org Subject: Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System I’m following up on this topic

Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System

2023-11-21 Thread James Duong
I’m following up on this topic. David has a PR from last year that’s done much of the heavy lifting for refactoring the codebase to be package-friendly. https://github.com/apache/arrow/pull/13072 What’s changed since and what’s left: * New components have been added (Flight SQL for

Re: [ANNOUNCE] New Arrow committer: James Duong

2023-11-16 Thread James Duong
Thank you, everyone! From: Rok Mihevc Date: Thursday, November 16, 2023 at 7:14 AM To: dev@arrow.apache.org Subject: Re: [ANNOUNCE] New Arrow committer: James Duong Congrats James! On Thu, Nov 16, 2023 at 3:58 PM Kevin Gurney wrote: > Congratulations, Ja

Re: DISCUSS: [FlightSQL] Catalog support

2023-02-14 Thread James Duong
2 18:12:06 +0000, James Duong wrote: > Hi David, > > I've written up the URI parsing in C++ and started adding session management > messages. I'm also planning on having the ClientCookieMiddlewareFactory be > able to report if sessions are enabled on the server. > > I (or a

Re: DISCUSS: ADBC Press Release

2023-01-17 Thread James Duong
https://arrow.apache.org/blog/2023/01/05/introducing-arrow-adbc/ > > [2] > > > https://github.com/apache/arrow-site/blob/master/_posts/2023-01-05-introducing-arrow-adbc.md > > > > On Wed, Jan 11, 2023 at 8:02 AM James Duong > > wrote: > > > >> Hi, > >

DISCUSS: ADBC Press Release

2023-01-10 Thread James Duong
Hi, In the ADBC blog entry that Flight SQL was mentioned as a vendor-specific protocol and s Dremio is mentioned in the same sentence. The intent of the Flight SQL was to be database agnostic and this sort of implies Flight SQL as a Dremio-specific protocol which is not really what we want.

Re: [Java]: Failures building Java pom

2022-12-13 Thread James Duong
uld try the instructions at > https://arrow.apache.org/docs/developers/java/index.html for the 10.0 > instructions. > > Hope that helps > > On Mon, Dec 12, 2022 at 7:18 PM James Duong .invalid> > wrote: > > > I have been trying to build Java from the root pom and am see

[Java]: Failures building Java pom

2022-12-12 Thread James Duong
Plasma Client SUCCESS [ 6.158 s] [INFO] Arrow Flight ... SUCCESS [ 2.107 s] [INFO] Arrow Flight Core .. FAILURE [ 27.441 s] Does anyone know why this might be failing? Thanks -- *James Duong

Re: DISCUSS: [FlightSQL] Catalog support

2022-12-12 Thread James Duong
;> out >> > the Arrow community is already hard at work on a solution. >> > >> > Andrew >> > >> > [1] https://github.com/influxdata/influxdb_iox/issues/6102 >> > >> > On Wed, Nov 30, 2022 at 7:17 PM Gavin Ray wrote: >> > >

Re: DISCUSS: [FlightSQL] Catalog support

2022-11-30 Thread James Duong
mapping from URI parameters and fields to session data > > > > On Tue, Nov 22, 2022, at 17:45, James Duong wrote: > > Just following up on this and if there are any thoughts. > > > > The purpose would be to standardize how we specify access to some named > > lo

Re: DISCUSS: [FlightSQL] Catalog support

2022-11-22 Thread James Duong
to specifying a resource in an HTTP URL (ie an endpoint) which should make it easy for end users to work with and modify. On Fri, Nov 18, 2022 at 3:17 PM James Duong wrote: > As for surfacing catalogs itself, perhaps we allow the URI take in a path > and treat that as a way of specifying a multi

Re: DISCUSS: [FlightSQL] Catalog support

2022-11-18 Thread James Duong
ut perhaps we can > > >> find a way to make it not tied to the connection itself? For instance, > > in > > >> the same way transactions were implemented (as a handle). Or rather, > > >> instead of adding connection statefulness to Flight RPC, I'd rather >

DISCUSS: [FlightSQL] Catalog support

2022-11-09 Thread James Duong
for Flight SQL applications that need this) - Related to the above, expand the connection URL and Java builder to allow arbitrary application-specific properties. - Add optional RPCs for changing the catalog and relevant error codes if this is not permitted. -- *James Duong* Lead Software Developer

DISCUSS: [FlightSQL] Data-source specific connection context

2022-10-21 Thread James Duong
in mind (https://github.com/apache/arrow/pull/8572 ) Does the ADBC driver for Flight SQL also do this? -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.562.6082 | jam...@bitquilltech.com https://www.bitquilltech.com This email message is for the sole use

Re: [VOTE] Substrait for Flight SQL

2022-09-01 Thread James Duong
: Accept the proposal > > > > [ ] 0 : No opinion > > > > [ ] -1 : Do not accept this proposal because... > > > > > > > > [1]: https://substrait.io/ > > > > [2]: > https://lists.apache.org/thread/l6j0nc43y7czs2m4kpzrckmrtgr9qs9z > >

Re: Re: Help needed with PR #13659: Fixing build/unit test issues in msvc/win32

2022-08-02 Thread James Duong
out the warnings in > the > > > headers. > > > > > > Regards, > > > Arkadiy > > > > > > From: dev@arrow.apache.org At: 07/22/22 10:18:09 UTC-4:00To: > > > dev@arrow.apache.org > > > Subject: Re: Help needed with PR #13659: Fi

[DISCUSS][FlightRPC] Lifetime of endpoints

2022-08-02 Thread James Duong
headers from the originating request can be re-used. -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.562.6082 | jam...@bitquilltech.com https://www.bitquilltech.com This email message is for the sole use of the intended recipient(s) and may contain confidential

[FlightSQL][JDBC] Additional changes to the JDBC driver

2022-08-02 Thread James Duong
-driver branch? -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.562.6082 | jam...@bitquilltech.com https://www.bitquilltech.com This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any

Re: Help needed with PR #13659: Fixing build/unit test issues in msvc/win32

2022-07-25 Thread James Duong
gt; 2) Let those users who care about 32 bits worry about the warnings in > the > >> > headers. > >> > > >> > Regards, > >> > Arkadiy > >> > > >> > From: dev@arrow.apache.org At: 07/22/22 10:18:09 UTC-4:00To: > >

Re: Help needed with PR #13659: Fixing build/unit test issues in msvc/win32

2022-07-22 Thread James Duong
> From: dev@arrow.apache.org At: 07/22/22 10:18:09 UTC-4:00To: > dev@arrow.apache.org > Subject: Re: Help needed with PR #13659: Fixing build/unit test issues in > msvc/win32 > > > Ah, that's a good point. Then we should probably use explicit casts. > > > Le 22/07

Re: Help needed with PR #13659: Fixing build/unit test issues in msvc/win32

2022-07-22 Thread James Duong
n 3 > >>>>> > >>>>> E ImportError: > >> dlopen(/usr/local/lib/python3.9/site-packages/pyarrow/ > >>>>> lib.cpython-39-darwin.so, 2): Symbol not found: > >>>>> __ZN6google8protobuf8internal16InternalMetadataD1Ev >

Re: Help needed with PR #13659: Fixing build/unit test issues in msvc/win32

2022-07-21 Thread James Duong
buf::MessageLite::~MessageLite() in > > > > libopentelemetry_proto.a(common.pb.cc.o) > > > > google::protobuf::MessageLite::~MessageLite() in > > > > libopentelemetry_proto.a(resource.pb.cc.o) > > > > ld: symbol(s) not found for architecture

Re: Help needed with PR #13659: Fixing build/unit test issues in msvc/win32

2022-07-21 Thread James Duong
yAlt (missing: Snappy_LIB Snappy_INCLUDE_DIR) > > > -- Building snappy from source > > > CMake Error at C:/Program > > > > > > Files/CMake/share/cmake-3.23/Modules/FindPackageHandleStandardArgs.cmake:230 > > > (message): > > > Could NOT find OpenSSL, t

Re: [Flight][Java][JDBC] IP clearance of Flight JDBC Driver

2022-07-12 Thread James Duong
story > > > > [1]: https://incubator.apache.org/ip-clearance/arrow-rust-ballista.html > > [2]: https://lists.apache.org/thread/khk8b06t5wrsg2xmprcqglb7dl76x20r > > > > On Thu, Apr 7, 2022, at 17:02, James Duong wrote: > >> I have started a PR for merging to the n

Re: Cpp Win32/MSVC build

2022-07-03 Thread James Duong
if (_BitScanForward(, value)) { > > return static_cast(index); > > @@ -245,7 +252,7 @@ static inline int CountTrailingZeros(uint64_t value) > { > > #if defined(__clang__) || defined(__GNUC__) > > if (value == 0) return 64; > >return static_cast(_

Re: [FlightSQL] Structured/Serialized representation of query (like JSON) rather than SQL string possible?

2022-06-30 Thread James Duong
is a property in GetSqlInfo. > >> > >> > > >> > >> > > >> > >> > This sounds reasonable. > >> > >> > > >> > >> > > >> > >> >> What happens to client code written prior to ch

Re: [VOTE] Accept donation of Flight SQL JDBC driver

2022-06-30 Thread James Duong
/lists.apache.org/thread/q5mn906m5788zxppjpcqvltxppc4sol0 > > [2]: > https://svn.apache.org/repos/asf/incubator/public/trunk/content/ip-clearance/arrow-flight-sql-jdbc-driver.xml > > [3]: https://github.com/apache/arrow/pull/12830 > > > > Best, > > David > --

Re: [VOTE] Extend Arrow Flight SQL with more SQL type info in schemas

2022-04-20 Thread James Duong
> https://lists.apache.org/thread/ynlyjcc5k66dbjphv485nl2nt6ztbbzt > [2]: https://github.com/apache/arrow/pull/12254 > [3]: https://github.com/apache/arrow/pull/12747 > > Thanks, > David -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.562.6

Re: [DISCUSS] A book about Apache Arrow

2022-04-20 Thread James Duong
801071039/dp/1801071039/ > ). > > Thanks much for your time everyone! Hope to hear back from someone soon. > > Matthew Topol Vice President, Principal Software Architect > mto...@factset.com<mailto:mto...@factset.com> T 203.810.1804 FactSet > Research Systems >

Re: Remote datasets

2022-04-12 Thread James Duong
st. > > I was trying to browse the JIRA issues, but the future picture wasn't clear > based on that > > Best regards, > Adam Lippai > -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.562.6082 | jam...@bitquilltech.com https://www.bitqu

Re: [Flight][Java][JDBC] IP clearance of Flight JDBC Driver

2022-04-07 Thread James Duong
. (Development can continue in the meantime, since I see > that it's now proceeding on the current GitHub PR, but I think we just need > a stable target to merge for the IP clearance) > > > > > > [1]: > https://incubator.apache.org/ip-clearance/ip-clearance-template.html > > >

[Flight][Java][JDBC] IP clearance of Flight JDBC Driver

2022-03-30 Thread James Duong
Following up on today's sync-up: We're looking to start IP clearance of the JDBC driver in https://github.com/apache/arrow/pull/12254 I believe we discussed merging the PR into a branch to start the process. What else is involved in this process? -- *James Duong* Lead Software Developer Bit

[C++][Java][FlightSQL] GetSqlInfo properties

2022-03-21 Thread James Duong
to support these properties, it'd probably be best to treat these as non-custom, but at the expense of making bridge-specific concepts "standard". I've also observed that there are missing enums and enum values in the C++ definitions of the properties in arrow/flight/sql/types.h -- *James Duong* Lea

Re: [FlightSQL] Higher-level facade API to increase adoption/audience? Or does this belong as a personal project

2022-03-15 Thread James Duong
> > But the thing that excites me most about FlightSQL, isn't its > > performance > > >> > (always nice to have), but that it's a language-agnostic standard > for > > >> data > > >> > access. > > >> > > > >> > That has broad implications -- for

Re: [VOTE] Release Apache Arrow 7.0.0 - Java artifacts

2022-03-11 Thread James Duong
> > > > > You can find them at > > > > > > https://repository.apache.org/content/repositories/staging/org/apache/arrow/ > > > . > > > > > > Could someone start a vote for them? Any PMC member can > > > publish them by press

Re: [PROPOSAL][RELEASE] Arrow 7.0.1

2022-03-10 Thread James Duong
sure how procedures work here, but is it possible to > just vote and upload the missing 7.0.0 artifacts, instead of going through > the whole release process? > > > > On Wed, Mar 9, 2022, at 13:23, James Duong wrote: > >> Hi, > >> > >> I would like to pro

[PROPOSAL][RELEASE] Arrow 7.0.1

2022-03-09 Thread James Duong
Hi, I would like to propose an Arrow 7.0.1 release. The main reason is to make Flight SQL Java artifacts available on maven central ( https://issues.apache.org/jira/browse/ARROW-15746). I'd be happy to help facilitate this (and learn the release process) for this. -- *James Duong* Lead

Re: [FlightSQL] Structured/Serialized representation of query (like JSON) rather than SQL string possible?

2022-03-04 Thread James Duong
PM Gavin Ray wrote: > @James Duong > > You are absolutely right, I realized this and confirmed whether this > would be possible with Jacques to double-check. > It would amount to what I might call "dollar-store Substrait." It's not > elegant or a good solution, bu

Re: [FlightSQL] Structured/Serialized representation of query (like JSON) rather than SQL string possible?

2022-03-03 Thread James Duong
eries is as SQL strings. > > > > > > Is there any kind of lower-level API that can be used to express > > operations? > > > > > > IE instead of "SELECT name FROM user" > > > > > > A structured representation like: > >

Re: Arrow sync call March 2 at 12:00 US/Eastern, 17:00 UTC

2022-03-02 Thread James Duong
> GeoData JSON vs Binary > >>> > > > >>> > > - Binary doesn’t seem very hard in the majority of cases > >>> > > > >>> > > - base64 might add unnecessary overhead > >>> > > > >>> > > > >>&

Re: Flight/FlightSQL Optimization for Small Results?

2022-03-01 Thread James Duong
nfo. I think if a > > server does return a ticket then it should be able to handle it. > > > > [1] https://github.com/apache/arrow/blob/master/format/Schema.fbs#L67 > > > > > > On Mon, Feb 28, 2022 at 11:30 AM James Duong > > wrote: > > > >> This se

Re: Flight/FlightSQL Optimization for Small Results?

2022-02-28 Thread James Duong
gt; wrote: > >> > > >> >> I'm rereviewing the Flight SQL interfaces, and I'm not sure if I'm > >> missing > >> >> it but is there any optimization for small results? My concern is > that > >> the > >> >> overhead of the RPCs

Re: [FlightSQL] Flight as a cross-language JDBC driver?

2022-02-22 Thread James Duong
o > re-use existing JDBC drivers, albeit at a bit of a performance cost right? > > Seems like it could be useful, but I thought there might be a reason why > someone hadn't done this (Chesterton's Fence) > Thank you =) > > Gavin Ray. > -- *James Duong* Lead Softwar

Re: [RESULT][VOTE] Proposed addition to Arrow Flight: Arrow Flight RPC

2022-01-04 Thread James Duong
t in time for > > the holidays, Flight SQL has now been merged into the main branch, thanks > > again to everyone who participated! > > > > I will begin reviewing the additional proposals next. > > > > -David > > > > On Fri, Dec 17, 2021, at 17:07, J

Re: [RESULT][VOTE] Proposed addition to Arrow Flight: Arrow Flight RPC

2021-12-17 Thread James Duong
tly you mean by additional column metadata, > but if it's just going to be encoded into the key-value metadata then I > don't see a problem there. (As in: it sounds like it fits in the Field > class given it's encoded in the Field metadata!) > > -David > > On Thu, Dec 16, 2021, at

Re: [RESULT][VOTE] Proposed addition to Arrow Flight: Arrow Flight RPC

2021-12-16 Thread James Duong
etween the two > languages? > > > > > > > >> > > > > > > > > > > >> > > > On Tue, Dec 7, 2021 at 1:35 PM David Li < > > > > lidav...@apache.org> > > > > > > > >> wrote: > > > &

getFlightInfo behavior

2021-07-27 Thread James Duong
be able to retrieve from any endpoint in any order (and do so concurrently) without having to order the data at the end. If the order of the data is significant, I'd expect the producer to just return one endpoint with data in the correct order. Is this the case? -- *James Duong* Lead Software

[FlightRPC][C++][Python] Exposing internal middlewares

2020-11-16 Thread James Duong
less efficient. The latter is obviously less convoluted, but brings up issues if we ever change the Python implementation from being a wrapper around C++. -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.562.6082 | jam...@bitquilltech.com https

Re: Arrow 2.0.0 versioning

2020-11-03 Thread James Duong
Thanks. I ran the command and created a PR: https://github.com/apache/arrow/pull/8577 On Mon, Nov 2, 2020 at 11:14 PM Krisztián Szűcs wrote: > On Tue, Nov 3, 2020 at 5:07 AM James Duong > wrote: > > > > I can go ahead and make the change, but should this get force

[Discuss] Arrow Release Schedule

2020-11-02 Thread James Duong
Hello, My understanding is that Arrow releases are 3 months apart. Are there any plans for a more frequent release cadence? Do we have a guide for what goes into major releases vs. minor releases vs. patch releases? Thanks, -- *James Duong* Lead Software Developer Bit Quill Technologies Inc

Re: Closing of Server Resources

2020-11-02 Thread James Duong
quot;close" Action to the server which > > would invoke the closeHandler for release of the session resources. > > > > We would then maintain a clear distinction between stateless > FlightServers > > and those that opt into session headers where there may be state, and

Re: Arrow 2.0.0 versioning

2020-11-02 Thread James Duong
> On Mon, Nov 2, 2020 at 6:12 PM James Duong > wrote: > > > > Hi, > > > > I noticed that in the Java POM files, the version in master is still > 2.0.0 > > even after the release. This patch updated versions to 3.0.0-SNAPSHOT in > > o

Arrow 2.0.0 versioning

2020-11-02 Thread James Duong
Hi, I noticed that in the Java POM files, the version in master is still 2.0.0 even after the release. This patch updated versions to 3.0.0-SNAPSHOT in other languages: https://github.com/apache/arrow/commit/b1f36acca85d0845c1e64c0a3270651d4a1467b7 -- *James Duong* Lead Software Developer Bit

Re: [FlightRPC][Java] HTTP cookie support

2020-10-30 Thread James Duong
for the Set-Cookie header. On Fri, Oct 30, 2020 at 7:05 AM David Li wrote: > Hey James, > > I looked over the PR and it seems quite straightforward - thanks for > contributing this. > > Best, > David > > On 10/29/20, James Duong wrote: > > Hi all, > > >

[FlightRPC][Java] HTTP cookie support

2020-10-29 Thread James Duong
. -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.562.6082 | jam...@bitquilltech.com https://www.bitquilltech.com This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review

Re: mutual TLS peer_identity in arrow flight

2020-10-26 Thread James Duong
ht Authentication Handler, the lower level > identity > > would be ignored (but that is the case in the current implementation > > already). > > > > I can send out a PR unless there is another solution in the works > -- *James Duong* Lead Software Developer Bit Qu

Flight gRPC version and disabling server verification in C++ [was Re: 2.0.0 release timeline: October 9]

2020-10-08 Thread James Duong
s > > > > not > > > > > a bad experience, and if the user doesn't like it, presumably they > can > > > > > upgrade system gRPC and rebuild. > > > > > > > > How do you upgrade system gRPC without potentially breaking other > > &g

Re: 2.0.0 release timeline: October 9

2020-10-07 Thread James Duong
with requiring a < 1 year old version of gRPC > > > > On Wed, Oct 7, 2020 at 2:23 PM Antoine Pitrou > wrote: > >> > >> > >> Le 07/10/2020 à 21:19, James Duong a écrit : > >>> Hi Neal, > >>> > >>> Are you the

Re: 2.0.0 release timeline: October 9

2020-10-07 Thread James Duong
che.org/confluence/display/ARROW/Arrow+2.0.0+Release > , > >> > there are still 178 issues tagged for 2.0 that are not yet started. > That > >> > seems... ambitious. Please do go through the backlog and push to the > >> next > >> > release (i.

Re: [FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-10-05 Thread James Duong
dation? (Also, is there > a bug report for gRPC/would you like to file one?) > > For #2, I think you can get cmake to pass -D flags, perhaps you can > get it to define a symbol you can check (though that is maybe not a > preferable solution). > > David > > On 10/5/20, James

Re: [FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-10-05 Thread James Duong
set in various config files. > > Best, > David > > [1]: https://arrow.apache.org/docs/developers/cpp/building.html > [2]: > https://arrow.apache.org/docs/developers/cpp/building.html#bundled-dependency-versions > > On 10/2/20, James Duong wrote: > > Hi David, > &

Re: [FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-10-02 Thread James Duong
with 1.30.x - Where do we specify which version of gRPC we depend on? In java it's in maven and looks to be 1.30.2. - The Java implementation looks fairly straightforward. - Python implementation is pending. - Tests are pending. On Wed, Sep 30, 2020 at 8:12 AM James Duong wrote

Re: [FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-09-30 Thread James Duong
Will do David. I've created a JIRA for the TLS_SNI extension as well: https://issues.apache.org/jira/browse/ARROW-10144 On Wed, Sep 30, 2020 at 7:52 AM David Li wrote: > Hi James, > > Please feel free to tag me as a reviewer if needed. > > Best, > David > > On 9/2

[FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-09-28 Thread James Duong
Hi Arrow-Dev, I've created a JIRA for supporting using Flight clients to connect to Flight servers without verifying the server certificate. This is something I've seen done frequently for other connectivity tools such as JDBC drivers. I'll be looking to implement this one for the and hopefully

Re: [Flight Format] Authentication Redesign

2020-09-04 Thread James Duong
va) and much more limited (unless recent > versions changed this). C++/Python might function better as a set of > middleware implementations in the client which can attach/read headers > as necessary. > > David > > On 9/2/20, James Duong wrote: > > Looking tow

Re: [Flight Format] Authentication Redesign

2020-09-02 Thread James Duong
ut seeing as I've been commenting > so far - the changes as summarized in the presentation (+I think the > latest comments in the doc) look good to me, thanks for working > through the proposal with us. > > Best, > David > > On 9/1/20, James Duong wrote: > > Hi, > &g

Re: [Flight Format] Authentication Redesign

2020-09-01 Thread James Duong
James Duong wrote: > Hi everyone, > I've updated the PR and responded to comments in the proposal document. > > The PR now makes handshake optional and sends auth information with every > request. > The client now needs to supply a CredentialCallOption containing auth > infor

Re: Authentication Redesign

2020-08-26 Thread James Duong
CallCredentials under the hood, and use that to write headers. On Thu, Aug 20, 2020 at 2:14 PM James Duong wrote: > Comments should be enabled now. > > Thanks for the feedback so far. > -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.56

Re: Authentication Redesign

2020-08-20 Thread James Duong
Comments should be enabled now. Thanks for the feedback so far.

Re: Authentication Redesign

2020-08-20 Thread James Duong
...@dremio.com > > > > On Wed, Aug 19, 2020 at 9:43 PM James Duong > wrote: > > > Hi Arrow-Dev, > > > > I've written up a proposal to make some enhancements to the > authentication > > process. I've captured the overall goals on JIRA here: > &

Authentication Redeisgn

2020-08-19 Thread James Duong
) as part of the proposal. I've written a POC of the proposed changes here for authentication only (not the handshake): https://github.com/apache/arrow/pull/7994 Thanks! -- *James Duong* Lead Software Developer Bit Quill Technologies Inc. Direct: +1.604.562.6082 | jam...@bitquilltech.com https