Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/15659
@JoshRosen thank you so much! That's awesome. I've had some off-line chats
about why I think we should merge this for 2.1 as well (hopefully @rxin can
chime in here with his thoughts) but I think the general argument is that:
I'd like to argue for its inclusion in 2.1 as it seems to follow both the
official and defacto conventions for inclusion:
Namely this PR existed before branch cut and is primarily additive, and the
idea it's self has been proposed since 2014 in various forms. Also defacto
we've added much of the streaming functionality between RCs during 2.0 which
was even larger than this.
If we want to publish to PyPI for 2.2 (which I think would be awesome) - it
would probably be best for us to have a chance to have the pip installable
artifacts available in a prior release so that we can have an opportunity to
work out any unexpected kinks before going ahead with full PyPI publishing
which might reach a different audience.
Thank you so much for everyone involved @rgbkrk, @nchammas , @jhlch,
@felixcheung, @viirya, @davies , @minrk, @mariusvniekerk - this is the PR I'm
most excited about getting in recently :dancer: :smile: :package:
:dancing_women: :four_leaf_clover: :+1: :tea: :cat: :cat2: :joy_cat:
:smile_cat: :snake: #2ammytimesorryfortheemoji #pip4life
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
