xhochy commented on a change in pull request #2268:
URL: https://github.com/apache/iceberg/pull/2268#discussion_r582717176
##########
File path: python/setup.py
##########
@@ -15,8 +15,28 @@
# specific language governing permissions and limitations
# under the License.
+import sys
+
from setuptools import setup
+DEPENDENCIES = ['botocore==1.20.14',
+ 'boto3==1.17.14',
+ 'fastavro==1.3.2',
+ 'hmsclient==0.1.1',
+ 'mmh3==3.0.0',
+ 'pyparsing==2.4.7',
+ 'python-dateutil==2.8.1',
+ 'pytz==2021.1',
+ 'requests==2.25.1',
+ 'retrying==1.3.3',
+ 'pyarrow==2.0.0'
+ ]
+
Review comment:
> This is my preference too. I suppose dependabot + apache is a no-go
though :-(
You can build a poor mans dependendabot using Github actions as I did in
https://github.com/conda-forge/miniforge/pull/117 The only limitation with
running it in the Apache org will be that CI doesn't run automatically (you
need to close/reopen the PR to trigger it).
> Is there a source of arrow nightlies or would it require building arrow? I
am also looking to spend more time on the python side here, curious to see if
there is anything on your todo list I can help w/?
We have a conda channel called `arrow-nightlies` and there are also `pip`
packages as documented in
https://arrow.apache.org/docs/python/install.html?highlight=nightlies#installing-nightly-packages
One thing we did with a lot of other packages is that we added a nightly job
to the arrow project itself so that we get reports over there if we break an
upstream library. Worth looking for e.g. `turbodbc` in the Arrow sources.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
