spark git commit: [SPARK-13474][PROJECT INFRA] Update packaging scripts to push artifacts to home.apache.org
Repository: spark
Updated Branches:
refs/heads/master ad615291f -> f77dc4e1e
[SPARK-13474][PROJECT INFRA] Update packaging scripts to push artifacts to
home.apache.org
Due to the people.apache.org -> home.apache.org migration, we need to update
our packaging scripts to publish artifacts to the new server. Because the new
server only supports sftp instead of ssh, we need to update the scripts to use
lftp instead of ssh + rsync.
Author: Josh Rosen
Closes #11350 from JoshRosen/update-release-scripts-for-apache-home.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f77dc4e1
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f77dc4e1
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/f77dc4e1
Branch: refs/heads/master
Commit: f77dc4e1e202942aa8393fb5d8f492863973fe17
Parents: ad61529
Author: Josh Rosen
Authored: Fri Feb 26 18:40:00 2016 -0800
Committer: Josh Rosen
Committed: Fri Feb 26 18:40:00 2016 -0800
--
dev/create-release/release-build.sh | 60 +++-
1 file changed, 44 insertions(+), 16 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/spark/blob/f77dc4e1/dev/create-release/release-build.sh
--
diff --git a/dev/create-release/release-build.sh
b/dev/create-release/release-build.sh
index 2fd7fcc..c08b6d7 100755
--- a/dev/create-release/release-build.sh
+++ b/dev/create-release/release-build.sh
@@ -23,8 +23,8 @@ usage: release-build.sh
Creates build deliverables from a Spark commit.
Top level targets are
- package: Create binary packages and copy them to people.apache
- docs: Build docs and copy them to people.apache
+ package: Create binary packages and copy them to home.apache
+ docs: Build docs and copy them to home.apache
publish-snapshot: Publish snapshot release to Apache snapshots
publish-release: Publish a release to Apache release repo
@@ -64,13 +64,16 @@ for env in ASF_USERNAME ASF_RSA_KEY GPG_PASSPHRASE GPG_KEY;
do
fi
done
+# Explicitly set locale in order to make `sort` output consistent across
machines.
+# See https://stackoverflow.com/questions/28881 for more details.
+export LC_ALL=C
+
# Commit ref to checkout when building
GIT_REF=${GIT_REF:-master}
# Destination directory parent on remote server
REMOTE_PARENT_DIR=${REMOTE_PARENT_DIR:-/home/$ASF_USERNAME/public_html}
-SSH="ssh -o ConnectTimeout=300 -o StrictHostKeyChecking=no -i $ASF_RSA_KEY"
GPG="gpg --no-tty --batch"
NEXUS_ROOT=https://repository.apache.org/service/local/staging
NEXUS_PROFILE=d63f592e7eac0 # Profile for Spark staging uploads
@@ -97,7 +100,20 @@ if [ -z "$SPARK_PACKAGE_VERSION" ]; then
fi
DEST_DIR_NAME="spark-$SPARK_PACKAGE_VERSION"
-USER_HOST="$asf_usern...@people.apache.org"
+
+function LFTP {
+ SSH="ssh -o ConnectTimeout=300 -o StrictHostKeyChecking=no -i $ASF_RSA_KEY"
+ COMMANDS=$(cat
spark git commit: [SPARK-13474][PROJECT INFRA] Update packaging scripts to push artifacts to home.apache.org
Repository: spark
Updated Branches:
refs/heads/branch-1.6 a57f87ee4 -> 8a43c3bfb
[SPARK-13474][PROJECT INFRA] Update packaging scripts to push artifacts to
home.apache.org
Due to the people.apache.org -> home.apache.org migration, we need to update
our packaging scripts to publish artifacts to the new server. Because the new
server only supports sftp instead of ssh, we need to update the scripts to use
lftp instead of ssh + rsync.
Author: Josh Rosen
Closes #11350 from JoshRosen/update-release-scripts-for-apache-home.
(cherry picked from commit f77dc4e1e202942aa8393fb5d8f492863973fe17)
Signed-off-by: Josh Rosen
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8a43c3bf
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/8a43c3bf
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/8a43c3bf
Branch: refs/heads/branch-1.6
Commit: 8a43c3bfbcd9d6e3876e09363dba604dc7e63dc3
Parents: a57f87e
Author: Josh Rosen
Authored: Fri Feb 26 18:40:00 2016 -0800
Committer: Josh Rosen
Committed: Fri Feb 26 18:40:23 2016 -0800
--
dev/create-release/release-build.sh | 60 +++-
1 file changed, 44 insertions(+), 16 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/spark/blob/8a43c3bf/dev/create-release/release-build.sh
--
diff --git a/dev/create-release/release-build.sh
b/dev/create-release/release-build.sh
index cb79e9e..2c3af6a 100755
--- a/dev/create-release/release-build.sh
+++ b/dev/create-release/release-build.sh
@@ -23,8 +23,8 @@ usage: release-build.sh
Creates build deliverables from a Spark commit.
Top level targets are
- package: Create binary packages and copy them to people.apache
- docs: Build docs and copy them to people.apache
+ package: Create binary packages and copy them to home.apache
+ docs: Build docs and copy them to home.apache
publish-snapshot: Publish snapshot release to Apache snapshots
publish-release: Publish a release to Apache release repo
@@ -64,13 +64,16 @@ for env in ASF_USERNAME ASF_RSA_KEY GPG_PASSPHRASE GPG_KEY;
do
fi
done
+# Explicitly set locale in order to make `sort` output consistent across
machines.
+# See https://stackoverflow.com/questions/28881 for more details.
+export LC_ALL=C
+
# Commit ref to checkout when building
GIT_REF=${GIT_REF:-master}
# Destination directory parent on remote server
REMOTE_PARENT_DIR=${REMOTE_PARENT_DIR:-/home/$ASF_USERNAME/public_html}
-SSH="ssh -o ConnectTimeout=300 -o StrictHostKeyChecking=no -i $ASF_RSA_KEY"
GPG="gpg --no-tty --batch"
NEXUS_ROOT=https://repository.apache.org/service/local/staging
NEXUS_PROFILE=d63f592e7eac0 # Profile for Spark staging uploads
@@ -97,7 +100,20 @@ if [ -z "$SPARK_PACKAGE_VERSION" ]; then
fi
DEST_DIR_NAME="spark-$SPARK_PACKAGE_VERSION"
-USER_HOST="$asf_usern...@people.apache.org"
+
+function LFTP {
+ SSH="ssh -o ConnectTimeout=300 -o StrictHostKeyChecking=no -i $ASF_RSA_KEY"
+ COMMANDS=$(cat
