Github user JoshRosen commented on a diff in the pull request:
https://github.com/apache/spark/pull/11350#discussion_r54168890
--- Diff: dev/create-release/release-build.sh ---
@@ -178,11 +198,17 @@ if [[ "$1" == "package" ]]; then
# Copy data
dest_dir="$REMOTE_PARENT_DIR/${DEST_DIR_NAME}-bin"
echo "Copying release tarballs to $dest_dir"
- $SSH $USER_HOST mkdir $dest_dir
- rsync -e "$SSH" spark-* $USER_HOST:$dest_dir
- echo "Linking /latest to $dest_dir"
- $SSH $USER_HOST rm -f "$REMOTE_PARENT_DIR/latest"
- $SSH $USER_HOST ln -s $dest_dir "$REMOTE_PARENT_DIR/latest"
+ set -x
+ # Put to new directory:
+ LFTP mkdir -p $dest_dir
+ LFTP mput -O $dest_dir spark-*
+ # Delete /latest directory and rename new upload to /latest
+ LFTP rm -rf "$REMOTE_PARENT_DIR/latest"
+ LFTP mv $dest_dir "$REMOTE_PARENT_DIR/latest"
+ # Re-upload a second time and leave the files in the timestamped upload
directory:
+ LFTP mkdir -p $dest_dir
+ LFTP mput -O $dest_dir spark-*
--- End diff --
I might need to quote the `spark-*` so that the parameter expansion is done
by `lftp` rather than the shell.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
