corticalstack commented on issue #41058: URL: https://github.com/apache/arrow/issues/41058#issuecomment-2049596196
@jorisvandenbossche ``` # Update conda conda update -n base -c conda-forge conda -y # Define Conda environment name and kernel display name export CONDA_ENV_NAME="lhg_py311_pt_unsloth" export KERNEL_DISPLAY_NAME="Python 3.11 - LLM tune" echo $CONDA_ENV_NAME echo $KERNEL_DISPLAY_NAME # List existing Conda environments conda env list # Create a new Conda environment with Python 3.11.7 conda create --name $CONDA_ENV_NAME python=3.11.7 -y # List Conda environments to verify the new one is created conda env list # Install ipykernel and other necessary packages into the new Conda environment conda install -no-cache -n $CONDA_ENV_NAME ipykernel -y conda install -no-cache -n $CONDA_ENV_NAME -c conda-forge cudatoolkit xformers bitsandbytes xformers -y conda install -no-cache -n $CONDA_ENV_NAME -c conda-forge cudatoolkit-dev -y conda install -no-cache -n $CONDA_ENV_NAME -c conda-forge ipywidgets widgetsnbextension transformers -y conda install -no-cache -n $CONDA_ENV_NAME -c conda-forge git-lfs wandb # Activate the new Conda environment conda activate $CONDA_ENV_NAME # Install additional packages via pip into the Conda environment pip install chardet accelerate "unsloth[conda] @ git+https://github.com/unslothai/unsloth.git"; pip install torch==2.1.0+cu121 -f https://download.pytorch.org/whl/torch_stable.html pip install flash-attn ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
