amaliujia commented on PR #38899: URL: https://github.com/apache/spark/pull/38899#issuecomment-1336537633
@dengziming there are several techniques that can help you: when you working on Scala, you can run `./dev/lint-scala` locally which does scala side lint check. One of the check of that is the format over the Connect Scala module, which in fact you can run this command to auto-format the connect Scala code: `./build/mvn -Pscala-2.12 scalafmt:format -Dscalafmt.skip=fase -Dscalafmt.validateOnly=false -Dscalafmt.changedOnly=false -pl connector/connect` When you working on Python side, after you build the Scala side jars, you can run `./python/run-tests --module pyspark-connect` to test your code (you may consider use https://docs.conda.io/en/latest/miniconda.html to manage the python envs and in the conda env you can `pip install -r dev/requirement.txt --upgrade`). Similar, you can run `./dev/lint-python` to do the lint check. And there will be some prompted suggestions if you fail a check. Please feel free to ask questions that help you develop easier. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
