This is an automated email from the ASF dual-hosted git repository.
zkaoudi pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-wayang.git
from 3ade29109 Merge pull request #625 from
apache/dependabot/maven/wayang-commons/wayang-basic/org.apache.kafka-kafka-clients-3.9.1
add bad0cd2f2 tests and general code cleanup for python api
add 817e93974 Merge pull request #1 from mspruc/python-api-tests
add 8c4592fa4 rm unused configurations
add 203985971 add wayang.properties file for python api tests
add 9063e544b add python api configurations to test .properties file
add 796c3bfda expand exception msg
add 748270e80 add common python3 config for resource .properties file
add 4e2625798 add config to correct .properties file
add 881563a4b try referring to two folders up
add 70c99184d update workflow
add ed29104a8 rollback action version of cache & add license
add 7e45e997a refer to pywy src
add 6d720935b hardcode env path
add 9c82d3861 add .properties for local testing & bump cloudpickle to 3.1.2
add ae899536a roll back to python3.8
add 94987b64d remove tests as they only work for specific python versions
add c4635a532 clean up imports
add 435f1b629 bump python version
add 2a56927d1 make tests compatible with pytest & and pytest to workflow
add be3de2b0d remove references to self
add 9b5a6e5f1 add pytest to requirements
add d3fe27453 move pytest unit testing to its own run block
add bce3d74df add run tag to pytest
add 211f2f19e more info in exception msgs
add 5b762f2df fix up test_filter should now runnable from same directory
as maven
add 09571dabd add requests to requirements
add 31991c094 add resources folder & contents
add fd8382a1c licenses
add 5786d9f66 license in __init__
add 9f1c81110 change file type of sample_data
add 576098429 fix sample_data in test_filter
add 6bc722f02 fix test
add ccf9c7da6 test data for test_json.py
add 35efdbd6e move python tests after maven
add e760a94d6 move python dependencies before maven tests so tests can use
them
add 9218f3a62 add missing arg to pytest
add 5e309172f add resources for json test
add 37b87faf6 move over to mvn runner instead of bin
add f81d012b5 enable custom properties file
add 860816f3b add config to python test runner
add 365374f0e add meta func for config files with pytest
add d12149bce add test directory to pytest
add 27b036f65 remove unused quotations
add 2487a466c add omitted comma
add 76ba1b6cd disable test requiring missing implementations
add e1ea95ca4 explicitly write pom to exec from, pytest should now be
executable from root
add 9b9c797e1 add better process waiting
add 670215db8 maven process for test_json
add 4471bb0f4 make json api respect custom configs
add c34ed593f rm test_join as joins are already tested in filter and it
was not setup to be run singularly
add 85503b61f skip test missing impl
add 26f939cf9 update readme with pytest specifics
new 1e0f9e816 Merge pull request #603 from mspruc/main
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/backend.yml | 17 +++-
python/README.md | 3 +
python/src/pywy/{exception.py => requirements.txt} | 7 +-
.../src/pywy/{exception.py => tests/conftest.py} | 4 +-
python/src/pywy/tests/filter_test.py | 40 --------
python/src/pywy/tests/join_test.py | 45 ---------
python/src/pywy/tests/json_test.py | 35 -------
python/src/pywy/{ => tests/resources}/__init__.py | 0
.../src/pywy/tests}/resources/plan-a.json | 4 +-
.../src/pywy/tests/resources/sample_data.md | 0
.../src/pywy/tests/resources/wayang.properties | 5 +-
.../pywy/tests/resources/wordcount_out_python.txt | 2 -
python/src/pywy/tests/test.py | 78 ----------------
.../pywy/tests/test_decision_tree_regression.py | 67 +++++++------
python/src/pywy/tests/test_dl.py | 78 ++++++++++++++++
python/src/pywy/tests/test_filter.py | 65 +++++++++++++
python/src/pywy/tests/test_json.py | 52 +++++++++++
python/src/pywy/tests/test_train_linear_svc.py | 35 ++++---
python/src/pywy/tests/test_word_count.py | 95 +++++++++++++++++++
python/src/pywy/tests/train_logistic_test.py | 32 +++----
python/src/pywy/tests/word_count.py | 71 --------------
tools/test/config/wayang.properties | 5 +
.../wayang-api-json/src/main/resources/plan-a.json | 4 +-
.../src/main/scala/builder/JsonPlanBuilder.scala | 2 +-
wayang-api/wayang-api-python/pom.xml | 2 -
.../wayang/api/python/executor/ProcessFeeder.java | 104 ++++++++++-----------
.../api/python/executor/ProcessReceiver.java | 23 ++---
.../api/python/executor/PythonProcessCaller.java | 94 ++++++++++---------
.../api/python/executor/PythonWorkerManager.java | 34 ++++---
.../wayang/api/python/executor/ReaderIterator.java | 72 ++++++--------
.../python/function/WrappedFlatMapDescriptor.java | 34 +++----
.../function/WrappedMapPartitionsDescriptor.java | 44 +++++----
.../function/WrappedPredicateDescriptor.java | 45 ++++-----
.../api/python/function/WrappedPythonFunction.java | 16 ++--
.../python/function/WrappedReduceDescriptor.java | 35 +++----
.../function/WrappedTransformationDescriptor.java | 39 ++++----
.../apache/wayang/api/python/PythonApiTests.java} | 41 ++++----
.../resources/wayang.properties} | 7 +-
38 files changed, 674 insertions(+), 662 deletions(-)
copy python/src/pywy/{exception.py => requirements.txt} (90%)
copy python/src/pywy/{exception.py => tests/conftest.py} (87%)
delete mode 100644 python/src/pywy/tests/filter_test.py
delete mode 100644 python/src/pywy/tests/join_test.py
delete mode 100644 python/src/pywy/tests/json_test.py
copy python/src/pywy/{ => tests/resources}/__init__.py (100%)
copy {wayang-api/wayang-api-json/src/main =>
python/src/pywy/tests}/resources/plan-a.json (88%)
copy README.md => python/src/pywy/tests/resources/sample_data.md (100%)
copy
wayang-api/wayang-api-python/src/main/resources/wayang-api-python-defaults.properties
=> python/src/pywy/tests/resources/wayang.properties (89%)
copy wayang-platforms/wayang-spark/src/test/resources/wayang.properties =>
python/src/pywy/tests/resources/wordcount_out_python.txt (96%)
delete mode 100644 python/src/pywy/tests/test.py
create mode 100644 python/src/pywy/tests/test_dl.py
create mode 100644 python/src/pywy/tests/test_filter.py
create mode 100644 python/src/pywy/tests/test_json.py
create mode 100644 python/src/pywy/tests/test_word_count.py
delete mode 100644 python/src/pywy/tests/word_count.py
copy
wayang-api/{wayang-api-sql/src/main/java/org/apache/wayang/api/sql/calcite/schema/WayangSchema.java
=>
wayang-api-python/src/test/java/org/apache/wayang/api/python/PythonApiTests.java}
(50%)
mode change 100755 => 100644
copy
wayang-api/wayang-api-python/src/{main/resources/wayang-api-python-defaults.properties
=> test/resources/wayang.properties} (76%)
