[GitHub] spark pull request #8384: [SPARK-8510] [CORE] [PYSPARK] NumPy matrices as va...

2017-02-18 Thread paberline
Github user paberline closed the pull request at: https://github.com/apache/spark/pull/8384 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #8384: [SPARK-8510] [CORE] [PYSPARK] NumPy matrices as values in...

2017-02-18 Thread paberline
Github user paberline commented on the issue: https://github.com/apache/spark/pull/8384 Closing as requested due to this feature being too narrow a use case for core Spark. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark issue #8384: [SPARK-8510] [CORE] [PYSPARK] NumPy matrices as values in...

2016-10-08 Thread paberline
Github user paberline commented on the issue: https://github.com/apache/spark/pull/8384 Hi @holdenk - thanks for taking the time to look at this. I understand this PR might be too esoteric for Spark core. I will close it once @mengxr @jkbradley and @davies confirm

[GitHub] spark pull request: [SPARK-8510] [CORE] [PYSPARK] NumPy matrices a...

2015-08-27 Thread paberline-rms
Github user paberline-rms commented on the pull request: https://github.com/apache/spark/pull/8384#issuecomment-135505761 JIRA: https://issues.apache.org/jira/browse/SPARK-8510 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-8510] [CORE] [PYSPARK] NumPy matrices a...

2015-08-27 Thread paberline
Github user paberline commented on the pull request: https://github.com/apache/spark/pull/8384#issuecomment-135506108 JIRA: https://issues.apache.org/jira/browse/SPARK-8510 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark pull request: [SPARK-8510] [CORE] [PYSPARK] NumPy arrays and...

2015-08-23 Thread paberline
GitHub user paberline opened a pull request: https://github.com/apache/spark/pull/8384 [SPARK-8510] [CORE] [PYSPARK] NumPy arrays and matrices as values in … …sequence files You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] spark pull request: [SPARK-8510] [CORE] [PYSPARK] NumPy arrays and...

2015-06-27 Thread paberline
Github user paberline commented on the pull request: https://github.com/apache/spark/pull/6995#issuecomment-116092604 I want to work on this some more to incorporate the improvement suggestion I have received. --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [SPARK-8510] [CORE] [PYSPARK] NumPy arrays and...

2015-06-27 Thread paberline
Github user paberline closed the pull request at: https://github.com/apache/spark/pull/6995 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: [SPARK-8510] [CORE] [PYSPARK] NumPy arrays and...

2015-06-25 Thread paberline
Github user paberline commented on the pull request: https://github.com/apache/spark/pull/6995#issuecomment-115385801 I've received a suggestion this PR could be improved by using np.save(z) to serialize the data and also preserve metadata about the NumPy array. I'm going

[GitHub] spark pull request: Spark 8510 numpy sequence files

2015-06-24 Thread paberline
Github user paberline commented on the pull request: https://github.com/apache/spark/pull/6995#issuecomment-115004710 Using the DoubleArrayWritable example, I have added support for storing NumPy double arrays and matrices as arrays of doubles and nested arrays of doubles as value

[GitHub] spark pull request: Spark 8510 numpy sequence files

2015-06-24 Thread paberline
GitHub user paberline opened a pull request: https://github.com/apache/spark/pull/6995 Spark 8510 numpy sequence files You can merge this pull request into a Git repository by running: $ git pull https://github.com/paberline/spark spark_8510_numpy_sequence_files

[GitHub] spark pull request: Spark 8510 numpy sequence files

2015-06-24 Thread paberline
Github user paberline commented on the pull request: https://github.com/apache/spark/pull/6995#issuecomment-114997377 https://issues.apache.org/jira/browse/SPARK-8510 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark pull request: Spark 8510 numpy sequence files

2015-06-24 Thread paberline
Github user paberline commented on the pull request: https://github.com/apache/spark/pull/6995#issuecomment-114997479 https://issues.apache.org/jira/browse/SPARK-8510 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark pull request: Update from original

2015-06-13 Thread paberline
GitHub user paberline opened a pull request: https://github.com/apache/spark/pull/6798 Update from original You can merge this pull request into a Git repository by running: $ git pull https://github.com/paberline/spark master Alternatively you can review and apply

[GitHub] spark pull request: Update from original

2015-06-13 Thread paberline
Github user paberline closed the pull request at: https://github.com/apache/spark/pull/6798 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature