Burak Yavuz created SPARK-8023:
----------------------------------
Summary: Random Number Generation inconsistent in projections in
DataFrame
Key: SPARK-8023
URL: https://issues.apache.org/jira/browse/SPARK-8023
Project: Spark
Issue Type: Bug
Components: SQL
Reporter: Burak Yavuz
Priority: Blocker
to reproduce (in python):
{code}
df = sqlContext.range(0, 10).withColumn('uniform', rand(seed=10))
df.select('uniform', 'uniform' + 1)
{code}
You should see that the first column + 1 doesn't equal the second column.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]