davidcavazos commented on pull request #12963: URL: https://github.com/apache/beam/pull/12963#issuecomment-712953191
> You may also want to make some mention of the Spark `DataFrame` [API](https://spark.apache.org/docs/latest/api/python/pyspark.sql.html#pyspark.sql.DataFrame), at least in the introduction. This is technically newer and in many cases superior to the RDD API, and where a lot of users would be coming from. What kind of mention do you think would be useful? I'm not familiar with Spark nor Spark Dataframes. I was looking at the API and it looks like it has about the same functionality, but some method names are different, and it supports SQL. Right now BeamSQL is only available in Java so we won't mention it here for the time being. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
