Re: MongoDB plugin to Spark - too many open cursors

2020-10-25 Thread lec ssmi
Is the connection pool configured by mongodb full? Daniel Stojanov 于2020年10月26日周一 上午10:28写道: > Hi, > > > I receive an error message from the MongoDB server if there are too many > Spark applications trying to access the database at the same time (about > 3 or 4), "Cannot open a new cursor since

MongoDB plugin to Spark - too many open cursors

2020-10-25 Thread Daniel Stojanov
Hi, I receive an error message from the MongoDB server if there are too many Spark applications trying to access the database at the same time (about 3 or 4), "Cannot open a new cursor since too many cursors are already opened." I am not too sure of how to remedy this. I am not sure how the

Re: mission statement : unified

2020-10-25 Thread Khalid Mammadov
Correct. Also as explained in the book LearningSpark2.0 by Databiricks: Unified Analytics While the notion of unification is not unique to Spark, it is a core component of its design philosophy and evolution. In November 2016, the Association for Computing Machinery (ACM) recognized Apache

Re: Spark hive build and connectivity

2020-10-25 Thread hopefulnick
For compatibility,it's recommended:- Use compatible version of Hive.- Build Spark without hive and configure hive to use Spark.Here is the way to build Spark with custom Hive. It worked for me and hope helpful to you. Hive on Spark