Github user allwefantasy commented on the pull request:
https://github.com/apache/spark/pull/1983#issuecomment-55238978
@witgo æè°¢è¿ä¸ªæå·§çå享ã
æç®åè¿éå°ä¸ä¸ªé®é¢ãæ¨å¤©ä½
é®æè¿è¾¹24wææ¡£çè¯æ°æ¯å¤å°ï¼æç»è®¡äºä¸ï¼æ¯ 2400w
计ç®æ¹å¼æ¯(parsedData.map(f:Document=>f.content.size).sum())ï¼è¯ç©ºé´æ¯8wã
第ä¸è½®åå§è¿ä»£é常快ï¼åªè¦åéå·¦å³å°±è·å®ãå°ç¬¬äºè½®åï¼æ¯ä¸ªtask
大æ¦éè¦åºåå26mçæ°æ®ãç¶åå°Cleaned broadcast å spark-shell
就没æååºäºã è¿å
¥ç±»ä¼¼
http://csdn-hdp-nn-01:4040/stages/stage/?id=11 è¿ç§url åtask
æ¾ç¤ºé½æ¯runningï¼ç¶åæçäºä¸æ¯ä¸ªworker
è年代ä»ä¹çé½æ¯æ£å¸¸çãä½æ¯cpuå¾ç©ºé²ï¼æè§äººç©é½æ²¡æå¨è·çæ
·åãä½ æéå°è¿ä¸ªé®é¢ä¹ï¼
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
