Github user DylanGuedes commented on the issue:
    Ok so It works fine in spark-shell but in pyspark I got this error:
    File "/home/dguedes/Workspace/spark/python/pyspark/sql/", line 
2155, in                                              
    Failed example:                                                             
                                 , df.vals2).alias('zipped')).collect()            
    Exception raised:                                                           
        Traceback (most recent call last):                                      
          File "/usr/lib64/python2.7/", line 1315, in __run           
            compileflags, 1) in test.globs                                      
          File "<doctest[2]>", line 1, in <module>    
  , df.vals2).alias('zipped')).collect()        
          File "/home/dguedes/Workspace/spark/python/pyspark/sql/", 
line 466, in collect                                                            
            port = self._jdf.collectToPython()                                  
 line 1160, in __call__                                                         
            answer, self.gateway_client, self.target_id,             
          File "/home/dguedes/Workspace/spark/python/pyspark/sql/", 
line 63, in deco                                                                
            return f(*a, **kw)                                                  
 line 320, in get_return_value                                                  
            format(target_id, ".", name), value)                                
        Py4JJavaError: An error occurred while calling o2240.collectToPython.   
        : java.util.concurrent.ExecutionException: 
org.codehaus.commons.compiler.CompileException: File '', Line 41, 
Column 2: failed to compile: org.codehaus.commons.compiler.Com$
    ileException: File '', Line 41, Column 2: Unexpected token 
"[" in primary                                                                  
    The problem is in the `doGenCode` function, but I can't see why. Any 
suggestions are welcome :)


To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to