Re: dataFrame.na.fill() fails for column with dot

2021-02-11 Thread Amandeep Sharma
Adding note to the previous email. Test suite org.apache.spark.sql.catalyst.analysis.AnalysisSuite passed after the aforementioned changes. Regards, Amandeep Sharma On Tue, Feb 9, 2021 at 3:07 PM Amandeep Sharma wrote: > Hi guys, > Apologies for the long mail. > > I am running below code

Re: dataFrame.na.fill() fails for column with dot

2021-02-09 Thread Terry Kim
You probably need to update f. name here as well, but we can discuss further when you create a JIRA/PR. Thanks, Terry On Tue, Feb 9, 2021

Re: dataFrame.na.fill() fails for column with dot

2021-02-09 Thread Terry Kim
Thanks Amandeep. This seems like a valid bug to me as quoted columns are not handled property for na.fill(). I think the better place to fix is in DataFrameNaFunctions.scala

dataFrame.na.fill() fails for column with dot

2021-02-09 Thread Amandeep Sharma
Hi guys, Apologies for the long mail. I am running below code snippet import org.apache.spark.sql.SparkSession object ColumnNameWithDot { def main(args: Array[String]): Unit = { val spark = SparkSession.builder.appName("Simple Application") .config("spark.master", "local").getOrCreate()