It sounds like you're expecting the XPath expression to evaluate embedded Spark SQL expressions? From the documentation <https://spark.apache.org/docs/2.4.5/api/sql/index.html#xpath>, there appears to be no reason to expect that to work.
On Tue, May 12, 2020 at 2:09 PM Chetan Khatri <chetan.opensou...@gmail.com> wrote: > Can someone please help.. Thanks in advance. > > On Mon, May 11, 2020 at 5:29 PM Chetan Khatri <chetan.opensou...@gmail.com> > wrote: > >> Hi Spark Users, >> >> I want to parse xml coming in the query columns and get the value, I am >> using *xpath_int* which works as per my requirement but When I am >> embedding in the Spark SQL query columns it is failing. >> >> select timesheet_profile_id, >> *xpath_int(timesheet_profile_code, '(/timesheetprofile/weeks/week[* >> *td.current_week**]/**td.day**)[1]')* >> >> *this failed * >> where Hardcoded values work for the above scenario >> >> scala> spark.sql("select timesheet_profile_id, >> xpath_int(timesheet_profile_code, >> '(/timesheetprofile/weeks/week[2]/friday)[1]') from >> TIMESHEET_PROFILE_ATT").show(false) >> >> Anyone has worked on this? Thanks in advance. >> >> Thanks >> - Chetan >> >>