Hi,
I have a Dataframe containing a column with a map Map[A,B] with
multiple values. I want to explode the key,value pairs in the map into a
new column, actually planing to create 2 new cols.
My plan had been
- explode "input": Map[K,V] to "temp":Iterable[Map[K,V]]
- new col temp to temp.key
- new col temp to temp.value
- drop temp
But I am failing at the first hurdle.
For example my data looks a bit like like....
scala> test.show()
+----------------------------+------------------------------------------+
| id | brand
|
+----------------------------+------------------------------------------+
|a02d1fa5d87dce6a7...|Map(Vans -> 1, Versace ->2, ...|
but I want to get to
scala> test.show()
+-----------------------------+------------------------------------------+
| id | brand_key | brand_count |
+-----------------------------+------------------------------------------+
| a02d1fa5d87dce6a7...| Vans | 1 |
| a02d1fa5d87dce6a7...| Versace | 2 |
Any suggestions would be appreciated.
Thanks,
Anthony