Grouping and counting occurences of specific column rows

2022-04-22 Thread marc nicole
Hi all, Sorry for posting this twice, I need to know how to group by several column attributes (e.g.,List groupByAttributes) a dataset (dataset) and then count the occurrences of associated grouped rows, how do i achieve that ? I tried through the following code: > Dataset groupedRows =

Re: Grouping and counting occurences of specific column rows

2022-04-19 Thread marc nicole
I don't want to groupBy since i want the rows separate for the subsequent transformations. But i want to groupBy (i am using partitionBy here) using many attributes while counting the frequency for each different group of records (with respect to the the attributes first mentioned) Le mar. 19

Re: Grouping and counting occurences of specific column rows

2022-04-19 Thread Sean Owen
Just .groupBy(...).count() ? On Tue, Apr 19, 2022 at 6:24 AM marc nicole wrote: > Hello guys, > > I want to group by certain column attributes (e.g.,List > groupByQidAttributes) a dataset (initDataset) and then count the > occurrences of associated grouped rows, how do i achieve that neatly? >

Grouping and counting occurences of specific column rows

2022-04-19 Thread marc nicole
Hello guys, I want to group by certain column attributes (e.g.,List groupByQidAttributes) a dataset (initDataset) and then count the occurrences of associated grouped rows, how do i achieve that neatly? I tried through the following code: Dataset groupedRowsDF =