How work with Big JSON

[e-sociaux]

 

Hello all,

NIFI receives a flowfile containing a bit json around 10.000.000 records

{
  "state" : "SUCCEEDED",
  "progress" : 100,
  "result" : {
    "records" : [ {
      "timestamp" : "2025-02-07T08:59:59.999000000+01:00",
      "data": "fooA",
    },{
      "timestamp" : "2025-02-07T08:59:33.999000000+01:00",
      "data": "fooB",
    },.................
............
.......
]
}

How do you do to get only the records and to avoid "out of memory" when we use EvaluateJsonPath ?

Thanks for your help

Minh