I thought the digest only included the IDs of the inputs, not the digest of the inputs. Am I mistaken?
Could you give an example of large description & digest? > On Aug 15, 2018, at 1:46 PM, Laurent Goujon <[email protected]> wrote: > > Hi folks, > > I'm looking for some guidance here before opening JIRAs/pull requests. > > I'm examining a memory dump during a planning operation and a significant > amount of memory are strings used for RelNode digest and description (some > strings being around 130kb). In that particular case, the relnode tree is > particularly deep, and since the digest is basically done recursively, the > deepest/widest the tree, the longer the digest. > > The easy solution would be to not go deep when adding inputs to the digest, > and instead of adding the input description to only add their type, id and > traits (and also not recurse). Would this break parts of calcite, or cause > other inconvenience because some use-cases rely on digest/description to be > basically the whole tree in a textual form? > > Laurent
