We dont have Domain Objects, its a service like a pipeline, data is read from source and they are saved it in relational Database
I can read the structure from DataFrames, and do some transformations, I would prefer to do it with Spark to be consistent with the process On Wed, Jan 27, 2016 at 12:25 PM, Al Pivonka <alpivo...@gmail.com> wrote: > Are you using an Relational Database? > If so why not use a nojs DB ? then pull from it to your relational? > > Or utilize a library that understands Json structure like Jackson to > obtain the data from the Json structure the persist the Domain Objects ? > > On Wed, Jan 27, 2016 at 9:45 AM, Andrés Ivaldi <iaiva...@gmail.com> wrote: > >> Sure, >> The Job is like an etl, but without interface, so I decide the rules of >> how the JSON will be saved into a SQL Table. >> >> I need to Flatten the hierarchies where is possible in case of list >> flatten also, nested objects Won't be processed by now >> >> {"a":1,"b":[2,3],"c"="Field", "d":[4,5,6,7,8] } >> {"a":11,"b":[22,33],"c"="Field1", "d":[44,55,66,77,88] } >> {"a":111,"b":[222,333],"c"="Field2", "d":[44,55,666,777,888] } >> >> I would like something like this on my SQL table >> >> a b c d >> 1 2,3 Field 4,5,6,7,8 >> 11 22,33 Field1 44,55,66,77,88 >> 111 222,333 Field2 444,555,,666,777,888 >> >> Right now this is what i need >> >> I will later add more intelligence, like detection of list or nested >> objects and create relations in other tables. >> >> >> >> On Wed, Jan 27, 2016 at 11:25 AM, Al Pivonka <alpivo...@gmail.com> wrote: >> >>> More detail is needed. >>> Can you provide some context to the use-case ? >>> >>> On Wed, Jan 27, 2016 at 8:33 AM, Andrés Ivaldi <iaiva...@gmail.com> >>> wrote: >>> >>>> Hello, I'm trying to Save a JSON filo into SQL table. >>>> >>>> If i try to do this directly the IlligalArgumentException is raised, I >>>> suppose this is beacouse JSON have a hierarchical structure, is that >>>> correct? >>>> >>>> If that is the problem, how can I flatten the JSON structure? The JSON >>>> structure to be processed would be unknow, so I need to do it >>>> programatically >>>> >>>> regards >>>> >>>> -- >>>> Ing. Ivaldi Andres >>>> >>> >>> >>> >>> -- >>> Those who say it can't be done, are usually interrupted by those doing >>> it. >>> >> >> >> >> -- >> Ing. Ivaldi Andres >> > > > > -- > Those who say it can't be done, are usually interrupted by those doing it. > -- Ing. Ivaldi Andres