Hi madhuka, The Spring Cleaning PR will change the code base a lot, the way the code work will be the same (for 80% of the case), so you can familiarize yourself with it however keep in mind that the Spring Cleaning PR will change: * folder structure * Separate some code into multiple files * Refactor some code to be simpler/optimized
The folder structure part is kinda set right now (just a few tiny changes more), and we are working on making some refactoring ready as fast as possible. I think that on Monday, you can get familiar with that PR new structure and work from there, it should help you understand better all the part of the zeppelin-web. On Thu, May 21, 2015 at 1:46 AM, madhuka udantha <[email protected]> wrote: > Hi All, > > > I went through google charts / d3 (chart-options, chart-types, chart-data > and chart-format) with angularJS. And I have written few blog articles > regard to the topics[1,2]. > To Familiarize myself with Zepplin I wrote angular controller and new tab > for Zepplin-Web app. > > As 'spring cleaning of Zeppelin-web'[3] is in-progress, will this change > existing code base? I'm currently working on zepplin web app. Will the > change be significant? Shall I familiarize with the existing code base or > the resulting one of the 'spring cleaning of Zeppelin-web' > > > > [1] http://madhukaudantha.blogspot.com/search/label/Google%20Chart > [2] https://github.com/Madhuka/angularjs-tutorial > [3] https://github.com/apache/incubator-zeppelin/pull/56 > > On Fri, May 1, 2015 at 9:40 AM, Alex B. <[email protected]> wrote: > >> Congratulations, Madhuka! >> >> Glad that you can make it and thank you for your contributions. So we >> will go on with the initial plan of making more visualizations for Zeppelin >> then. >> >> Meanwhile it is community bonding period [1] I would suggest you go on >> participating at the dev@ and user@ mailing lists, helping people, >> sharing your experience with Zeppelin and meanwhile you can also try doing >> a simple PoC as Ilya suggested, by picking two different libraries or >> chart types (1 existing, 1 new) and writing an implementation of the >> transformation function to fit them together. >> >> Please keep in touch and let us know who it goes every week or two in a >> form of short email with your progress summary. We can also arrange >> something like a regular call\IRC hours if you will. >> >> Thanks again, please feel free to reach out in case of any further >> questions! >> >> [1] >> http://googlesummerofcode.blogspot.kr/2007/04/so-what-is-this-community-bonding-all.html >> >> On Thu, Apr 30, 2015 at 12:57 PM, madhuka udantha < >> [email protected]> wrote: >> >>> Hi, >>> >>> Thank you all for your participation in this thread and the support I >>> got. My GSoC proposal for Zeppelin had been accepted. Hope you will >>> continue to give the same support you have been giving me to see to the >>> successful finishing of the project. >>> >>> Also Thanks to Corneau for spring cleaning zeppelin. I can too support >>> this if needed. Please share any thread which will be discussing [1] so I >>> can go through the code changes happening. >>> >>> Currently I'm using zeppelin/master on github. Is it alright? Do you >>> have any ideas to what my first deliverable would need to contain? >>> >>> Thanks. >>> >>> [1] https://github.com/apache/incubator-zeppelin/pull/56 >>> >>> On Wed, Apr 29, 2015 at 2:41 PM, Corneau Damien <[email protected]> >>> wrote: >>> >>>> Hi Madhuka and dev mailing list, >>>> >>>> Since the code became quite a mess (didn't supervised it enough I guess >>>> :p >>>> ), and GSOC 2015 will start soon, >>>> I'm currently working on making things easier for people who would like >>>> to >>>> participate in the front-end of Zeppelin. >>>> Work in Progress in that Pull Request : >>>> https://github.com/apache/incubator-zeppelin/pull/56 >>>> >>>> It should be finished before the GSOC 2015 coding time start :) >>>> >>>> On Mon, Apr 27, 2015 at 2:00 PM, Ilya Malyanov <[email protected]> >>>> wrote: >>>> >>>> > Hi Madhuka, >>>> > >>>> > I’m not aware of any efforts in bridging different chart libraries. >>>> But my >>>> > guess is, we’ll have to do it ourselves. You can start by picking two >>>> > different libraries or chart types and writing an implementation of >>>> the >>>> > transformation function. It might help you to assess the scope of >>>> work. >>>> > >>>> > Regarding paragraph.js. >>>> > I don’t think there is documentation for it. >>>> > So the best way to understand the data flow it is to read the code. >>>> > I know it’s not very helpful, but I don’t think anyone can help you in >>>> > this situation. >>>> > >>>> > Regards, >>>> > Ilya >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > On Thu, Apr 23, 2015 at 10:43 PM, madhuka udantha < >>>> > [email protected]> wrote: >>>> > >>>> >> Hi, >>>> >> >>>> >> In different charting libraries the data template take different >>>> formats. >>>> >> Therefore to convert between these formats we use a data >>>> transformation >>>> >> module. It converts the input data (JSON format) to different data >>>> >> templates based on the chart library/ chart type selected. If chart >>>> library >>>> >> A and chart library B both use the same data template it will reuse >>>> the >>>> >> data transformation algorithm. >>>> >> >>>> >> Please share your valuable ideas on this matter. Has any >>>> implementation >>>> >> been done similar to this before? >>>> >> >>>> >> I also need to know the data flow within Paragraph.js. Please be kind >>>> >> enough to share the required resources. What is the logging >>>> mechanism that >>>> >> is being used in zeppelin? >>>> >> >>>> >> I have written few articles[1] on zeppelin >>>> >> >>>> >> [1] >>>> http://madhukaudantha.blogspot.com/search/label/Apache%20Zeppelin >>>> >> >>>> >> On Mon, Apr 20, 2015 at 11:44 AM, madhuka udantha < >>>> >> [email protected]> wrote: >>>> >> >>>> >>> Hi, >>>> >>> >>>> >>> Here are some blog posts[1] on AngularJS that I wrote last week and >>>> >>> git-hub[2] repo on them >>>> >>> >>>> >>> [1] >>>> >>> >>>> http://madhukaudantha.blogspot.com/search/label/AngularJS?view=sidebar >>>> >>> < >>>> http://madhukaudantha.blogspot.com/search/label/AngularJS?view=classic> >>>> >>> [2] https://github.com/Madhuka/angularjs-tutorial >>>> >>> >>>> >>> >>>> >>> On Wed, Apr 15, 2015 at 12:20 PM, madhuka udantha < >>>> >>> [email protected]> wrote: >>>> >>> >>>> >>>> Hi Alex, >>>> >>>> >>>> >>>> I ran the tests and they were fine. Yes I'm familiar with the code >>>> >>>> layout/architecture. Basically I'm looking at AngularJS and >>>> Typescript. I >>>> >>>> have played around with those two technologies and ran some >>>> example code >>>> >>>> which worked fine. I'm writing few blog posts on them as well. >>>> >>>> >>>> >>>> Currently I'm looking at zeppelin-web\app\scripts\controllers\ >>>> and I'm >>>> >>>> getting familiarized with the Zeppelin Code Base. Also I'm hoping >>>> to write >>>> >>>> some blog posts on it. >>>> >>>> >>>> >>>> I'm also following paragraph.js functions mainly the two >>>> >>>> functions pivot() and pivotDataToD3ChartFormat() for constructing >>>> d3 data. >>>> >>>> >>>> >>>> Further I'm finding what are the mainly used charting types by >>>> Research >>>> >>>> Teams of Universities all over the world. Also I'm researching on >>>> the main >>>> >>>> features that would be used in such graphs. >>>> >>>> >>>> >>>> Yes it will be great to have a call/meeting. This week or following >>>> >>>> will be fine for me. IRC meeting or google hangout will be fine. >>>> >>>> >>>> >>>> On Tue, Apr 14, 2015 at 12:33 PM, Alex B. <[email protected]> >>>> wrote: >>>> >>>> >>>> >>>>> Hi Madhuka, >>>> >>>>> >>>> >>>>> how Zeppelin code-base exploration it going for you? Do you have >>>> any >>>> >>>>> updates? >>>> >>>>> I can see from >>>> >>>>> >>>> http://madhukaudantha.blogspot.kr/2015/03/building-apache-zeppelin.html >>>> >>>>> that you were able to build it well. >>>> >>>>> >>>> >>>>> Were you able to run some tests? Are you familiar by now with code >>>> >>>>> layout\client-server architecture? >>>> >>>>> >>>> >>>>> Asking because it is time for us now to rate the GSoC proposals >>>> that >>>> >>>>> we'v >>>> >>>>> got, so please let us know about the progress that you have made >>>> so >>>> >>>>> fas, so >>>> >>>>> we can use it as foundation. >>>> >>>>> >>>> >>>>> Will you be interested in making a quick call this early\next >>>> week and >>>> >>>>> also >>>> >>>>> talk about your GSoC proposal a bit? >>>> >>>>> >>>> >>>>> That would be awesome and could help us a lot! >>>> >>>>> Thanks in advance. >>>> >>>>> >>>> >>>>> >>>> >>>>> On Wed, Apr 1, 2015 at 2:27 PM, madhuka udantha < >>>> >>>>> [email protected]> >>>> >>>>> wrote: >>>> >>>>> >>>> >>>>> > Hi Damien, >>>> >>>>> > >>>> >>>>> > Thanks for the quick and descriptive reply. I will go through >>>> each >>>> >>>>> of them >>>> >>>>> > and update you on those and I will share my experiences in my >>>> blog >>>> >>>>> too. I >>>> >>>>> > will go through the code-base with consideration for the above >>>> files. >>>> >>>>> > >>>> >>>>> > Thanks >>>> >>>>> > >>>> >>>>> > On Wed, Apr 1, 2015 at 7:36 AM, Corneau Damien < >>>> >>>>> [email protected]> >>>> >>>>> > wrote: >>>> >>>>> > >>>> >>>>> > > Hi, >>>> >>>>> > > >>>> >>>>> > > First of all we use angularjs so you might want to familiarize >>>> >>>>> yourself >>>> >>>>> > > with it. >>>> >>>>> > > Currently the code is not well organized (big files), and not >>>> >>>>> really >>>> >>>>> > > angular friendly either, but we are working on fixing that. >>>> >>>>> > > >>>> >>>>> > > We also were preparing a switch to Typescript, so you might >>>> want >>>> >>>>> to read >>>> >>>>> > > about it too. >>>> >>>>> > > >>>> >>>>> > > You will find most of the web logic inside of >>>> >>>>> > > zeppelin-web/app/scripts/controllers/ >>>> >>>>> > > >>>> >>>>> > > Main controllers are: notebook.js and paragraph.js >>>> >>>>> > > >>>> >>>>> > > notebook.js take care of the full note, while paragraph.js is >>>> for >>>> >>>>> each >>>> >>>>> > > paragraph of the notebook. >>>> >>>>> > > >>>> >>>>> > > In notebook.js will have functions that distributes actions >>>> to all >>>> >>>>> > > paragraphs, interpreter binding, note style etc... >>>> >>>>> > > In paragraph.js you shall find everything about text-editor, >>>> >>>>> running >>>> >>>>> > > queries, pivot and visualization. >>>> >>>>> > > >>>> >>>>> > > Since the file is somewhere around 1600 lines in >>>> paragraph.js, I >>>> >>>>> can help >>>> >>>>> > > you find what you want with more precise questions. >>>> >>>>> > > >>>> >>>>> > > Some functions you might be interested in: 'pivot = >>>> function(' , ' >>>> >>>>> > > pivotDataToD3ChartFormat = function(', 'setD3Chart = >>>> function(', >>>> >>>>> '$scope. >>>> >>>>> > > loadTableData = function(' >>>> >>>>> > > >>>> >>>>> > > This Pull request (typescript) wasn't ported to the incubator >>>> >>>>> repository >>>> >>>>> > > yet, but there was some work on splitting the paragraph into >>>> >>>>> smaller >>>> >>>>> > parts. >>>> >>>>> > > It might help you understand or find what you want. >>>> >>>>> > > >>>> >>>>> > > >>>> >>>>> > > >>>> >>>>> > > On Wed, Apr 1, 2015 at 2:23 AM, madhuka udantha < >>>> >>>>> > [email protected]> >>>> >>>>> > > wrote: >>>> >>>>> > > >>>> >>>>> > > > Hi All, >>>> >>>>> > > > >>>> >>>>> > > > Can you point out some resources / tutorials to >>>> understand the >>>> >>>>> code >>>> >>>>> > > base >>>> >>>>> > > > of zeppelin? >>>> >>>>> > > > Since I am trying to familiarize myself with the zeppelin >>>> code >>>> >>>>> > structure >>>> >>>>> > > > and architecture >>>> >>>>> > > > >>>> >>>>> > > > Thanks >>>> >>>>> > > > >>>> >>>>> > > > On Fri, Mar 20, 2015 at 10:57 AM, madhuka udantha < >>>> >>>>> > > > [email protected]> wrote: >>>> >>>>> > > > >>>> >>>>> > > >> Hi All, >>>> >>>>> > > >> >>>> >>>>> > > >> I'm Udantha, MSc. Student at University of Moratuwa. This >>>> GSoC >>>> >>>>> 2015 >>>> >>>>> > > >> project, 0COMDEV-1190 captures my interest. >>>> >>>>> > > >> >>>> >>>>> > > >> I have abundant experiences of visualization techniques >>>> creating >>>> >>>>> > > numerous >>>> >>>>> > > >> dashboards[1,2] with javascript, html5, angularJS, d3 >>>> charting >>>> >>>>> etc. >>>> >>>>> > > >> >>>> >>>>> > > >> My current research area comprises of big data where I have >>>> >>>>> worked >>>> >>>>> > with >>>> >>>>> > > >> various types of data sets. Also I'm working with cluster >>>> >>>>> > representation >>>> >>>>> > > >> and classification techniques where visualization amounts >>>> to a >>>> >>>>> > > considerable >>>> >>>>> > > >> part. I was following COMDEV-119 (jira) with Alexander >>>> Bezzubov >>>> >>>>> and >>>> >>>>> > > CORNEAU >>>> >>>>> > > >> Damien for more than week. >>>> >>>>> > > >> >>>> >>>>> > > >> Thanks >>>> >>>>> > > >> >>>> >>>>> > > >> [1] http://wso2.com/products/user-engagement-server/ >>>> >>>>> > > >> [2] https://github.com/wso2/jaggery >>>> >>>>> > > >> -- >>>> >>>>> > > >> Cheers, >>>> >>>>> > > >> Madhuka Udantha >>>> >>>>> > > >> http://madhukaudantha.blogspot.com >>>> >>>>> > > >> >>>> >>>>> > > > >>>> >>>>> > > > >>>> >>>>> > > > >>>> >>>>> > > > -- >>>> >>>>> > > > Cheers, >>>> >>>>> > > > Madhuka Udantha >>>> >>>>> > > > http://madhukaudantha.blogspot.com >>>> >>>>> > > > >>>> >>>>> > > >>>> >>>>> > >>>> >>>>> > >>>> >>>>> > >>>> >>>>> > -- >>>> >>>>> > Cheers, >>>> >>>>> > Madhuka Udantha >>>> >>>>> > http://madhukaudantha.blogspot.com >>>> >>>>> > >>>> >>>>> >>>> >>>>> >>>> >>>>> >>>> >>>>> -- >>>> >>>>> -- >>>> >>>>> Kind regards, >>>> >>>>> Alexander. >>>> >>>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> -- >>>> >>>> Cheers, >>>> >>>> Madhuka Udantha >>>> >>>> http://madhukaudantha.blogspot.com >>>> >>>> >>>> >>> >>>> >>> >>>> >>> >>>> >>> -- >>>> >>> Cheers, >>>> >>> Madhuka Udantha >>>> >>> http://madhukaudantha.blogspot.com >>>> >>> >>>> >> >>>> >> >>>> >> >>>> >> -- >>>> >> Cheers, >>>> >> Madhuka Udantha >>>> >> http://madhukaudantha.blogspot.com >>>> >> >>>> > >>>> > >>>> >>> >>> >>> >>> -- >>> Cheers, >>> Madhuka Udantha >>> http://madhukaudantha.blogspot.com >>> >> >> >> >> -- >> -- >> Kind regards, >> Alexander. >> >> > > > -- > Cheers, > Madhuka Udantha > http://madhukaudantha.blogspot.com >
