Sure, pls open a JIRA. On Wed, Jul 20, 2016 at 6:16 PM, Yiming Liu <liuyiming....@gmail.com> wrote:
> Hi Kylin devs, > > According to the doc: > http://kylin.apache.org/docs15/tutorial/cube_streaming.html, the Kafka > incoming message should be in flatten structure. But it's too limit for > JSON message. May I request the feature which supports embedded structure > raw messages, and convert them into flatten table structure? > > One example: > { > "createdAt": "Jul 20, 2016 9:59:17 AM", > "id": 755703618762862600, > "text": "dejamos las tapas regionales de este #Miercoles > https://t.co/kfe0kT2Fup";, > "source": "<a href=\"http://twitter.com\"; rel=\"nofollow\">Twitter Web > Client</a>", > "isTruncated": false, > "inReplyToStatusId": -1, > "inReplyToUserId": -1, > "isFavorited": false, > "isRetweeted": false, > "favoriteCount": 0, > "retweetCount": 0, > "isPossiblySensitive": false, > "lang": "es", > "contributorsIDs": [], > "userMentionEntities": [], > "urlEntities": [], > "hashtagEntities": [ > { > "text": "Miercoles", > "start": 37, > "end": 47 > } > ], > "symbolEntities": [], > "currentUserRetweetId": -1, > "user": { > "id": 4853763947, > "name": "El Metropolitano", > "screenName": "ElTWdelMetro", > "description": "Noticias, an��lisis e informaci��n para el crecimiento > de la regi��n.", > "descriptionURLEntities": [], > "isContributorsEnabled": false, > "profileImageUrl": " > http://pbs.twimg.com/profile_images/692361953377927169/cS7lUaSj_normal.png > ", > "profileImageUrlHttps": " > https://pbs.twimg.com/profile_images/692361953377927169/cS7lUaSj_normal.png > ", > "isDefaultProfileImage": false, > "url": "http://elmetropolitano.com.ar/";, > "isProtected": false, > "followersCount": 153, > "profileBackgroundColor": "F5F8FA", > "profileTextColor": "333333", > "profileLinkColor": "2B7BB9", > "profileSidebarFillColor": "DDEEF6", > "profileSidebarBorderColor": "C0DEED", > "profileUseBackgroundImage": true, > "isDefaultProfile": true, > "showAllInlineMedia": false, > "friendsCount": 169, > "createdAt": "Jan 27, 2016 3:00:21 PM", > "favouritesCount": 9, > "utcOffset": -25200, > "timeZone": "Pacific Time (US & Canada)", > "profileBackgroundImageUrl": "", > "profileBackgroundImageUrlHttps": "", > "profileBannerImageUrl": " > https://pbs.twimg.com/profile_banners/4853763947/1453907062";, > "profileBackgroundTiled": false, > "lang": "es", > "statusesCount": 1000, > "isGeoEnabled": false, > "isVerified": false, > "translator": false, > "listedCount": 0, > "isFollowRequestSent": false > } > } > > The flatten structure will like this: > > "createdAt": "Jul 20, 2016 9:59:17 AM", > ... > "user_id": 4853763947 > > -- > With Warm regards > > Yiming Liu (刘一鸣) >
