Dear Wiki user, You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.
The following page has been changed by udanax: http://wiki.apache.org/lucene-hadoop/HbaseShell ------------------------------------------------------------------------------ + '''work in progress''' + [[TableOfContents(4)]] ---- = Hbase Shell Introduction = @@ -8, +10 @@ [[BR]]aggregation, algebraic calculation on Hadoop + Hbase. == Hbase Shell Goals == + HBase Shell is developed to achieve the following goals. * Generic Query Model Functions * A Simplified Import/Export/Migrate Functionality Between different data sources (Hadoop, HBase) * A Simplified processing of a logical data model * A Simplified algebraic operations - * Parallel Numerical Analysis by abstracting/numericalizing points, lines, or plane data across multiple maps in HBase. + * Parallel Numerical Analysis by abstracting/numericalizing points, lines, or plane data across multiple maps in HBase. == Background == I expect Hadoop + Hbase to handle sparsity and data explosion very well in near future. [[BR]]Moreover, i believe the design of the multi-dimensional structure and the 3-dim space model of the data are [[BR]]optimized for rapid ad-hoc information retrieval in any orientation, as well as for fast, flexible calculation and transformation of [[BR]]raw data based on formulaic relationships. @@ -22, +25 @@ Then, I thought it would require a more user-friendly interface to enable querying the data interactive. [[BR]]So, I began building parallel processing shell [[BR]]to help make general algebraic and logical data modeling works easier on Hadoop + Hbase - -- ''If you could give me an opinion on the above ideas, it would be great.'' - == Rationale == + ... - - writing... - - {{{ - ... Bigtable takes care of all the data layout, compression, and access chores associated with a large - data store. It presents the abstraction of a 2-dimensional table of data cells, with different versions over time making up a third dimension ... - - - Failure Trends in a Large Disk Drive Population (Google) - }}} ---- = Hbase Shell Syntax Definition = - writing... + '''Note''' that Data should be located by their row, column, and timestamp. == Basic Commands == ||<#ececec> '''Command''' ||<#ececec> '''Explanation''' || - ||SHOW ||<99%>'''Show''' command provides information about argument.[[BR]][[BR]]~-''SHOW [TABLES]''-~ || + ||SHOW ||<99%>'''Show''' command will list the tables.[[BR]][[BR]]~-''SHOW tables''-~ || + ||DESC ||'''Desc''' command will provides information about the columnfamilies in a table.[[BR]][[BR]]~-''DESC table_name''-~ || - ||CREATE ||'''Create''' will Creating a new table.[[BR]][[BR]]~-''CREATE table_name[[BR]]COLUMNFAMILIES('columnfamily_name1'[, 'columnfamily_name2', ...])[[BR]]LIMIT=limitNumber_of_Version;''-~ || + ||CREATE ||'''Create''' command will create a new table.[[BR]][[BR]]~-''CREATE table_name[[BR]]COLUMNFAMILIES('columnfamily_name1'[, 'columnfamily_name2', ...])[[BR]]LIMIT=limitNumber_of_Version;''-~ || - ||DROP ||'''Drop''' will droping column in a table or tables.[[BR]][[BR]]~-''DROP table_name1[, table_name2, ...];''-~ || + ||DROP ||'''Drop''' command will droping column in a table or tables.[[BR]][[BR]]~-''DROP table_name1[, table_name2, ...];''-~ || - ||SET ||'''Set''' Inserting or add a row of data into the table.[[BR]][[BR]]~-''SET table_name[[BR]] VALUES('columnfamily_name:column_key','entry')[[BR]]WHERE row="row_key";''-~ || - ||SELECT ||'''Select''' Query the Hbase and retrieve selected data.[[BR]][[BR]]~-''SELECT table_name[[BR]][WHERE row="row_key"][[BR]][AND column="columnfamily_name:column_key"];[[BR]][AND time="Specified_Timestamp"];[[BR]][LIMIT=Number_of_Version];''-~ || + ||PRINT ||'''Print''' command will print a results to the console output. [[BR]][[BR]]~-''A = array([1, 2, 3]);[[BR]]PRINT A;[[BR]]B = SELECT table_name WHERE row="rowKey";[[BR]]PRINT B;''-~|| + ||STORE ||'''STORE''' command will store results to specified table. [[BR]][[BR]]~-''M = matrix('table_name','columnfamily_name');[[BR]]A = array([[1, 2],[3, 4]]);[[BR]]STORE A TO M run_style;[[BR]]B = SELECT table_name WHERE row="row_key";[[BR]]STORE B TO ('table_name','columnfamily_name1'[, 'columnfamily_name2']) run_style;''-~|| + And, Commands to manually manipulate data on more detailed parts. + + + ||<#ececec> '''Command''' ||<#ececec> '''Explanation''' || + ||INSERT ||<99%>'''Insert''' command will insert one row into the table with a value for specified column in the table.[[BR]][[BR]]~-''INSERT table_name[[BR]] VALUES('columnfamily_name:column_key','entry')[[BR]]WHERE row="row_key";''-~ || + ||SET ||'''SET''' command will change the values. [[BR]][[BR]]~-''SET table_name[[BR]] VALUES('columnfamily_name:column_key','entry')[[BR]]WHERE row="row_key";''-~|| + ||DELETE ||'''Delete''' command will delete specified rows in table. [[BR]][[BR]]~-''DELETE table_name[[BR]]WHERE row="row_key"[[BR]][AND column="columnfamily_name:column_key"];''-~|| + - === Basic Functions === + === Aggregation Functions === + + ||<#ececec> '''Command''' ||<#ececec> '''Explanation''' || + ||SELECT ||<99%>'''Select''' command will retrieves rows from a table.[[BR]][[BR]]~-''SELECT table_name[[BR]][WHERE row="row_key"][[BR]][AND column="columnfamily_name:column_key"];[[BR]][AND time="Specified_Timestamp"];[[BR]][LIMIT=Number_of_Version];''-~ || + + ... ||<#ececec> '''Function''' ||<#ececec> '''Explanation''' || - ||SHOW ||<99%>Show command provides information about argument.[[BR]][[BR]]~-''SHOW [TABLES]''-~ || - ||... ||... || + ||... ||<99%>... || - The Matrix commands are used to handle a 2D array of numerical data values. + The Matrix commands are used to store a 2D array of numerical data values. [[BR]]A number of routines are provided to manipulate the matrix object directly, illustrated below by simple examples. '''Note''' that vectors should be defined as two-dimensional matrices to distinguish between row and column vectors [[BR]]in order to be able to perform matrix operations consistently. - == Matrix Commands == - - ||<#ececec> '''Command''' ||<#ececec> '''Explanation''' || - ||SHOW ||<99%>Show command provides information about argument.[[BR]][[BR]]~-''SHOW [TABLES]''-~ || - ||... ||... || - === Matrix Construction Functions === + .. - - ||<#ececec> '''Function''' ||<#ececec> '''Explanation''' || - ||SHOW ||<99%>Show command provides information about argument.[[BR]][[BR]]~-''SHOW [TABLES]''-~ || - ||... ||... || - === Matrix Algebra Functions === + .. + === Special functions === + .. - - ||<#ececec> '''Function''' ||<#ececec> '''Explanation''' || - ||SHOW ||<99%>Show command provides information about argument.[[BR]][[BR]]~-''SHOW [TABLES]''-~ || - ||... ||... || ---- = Example Of Hbase Shell Use = .. == Basic Usage == .. - == Basic Matrix Operations == + == Matrix Operations == .. + ---- = Matrix Extension Example On Hbase Shell = .. @@ -97, +93 @@ .. ---- - = People Involved = * [:udanax:Edward Yoon] [EMAIL PROTECTED]
