Dear Wiki user, You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.
The following page has been changed by udanax: http://wiki.apache.org/lucene-hadoop/HbaseShell ------------------------------------------------------------------------------ + [[TableOfContents(4)]] + ---- + = Hbase Shell Introduction = + - Hbase Shell is an 'interpreter' (or 'shell)' to provide scalable data processing capabilities like + Hbase Shell is an 'interpreter' (or 'shell)' to provide scalable data processing capabilities like [[BR]]aggregation, algebraic calculation on Hadoop + Hbase. == Hbase Shell Goals == + HBase Shell is developed to achieve the following goals. + * Generic Query Model Functions - HBase Shell is developed to achieve the following goals. - - * Generic Monitoring Function - * A Simplified Import/Export/Migrate Functionality Between different data sources (Hadoop, HBase) + * A Simplified Import/Export/Migrate Functionality Between different data sources (Hadoop, HBase) - * A Simplified processing of a logical data model + * A Simplified processing of a logical data model - * A Simplified algebraic operations + * A Simplified algebraic operations - * Parallel Numerical Analysis by abstracting/numericalizing points, lines, or plane data across multiple maps in HBase. + * Parallel Numerical Analysis by abstracting/numericalizing points, lines, or plane data across multiple maps in HBase. == Background == - - I expect Hadoop + Hbase to handle sparsity and data explosion very well in near future. - [[BR]]Moreover, i believe the design of the multi-dimensional structure and the 3-dim space model of the data are [[BR]]optimized for rapid ad-hoc information retrieval in any orientation, as well as for fast, flexible calculation and transformation of [[BR]]raw data based on formulaic relationships. + I expect Hadoop + Hbase to handle sparsity and data explosion very well in near future. [[BR]]Moreover, i believe the design of the multi-dimensional structure and the 3-dim space model of the data are [[BR]]optimized for rapid ad-hoc information retrieval in any orientation, as well as for fast, flexible calculation and transformation of [[BR]]raw data based on formulaic relationships. Then, I thought it would require a more user-friendly interface to enable querying the data interactive. [[BR]]So, I began building parallel processing shell [[BR]]to help make general algebraic and logical data modeling works easier on Hadoop + Hbase -- ''If you could give me an opinion on the above ideas, it would be great.'' - == Syntax Definition == + == Rationale == - === Basic Commands === + writing... + {{{ + ... Bigtable takes care of all the data layout, compression, and access chores associated with a large + data store. It presents the abstraction of a 2-dimensional table of data cells, with different versions over time making up a third dimension ... + + - Failure Trends in a Large Disk Drive Population (Google) + }}} + + ---- + = Hbase Shell Syntax Definition = + + writing... + + == Basic Commands == + - ||<#ececec> '''Command''' ||<#ececec> '''Description''' || + ||<#ececec> '''Command''' ||<#ececec> '''Explanation''' || - ||SHOW ||<99%>Show command provides information about argument.[[BR]][[BR]]~-''SHOW [TABLES]''-~ || + ||SHOW ||<99%>'''Show''' command provides information about argument.[[BR]][[BR]]~-''SHOW [TABLES]''-~ || - ||CREATE ||Creating a new table.[[BR]][[BR]]~-''CREATE table_name[[BR]]COLUMNFAMILIES('columnfamily_name1'[, 'columnfamily_name2', ...])[[BR]]LIMIT=limitNumber_of_Version;''-~ || + ||CREATE ||'''Create''' will Creating a new table.[[BR]][[BR]]~-''CREATE table_name[[BR]]COLUMNFAMILIES('columnfamily_name1'[, 'columnfamily_name2', ...])[[BR]]LIMIT=limitNumber_of_Version;''-~ || - ||DROP ||Removing table or tables.[[BR]][[BR]]~-''DROP table_name1[, table_name2, ...];''-~ || + ||DROP ||'''Drop''' will droping column in a table or tables.[[BR]][[BR]]~-''DROP table_name1[, table_name2, ...];''-~ || - ||SET ||Inserting or add a row of data into the table.[[BR]][[BR]]~-''SET table_name[[BR]] VALUES('columnfamily_name:column_key','entry')[[BR]]WHERE row="row_key";''-~ || + ||SET ||'''Set''' Inserting or add a row of data into the table.[[BR]][[BR]]~-''SET table_name[[BR]] VALUES('columnfamily_name:column_key','entry')[[BR]]WHERE row="row_key";''-~ || - ||SELECT ||Query the Hbase and retrieve selected data.[[BR]][[BR]]~-''SELECT table_name[[BR]][WHERE row="row_key"][[BR]][AND column="columnfamily_name:column_key"];[[BR]][AND time="Specified_Timestamp"];[[BR]][LIMIT=Number_of_Version];''-~ || + ||SELECT ||'''Select''' Query the Hbase and retrieve selected data.[[BR]][[BR]]~-''SELECT table_name[[BR]][WHERE row="row_key"][[BR]][AND column="columnfamily_name:column_key"];[[BR]][AND time="Specified_Timestamp"];[[BR]][LIMIT=Number_of_Version];''-~ || === Basic Functions === + ||<#ececec> '''Function''' ||<#ececec> '''Explanation''' || + ||SHOW ||<99%>Show command provides information about argument.[[BR]][[BR]]~-''SHOW [TABLES]''-~ || + ||... ||... || + + The Matrix commands are used to handle a 2D array of numerical data values. + [[BR]]A number of routines are provided to manipulate the matrix object directly, illustrated below by simple examples. + + '''Note''' that vectors should be defined as two-dimensional matrices to distinguish between row and column vectors + [[BR]]in order to be able to perform matrix operations consistently. + - === Matrix Commands === + == Matrix Commands == + + ||<#ececec> '''Command''' ||<#ececec> '''Explanation''' || + ||SHOW ||<99%>Show command provides information about argument.[[BR]][[BR]]~-''SHOW [TABLES]''-~ || + ||... ||... || === Matrix Construction Functions === - === Matrix Operation Functions === + ||<#ececec> '''Function''' ||<#ececec> '''Explanation''' || + ||SHOW ||<99%>Show command provides information about argument.[[BR]][[BR]]~-''SHOW [TABLES]''-~ || + ||... ||... || - === Analysis Functions === + === Matrix Algebra Functions === - ==== Architecture ==== + ||MULTIPLY ||'''Multiply''' will determine the product of two matrices. The number of columns in the left matrix must match the number of rows in the right matrix. || + ||SUBTRACT ||'''Subtract''' will determine the difference of two matrices. The matrix may be subtracted from itself, and the result matrix may be either of the two input matrices. The right matrix is subtracted from the left matrix. || + ||SYMMETRIZE ||'''Symmetrize''' will symmetrize a real square matrix. If the result matrix does not exist at the time of the command, it is created. If the result matrix does exist, all previous information is lost. The result matrix may be the same as the input matrix. || + ||TRANSPOSE ||'''Transpose''' a matrix. If the result matrix does not exist at the time of the command, it is created. If the result matrix does exist, all previous information is lost. The result matrix may be the same as the input matrix, but results in a matrix filled with zero-valued elements. || + ||... ||... || + + ---- + = Example Of Hbase Shell Use = + .. + == Basic Usage == + .. + == Basic Matrix Operations == + + '''Not Good.... It Just writing =_=;''' + {{{ + Hbase > A = Matrix(table_m,columnfamily_a); + Hbase > B = Matrix(table_m,columnfamily_b); + Hbase > A.random(2,2); + Hbase > B.random(2,2); + + table_m + + columnfamily_a columnfamily_b columnfamily_b + column_1 column_2 column_1 column_2 column_1 column_2 + row_1 1 0 row_1 0 2 row_1 3 3 + row_2 0 0 row_2 1 0 row_2 3 3 + }}} - == Involved == + ---- + = Matrix Extension Example On Hbase Shell = + .. + == Latent Semantic Analysis By Singular Value Decomposition == + .. + == Scalable Collaborative Filtering With A Large User-By-Item Matrix == + .. + == Consistency Assessment Of Topological Relationship By Matrix-Union == + .. + ---- + + = People Involved = + - * [wiki:udanax Edward Yoon] [EMAIL PROTECTED] + * [:udanax:Edward Yoon] [EMAIL PROTECTED] * Sewon Kim [EMAIL PROTECTED] * Wonhyung Cha [EMAIL PROTECTED]
