user@master ~ $ export DBID=帳號 user@master ~ $ sqoop import --connect "jdbc:mysql://master.3du.me/$DBID" --table mysql_data --username $DBID -P --hbase-row-key id --hbase-create-table --column-family data --hbase-table my_$DBID Enter password: 輸入密碼
13/12/22 16:09:37 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset. 13/12/22 16:09:37 INFO tool.CodeGenTool: Beginning code generation 13/12/22 16:09:38 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `mysql_data` AS t LIMIT 1 13/12/22 16:09:38 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `mysql_data` AS t LIMIT 1 13/12/22 16:09:38 INFO orm.CompilationManager: HADOOP_HOME is /opt/hadoopmr Note: /tmp/sqoop-user/compile/0caa2db5c9f9ebce85eda6c97028fc0f/mysql_data.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. 13/12/22 16:09:41 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-user/compile/0caa2db5c9f9ebce85eda6c97028fc0f/mysql_data.jar 13/12/22 16:09:41 WARN manager.MySQLManager: It looks like you are importing from mysql. 13/12/22 16:09:41 WARN manager.MySQLManager: This transfer can be faster! Use the --direct 13/12/22 16:09:41 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path. 13/12/22 16:09:41 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql) 13/12/22 16:09:41 INFO mapreduce.ImportJobBase: Beginning import of mysql_data ... 略 ... 13/12/22 16:11:11 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 78.9235 seconds (0 bytes/sec) 13/12/22 16:11:11 INFO mapreduce.ImportJobBase: Retrieved 2 records.
user@master ~ $ hadoop fs -ls /hbase/my_$DBID No encryption was performed by peer. Found 3 items -rw------- 3 etu supergroup 559 2013-12-22 16:09 /hbase/mysql_data/.tableinfo.0000000001 drwxr-xr-x - etu supergroup 0 2013-12-22 16:09 /hbase/mysql_data/.tmp drwx------ - etu supergroup 0 2013-12-22 16:09 /hbase/mysql_data/595da9f76c44dcd9cb22ab6a4c8cdc61
hbase shell 指令查詢
user@master ~ $ hbase shell HBase Shell; enter 'help' for list of supported commands. Type "exit " to leave the HBase Shell Version 0.92.1-cdh4.0.1, r, Thu Jun 28 18:04:29 PDT 2012 hbase(main):001:0> list TABLE MSSQL_DATA _acl_ mysql_data 3 row(s) in 2.0240 seconds