sqoop example

export HIVE_HOME=/usr/lib/hive
export HADOOP_HOME=/usr/lib/hadoop

sqoop import --connect jdbc:mysql://***.ipdisk.co.kr/sqoop --username xxxx --password xxxx \
--table abc \
--split-by aaa \
--target-dir /user/root/results

[root@localhost lib]# sqoop import --connect jdbc:mysql://***.ipdisk.co.kr/sqoop --username xxxx --password xxxx--table abc --split-by aaa --target-dir /user/root/results
13/04/19 20:59:11 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
13/04/19 20:59:11 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
13/04/19 20:59:11 INFO tool.CodeGenTool: Beginning code generation
13/04/19 20:59:12 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `abc` AS t LIMIT 1
13/04/19 20:59:12 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `abc` AS t LIMIT 1
13/04/19 20:59:12 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/lib/hadoop-0.20-mapreduce
13/04/19 20:59:12 INFO orm.CompilationManager: Found hadoop core jar at: /usr/lib/hadoop-0.20-mapreduce/hadoop-core.jar
Note: /tmp/sqoop-root/compile/e12b8fe38c2de2a2a7d74fbfc0f02654/abc.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
13/04/19 20:59:15 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/e12b8fe38c2de2a2a7d74fbfc0f02654/abc.jar
13/04/19 20:59:15 WARN manager.MySQLManager: It looks like you are importing from mysql.
13/04/19 20:59:15 WARN manager.MySQLManager: This transfer can be faster! Use the --direct
13/04/19 20:59:15 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
13/04/19 20:59:15 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)
13/04/19 20:59:15 INFO mapreduce.ImportJobBase: Beginning import of abc
13/04/19 20:59:17 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
13/04/19 20:59:20 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(`aaa`), MAX(`aaa`) FROM `abc`
13/04/19 20:59:20 WARN db.TextSplitter: Generating splits for a textual index column.
13/04/19 20:59:20 WARN db.TextSplitter: If your database sorts in a case-insensitive order, this may result in a partial import or duplicate records.
13/04/19 20:59:20 WARN db.TextSplitter: You are strongly encouraged to choose an integral split column.
13/04/19 20:59:21 INFO mapred.JobClient: Running job: job_201304191942_0003
13/04/19 20:59:22 INFO mapred.JobClient:  map 0% reduce 0%
13/04/19 20:59:36 INFO mapred.JobClient:  map 25% reduce 0%
13/04/19 20:59:42 INFO mapred.JobClient:  map 50% reduce 0%
13/04/19 20:59:48 INFO mapred.JobClient:  map 75% reduce 0%
13/04/19 20:59:54 INFO mapred.JobClient:  map 100% reduce 0%
13/04/19 20:59:57 INFO mapred.JobClient: Job complete: job_201304191942_0003
13/04/19 20:59:57 INFO mapred.JobClient: Counters: 23
13/04/19 20:59:57 INFO mapred.JobClient:   File System Counters
13/04/19 20:59:57 INFO mapred.JobClient:     FILE: Number of bytes read=0
13/04/19 20:59:57 INFO mapred.JobClient:     FILE: Number of bytes written=646396
13/04/19 20:59:57 INFO mapred.JobClient:     FILE: Number of read operations=0
13/04/19 20:59:57 INFO mapred.JobClient:     FILE: Number of large read operations=0
13/04/19 20:59:57 INFO mapred.JobClient:     FILE: Number of write operations=0
13/04/19 20:59:57 INFO mapred.JobClient:     HDFS: Number of bytes read=435
13/04/19 20:59:57 INFO mapred.JobClient:     HDFS: Number of bytes written=78
13/04/19 20:59:57 INFO mapred.JobClient:     HDFS: Number of read operations=4
13/04/19 20:59:57 INFO mapred.JobClient:     HDFS: Number of large read operations=0
13/04/19 20:59:57 INFO mapred.JobClient:     HDFS: Number of write operations=4
13/04/19 20:59:57 INFO mapred.JobClient:   Job Counters
13/04/19 20:59:57 INFO mapred.JobClient:     Launched map tasks=4
13/04/19 20:59:57 INFO mapred.JobClient:     Total time spent by all maps in occupied slots (ms)=32992
13/04/19 20:59:57 INFO mapred.JobClient:     Total time spent by all reduces in occupied slots (ms)=0
13/04/19 20:59:57 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
13/04/19 20:59:57 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
13/04/19 20:59:57 INFO mapred.JobClient:   Map-Reduce Framework
13/04/19 20:59:57 INFO mapred.JobClient:     Map input records=9
13/04/19 20:59:57 INFO mapred.JobClient:     Map output records=9
13/04/19 20:59:57 INFO mapred.JobClient:     Input split bytes=435
13/04/19 20:59:57 INFO mapred.JobClient:     Spilled Records=0
13/04/19 20:59:57 INFO mapred.JobClient:     CPU time spent (ms)=4710
13/04/19 20:59:57 INFO mapred.JobClient:     Physical memory (bytes) snapshot=400191488
13/04/19 20:59:57 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=3102826496
13/04/19 20:59:57 INFO mapred.JobClient:     Total committed heap usage (bytes)=262733824
13/04/19 20:59:57 INFO mapreduce.ImportJobBase: Transferred 78 bytes in 41.0511 seconds (1.9001 bytes/sec)
13/04/19 20:59:57 INFO mapreduce.ImportJobBase: Retrieved 9 records.
[root@localhost lib]#