Hadoop Credentials

Use Hadoop credential provider API

The CredentialProvider API helps applications manage passwords/secrets. Use the hadoop credential command to get started.

hadoop credential create db2.testdb.alias \
   -provider jceks://hdfs/user/q1234/db2test.password.jceks

Enter alias password: Enter alias password again: db2.testdb has been successfully created. Provider jceks://hdfs/user/q1234/db2test.password.jceks has been updated.

Use the credential in sqoop command

sqoop import -Dhadoop.security.credential.provider.path=jceks://hdfs/user/q1234/db2test.password.jceks \
 — driver com.ibm.db2.jcc.DB2Driver \
 — connection-manager “org.apache.sqoop.manager.GenericJdbcManager” \
 — connect jdbc:db2://invdev:50010/testdb \
 — username testUser \
 — password-alias db2.testdb.alias \
 — table “scratch.document” \
 — target-dir /etl/document/