Wrong proxyUser when connect to Kyuubi using beeline from Spark distribution

[akizminet]

Code of Conduct

• I agree to follow this project's Code of Conduct

Search before asking

• I have searched in the issues and found no similar issues.

Describe the bug

beeline command:

[phamnv@fedora spark-3.2.0-bin-hadoop3.2]$ bin/beeline -u jdbc:hive2://fedora:10009/default --hivevar hive.server2.proxy.user=phamnv -n kyuubi -p password

proxyUser is null because confKey is set:hivevar:hive.server2.proxy.user:

When put hive.server2.proxy.user to jdbc string, realUser will become anonymous

[phamnv@fedora spark-3.2.0-bin-hadoop3.2]$ bin/beeline -u jdbc:hive2://fedora:10009/default;#hive.server2.proxy.user=phamnv -n kyuubi -p password

Affects Version(s)

1.4.0-incubating

Kyuubi Server Log Output

No response

Kyuubi Engine Log Output

No response

Kyuubi Server Configurations

default

Kyuubi Engine Configurations

default

Additional context

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

[yaooqinn]

jdbc:hive2://fedora:10009/default;hive.server2.proxy.user=phamnv

try after removing #

[akizminet]

bin/beeline -u jdbc:hive2://fedora:10009/default;hive.server2.proxy.user=phamnv -n kyuubi -p password

@yaooqinn proxy-user is anonymous

2021-12-20 12:21:31.517 INFO server.KyuubiServer: Service[KyuubiServer] is started.
2021-12-20 12:21:31.518 INFO server.KyuubiThriftBinaryFrontendService: Starting and exposing JDBC connection at: jdbc:hive2://fedora:10009/
2021-12-20 12:21:38.381 INFO server.KyuubiThriftBinaryFrontendService: Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V10
2021-12-20 12:21:52.406 INFO operation.LaunchEngine: Processing anonymous's query[c9631d70-ef3e-481f-b6a9-e09fc97a3be6]: INITIALIZED_STATE -> PENDING_STATE, statement: LAUNCH_ENGINE
2021-12-20 12:21:52.407 INFO operation.LaunchEngine: Processing anonymous's query[c9631d70-ef3e-481f-b6a9-e09fc97a3be6]: PENDING_STATE -> RUNNING_STATE, statement: LAUNCH_ENGINE
2021-12-20 12:21:52.408 INFO imps.CuratorFrameworkImpl: Starting
2021-12-20 12:21:52.408 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=fedora:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@37ae9394
2021-12-20 12:21:52.409 INFO zookeeper.ClientCnxn: Opening socket connection to server fedora/192.168.5.7:2181. Will not attempt to authenticate using SASL (unknown error)
2021-12-20 12:21:52.410 INFO zookeeper.ClientCnxn: Socket connection established to fedora/192.168.5.7:2181, initiating session
2021-12-20 12:21:52.410 INFO server.NIOServerCnxnFactory: Accepted socket connection from /192.168.5.7:35892
2021-12-20 12:21:52.410 INFO server.ZooKeeperServer: Client attempting to establish new session at /192.168.5.7:35892
2021-12-20 12:21:52.414 INFO server.ZooKeeperServer: Established session 0x10000da0dbb0001 with negotiated timeout 60000 for client /192.168.5.7:35892
2021-12-20 12:21:52.414 INFO zookeeper.ClientCnxn: Session establishment complete on server fedora/192.168.5.7:2181, sessionid = 0x10000da0dbb0001, negotiated timeout = 60000
2021-12-20 12:21:52.415 INFO state.ConnectionStateManager: State change: CONNECTED
2021-12-20 12:21:52.427 INFO server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x10000da0dbb0001 type:create cxid:0x2 zxid:0x5 txntype:-1 reqpath:n/a Error Path:/kyuubi_USER/lock/anonymous/default/locks Error:KeeperErrorCode = NoNode for /kyuubi_USER/lock/anonymous/default/locks
2021-12-20 12:21:52.432 WARN utils.ZKPaths: The version of ZooKeeper being used doesn't support Container nodes. CreateMode.PERSISTENT will be used instead.
2021-12-20 12:21:52.459 INFO server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x10000da0dbb0001 type:create cxid:0xf zxid:0xc txntype:-1 reqpath:n/a Error Path:/kyuubi_USER/lock/anonymous/default/leases Error:KeeperErrorCode = NoNode for /kyuubi_USER/lock/anonymous/default/leases
2021-12-20 12:21:52.501 INFO engine.EngineRef: Launching engine:
/home/phamnv/apps/spark-3.2.0-bin-hadoop3.2/bin/spark-submit \
	--class org.apache.kyuubi.engine.spark.SparkSQLEngine \
	--conf spark.hive.server2.thrift.resultset.default.fetch.size=1000 \
	--conf spark.kyuubi.ha.zookeeper.quorum=fedora:2181 \
	--conf spark.app.name=kyuubi_USER_SPARK_SQL_anonymous_default_dbaba268-c8ae-4729-8d49-96174279f8bc \
	--conf spark.kyuubi.ha.engine.ref.id=dbaba268-c8ae-4729-8d49-96174279f8bc \
	--conf spark.kyuubi.ha.zookeeper.auth.type=NONE \
	--conf spark.yarn.tags=KYUUBI \
	--conf spark.kyuubi.ha.zookeeper.namespace=/kyuubi_USER_SPARK_SQL/anonymous/default \
	--proxy-user anonymous /home/phamnv/Downloads/apache-kyuubi-1.4.0-incubating-bin/externals/engines/spark/kyuubi-spark-sql-engine_2.12-1.4.0-incubating.jar
2021-12-20 12:21:52.514 INFO engine.ProcBuilder: Logging to /home/phamnv/Downloads/apache-kyuubi-1.4.0-incubating-bin/work/anonymous/kyuubi-spark-sql-engine.log.4

[yaooqinn]

bin/beeline -u 'jdbc:hive2://10.242.189.214:10009/;hive.server2.proxy.user=kent' -n kentyao

2021-12-20 13:27:29.062 ERROR server.KyuubiThriftBinaryFrontendService: Error opening session:
org.apache.kyuubi.KyuubiSQLException: Failed to validate proxy privilege of kentyao for kent

I tried locally, the realUser and proxyUser seemed to be correct

[akizminet]

Yes. Sorry, I forgot quotes. realUser and proxyUser are correct now.

[yaooqinn]

you need to quote 'jdbc:hive2://fedora:10009/default;hive.server2.proxy.user=phamnv'

[akizminet]

So I think we can close this issue.

[yaooqinn]

I will transfer this to disscussions

[akizminet]

Thank you for your help

[yaooqinn]

my pleasure. I did not notice such behavior before. I looks good to document it. are you interested？