TEZ-3331: Add operation specific HDFS counters for Tez UI

[abstractdog]

This a rebased, reworked version of the last patch on TEZ-3331:
https://issues.apache.org/jira/secure/attachment/12926702/TEZ-3331.8.patch

[tez-yetus]

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 10s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s	The patch appears to include 3 new or modified test files.
		_ master Compile Tests _
+0 🆗	mvndep	4m 33s	Maven dependency ordering for branch
+1 💚	mvninstall	6m 59s	master passed
+1 💚	compile	0m 42s	master passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu322.04
+1 💚	compile	0m 36s	master passed with JDK Private Build-1.8.0_422-8u422-b05-1~22.04-b05
+1 💚	checkstyle	0m 46s	master passed
+1 💚	javadoc	0m 49s	master passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu322.04
+1 💚	javadoc	0m 35s	master passed with JDK Private Build-1.8.0_422-8u422-b05-1~22.04-b05
+0 🆗	spotbugs	0m 30s	Used deprecated FindBugs config; considering switching to SpotBugs.
+1 💚	findbugs	1m 44s	master passed
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 8s	Maven dependency ordering for patch
+1 💚	mvninstall	0m 29s	the patch passed
+1 💚	compile	0m 30s	the patch passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu322.04
+1 💚	javac	0m 30s	the patch passed
+1 💚	compile	0m 25s	the patch passed with JDK Private Build-1.8.0_422-8u422-b05-1~22.04-b05
+1 💚	javac	0m 25s	the patch passed
-0 ⚠️	checkstyle	0m 7s	tez-api: The patch generated 22 new + 0 unchanged - 0 fixed = 22 total (was 0)
-0 ⚠️	checkstyle	0m 6s	tez-runtime-internals: The patch generated 6 new + 16 unchanged - 1 fixed = 22 total (was 17)
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	xml	0m 0s	The patch has no ill-formed XML file.
+1 💚	javadoc	0m 22s	the patch passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu322.04
+1 💚	javadoc	0m 24s	the patch passed with JDK Private Build-1.8.0_422-8u422-b05-1~22.04-b05
+1 💚	findbugs	1m 16s	the patch passed
		_ Other Tests _
+1 💚	unit	1m 56s	tez-api in the patch passed.
+1 💚	unit	0m 33s	tez-runtime-internals in the patch passed.
+1 💚	asflicense	0m 17s	The patch does not generate ASF License warnings.
		24m 21s

Subsystem	Report/Notes
Docker	ClientAPI=1.47 ServerAPI=1.47 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-379/2/artifact/out/Dockerfile
GITHUB PR	#379
JIRA Issue	TEZ-3331
Optional Tests	dupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile xml
uname	Linux b8504bb48bab 5.15.0-124-generic #134-Ubuntu SMP Fri Sep 27 20:20:17 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	personality/tez.sh
git revision	master / 19b1423
Default Java	Private Build-1.8.0_422-8u422-b05-1~22.04-b05
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu322.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_422-8u422-b05-1~22.04-b05
checkstyle	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-379/2/artifact/out/diff-checkstyle-tez-api.txt
checkstyle	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-379/2/artifact/out/diff-checkstyle-tez-runtime-internals.txt
Test Results	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-379/2/testReport/
Max. process+thread count	357 (vs. ulimit of 5500)
modules	C: tez-api tez-runtime-internals U: .
Console output	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-379/2/console
versions	git=2.34.1 maven=3.6.3 findbugs=3.0.1
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

[tez-yetus]

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 10s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s	The patch appears to include 3 new or modified test files.
		_ master Compile Tests _
+0 🆗	mvndep	6m 0s	Maven dependency ordering for branch
+1 💚	mvninstall	10m 36s	master passed
+1 💚	compile	0m 41s	master passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu322.04
+1 💚	compile	0m 39s	master passed with JDK Private Build-1.8.0_422-8u422-b05-1~22.04-b05
+1 💚	checkstyle	0m 52s	master passed
+1 💚	javadoc	0m 52s	master passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu322.04
+1 💚	javadoc	0m 33s	master passed with JDK Private Build-1.8.0_422-8u422-b05-1~22.04-b05
+0 🆗	spotbugs	0m 25s	Used deprecated FindBugs config; considering switching to SpotBugs.
+1 💚	findbugs	1m 23s	master passed
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 7s	Maven dependency ordering for patch
+1 💚	mvninstall	0m 26s	the patch passed
+1 💚	compile	0m 25s	the patch passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu322.04
+1 💚	javac	0m 25s	the patch passed
+1 💚	compile	0m 22s	the patch passed with JDK Private Build-1.8.0_422-8u422-b05-1~22.04-b05
+1 💚	javac	0m 22s	the patch passed
+1 💚	checkstyle	0m 7s	The patch passed checkstyle in tez-api
+1 💚	checkstyle	0m 6s	tez-runtime-internals: The patch generated 0 new + 16 unchanged - 1 fixed = 16 total (was 17)
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	xml	0m 1s	The patch has no ill-formed XML file.
+1 💚	javadoc	0m 22s	the patch passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu322.04
+1 💚	javadoc	0m 24s	the patch passed with JDK Private Build-1.8.0_422-8u422-b05-1~22.04-b05
+1 💚	findbugs	1m 8s	the patch passed
		_ Other Tests _
+1 💚	unit	1m 53s	tez-api in the patch passed.
+1 💚	unit	0m 39s	tez-runtime-internals in the patch passed.
+1 💚	asflicense	0m 17s	The patch does not generate ASF License warnings.
		28m 53s

Subsystem	Report/Notes
Docker	ClientAPI=1.47 ServerAPI=1.47 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-379/3/artifact/out/Dockerfile
GITHUB PR	#379
JIRA Issue	TEZ-3331
Optional Tests	dupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile xml
uname	Linux 75e1b1dfb889 5.15.0-124-generic #134-Ubuntu SMP Fri Sep 27 20:20:17 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	personality/tez.sh
git revision	master / 19b1423
Default Java	Private Build-1.8.0_422-8u422-b05-1~22.04-b05
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu322.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_422-8u422-b05-1~22.04-b05
Test Results	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-379/3/testReport/
Max. process+thread count	573 (vs. ulimit of 5500)
modules	C: tez-api tez-runtime-internals U: .
Console output	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-379/3/console
versions	git=2.34.1 maven=3.6.3 findbugs=3.0.1
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.