Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add HADOOP_YARN_HOME for %service_env in deploy_yarn.py #16

Open
hpttlook opened this issue Jan 6, 2014 · 1 comment
Open

add HADOOP_YARN_HOME for %service_env in deploy_yarn.py #16

hpttlook opened this issue Jan 6, 2014 · 1 comment
Assignees

Comments

@hpttlook
Copy link

hpttlook commented Jan 6, 2014

Cloudera CDH4 is based on apache hadoop 2.0.0 version. Currently the latest version of hadoop is apache hadoop 2.2.0, big differences are exists between this two versions. In my test with minos + apache hadoop 2.2.0, the mapreduce job always failed due to some error like, "cannot find the main class xxxx, ClassNotDefined Exception".

After some debug things, it is proved the problem is caused by %service_env.

In hadoop 2.0.0, the follwing environment variables are used,
HADOOP_HDFS_HOME
HADOOP_COMMON_HOME
YARN_HOME

But in hadoop 2.2.0, the following variales are used
HADOOP_HDFS_HOME
HADOOP_COMMON_HOME
HADOOP_YARN_HOME
HADOOP_MAPRED_HOME,

so adding HADOOP_YARN_HOME and HADOOP_MAPRED_HOME to service_env makes it works for both CDH4 and apache hadoop 2.2.0 versions.

@ghost ghost assigned renozhang Jan 6, 2014
@wuzesheng
Copy link
Contributor

@renozhang Can you make sure of this issue?
BTW: Thanks @hpttlook

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants