Skip to content
This repository has been archived by the owner on Apr 19, 2022. It is now read-only.

get_external_config seems not to read config from $HADOOP_HOME/etc #240

Closed
visualskyrim opened this issue Dec 6, 2017 · 1 comment
Closed

Comments

@visualskyrim
Copy link

In the source code here:

def get_external_config(cls):

get_external_conf actually doesn't read core-site.xml or hdfs-site.xml from $HADOOP_HOME/etc.

But in hdfs_try_paths here, snakebite says it tried.

@visualskyrim
Copy link
Author

Sorry, I didn't notice that snakebite is using HADOOP_CONF_HOME too.

My HADOOP_CONF_HOME is set to $HADOOP_HOME/etc/hadoop, which makes me think snakebite is reading $HADOOP/etc.

Since snakebite is using HADOOP_CONF_HOME to find hdfs-site.xml and core-site.xml, I think it would be better to have that in the document.

I created another issue to cover this: #241

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant