hdfscheck fails

3 posts / 0 new
Last post
squalloser
squalloser's picture
Offline
Last seen: 2 weeks 2 days ago
Joined: Apr 22 2014
Junior Boarder

Posts: 6

Stephan Derp
hdfscheck fails

The following fails:

export JAVA_HOME=/usr/lib/jvm/j2sdk1.6-oracle
export LD_LIBRARY_PATH=/usr/lib/jvm/j2sdk1.6-oracle/jre/lib/amd64/server

./setenv-hdfs-20

 

./hdfsCheck /usr/local/Calpont/lib/hdfs-20.so

ERROR: HDFS plugin not installed /usr/local/Calpont/lib/hdfs-20.so

log msg: IDBFile[12435]: 32.395078 |0|0|0| E 35 CAL0002: IDBFactory::installPlugin: dlopen for /usr/local/Calpont/lib/hdfs-20.so failed: libhdfs.so.0.0.0: cannot open shared object file: No such file or directory
 

OS: Ubuntu LTS 12.04

InfiniDB version: 4.5.0-1

Hadoop: CDH4.6

squalloser
squalloser's picture
Offline
Last seen: 2 weeks 2 days ago
Joined: Apr 22 2014
Junior Boarder

Posts: 6

Stephan Derp
I created a link to the

I created a link to the libhdfs.so.0.0.0 file in /usr/local/Calpont/lib:

libhdfs.so.0.0.0 -> /opt/cloudera/parcels/CDH-4.6.0-1.cdh4.6.0.p0.26/lib/libhdfs.so.0.0.0

 

now the hdfscheck fails with another error msg:

Environment variable CLASSPATH not set!
getJNIEnv: getGlobalJNIEnv failed
Test-0:INFO:Running test for file type HDFS
Test-0:INFO:Running writeTest
Environment variable CLASSPATH not set!
getJNIEnv: getGlobalJNIEnv failed
Environment variable CLASSPATH not set!
getJNIEnv: getGlobalJNIEnv failed
Test-0:ERROR:Unable to open /tmp/idbdf-dir-20100-0/foobar for writing

 

It worked after I ran . /root/setenv-hdfs-20
Thanks.

 

squalloser
squalloser's picture
Offline
Last seen: 2 weeks 2 days ago
Joined: Apr 22 2014
Junior Boarder

Posts: 6

Stephan Derp
The first issue was that the

The first issue was that the link to the libhdfs.so.0.0.0 file was not created in /usr/local/Calpont/lib. I have the same issue on a cluster that I'm trying to set up. Hdfscheck doesn't pass because it can't find libhdfs.so.0.0.0. After I create the missing link hdfscheck passes. Any ideas why this could be happening?

 

Thanks