Pivotal Knowledge Base

Follow

External table query with GPHDFS error: "sh: GPHOME/lib//hadoop/hadoop_env.sh: No such file or directory"

Environment

Pivotal Greenplum: 4.3.13.0, 4.3.13.14.0

OS: RHEL 6.x

Symptom

A simple query on an external table with GPHDFS protocol failed.

Error Message:

gpadmin=# CREATE EXTERNAL TABLE cmp_extract_test 
gpadmin-# (
gpadmin(# survey_id text,
gpadmin(# criteria text,
gpadmin(# value text
gpadmin(# )
gpadmin-# LOCATION ('gphdfs://nameservice1/user/gpadmin/h.csv')
gpadmin-# FORMAT 'CSV' (DELIMITER ',');
CREATE EXTERNAL TABLE
gpadmin=# select * from cmp_extract_test limit 1;
ERROR: external table gphdfs protocol command ended with error. sh: GPHOME/lib//hadoop/hadoop_env.sh: No such file or directory (seg6 slice1 sdw-2.gdn.hitwise.com:40000 pid=9873)
DETAIL: Exception in thread "main" java.lang.NoClassDefFoundError: 6
Caused by: java.lang.ClassNotFoundException: 6
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoad
Command: source $GPHOME/lib//hadoop/hadoop_env.sh;java $GP_JAVA_OPT -classpath $CLASSPATH com.emc.greenplum.gpdb.hdfsconnector.HDFSReader $GP_SEGMENT_ID $GP_SEGMENT_COUNT TEXT cdh4.1-gnet-1.2.0.0 'gphdfs://nameservice1/user/gpadmin/h.csv' '000000002500044000000002500044000000002500044' 'survey_id,criteria,value,'
External table cmp_extract_test, file gphdfs://nameservice1/user/gpadmin/h.csv
gpadmin=#

Cause 

This is caused by a software defect in 4.3.13.0 and 4.3.14.0 which will break the normal functionality of GPHDFS.

Resolution

The software defect will be fixed in 4.3.14.1. Before the fix is ready, please avoid upgrading to Greenplum releases 4.3.13.0 and 4.3.14.0 if GPHDFS is used.

If upgrade to those 2 releases has already been done on system where GPHDFS functionality is mandatory, then consider downgrading the system to 4.3.12.0 or an older release.

 

Comments

Powered by Zendesk