Pivotal Knowledge Base

Follow

Create filespace failed with "could not create filespace directory ... Input/output error"

Environment

  • PHD 1.1.0
  • HDB 1.1.3

Symptom

bash-4.1$ gpfilespace --config ./gpfilespace_config_20131104_205746 -p 10432
20131112:08:04:22:023198 gpfilespace:gphd1:gpadmin-[INFO]:-
A tablespace requires a file system location to store its database
files. A filespace is a collection of file system locations for all components
in a Greenplum system (primary segment, mirror segment and master instances).
Once a filespace is created, it can be used by one or more tablespaces.
 
 
20131112:08:04:22:023198 gpfilespace:gphd1:gpadmin-[INFO]:-getting config
Reading Configuration file: './gpfilespace_config_20131104_205746'
20131112:08:04:23:023198 gpfilespace:gphd1:gpadmin-[INFO]:-Performing validation on paths
..............................................................................
 
20131112:08:04:23:023198 gpfilespace:gphd1:gpadmin-[INFO]:-Connecting to database
20131112:08:04:28:023198 gpfilespace:gphd1:gpadmin-[ERROR]:-error 'ERROR:  could not create filespace directory hdfs://gphd1.sh-hd.emc.com:8020/hawq/hdfs/gpseg0: Input/output error
' in '
CREATE FILESPACE hdfs_default ON hdfs
(
  1: '/data/master/hdfs_hdfs_default0/gpseg-1',
  2: 'gphd1.sh-hd.emc.com:8020/hawq/hdfs/gpseg0',
  3: 'gphd1.sh-hd.emc.com:8020/hawq/hdfs/gpseg1'
) WITH (NUMREPLICA = 3);'

The following is observed in the namenode logs when gpfilespace command attemped to create the hdfs data directories

2013-11-12 08:17:06,965 WARN org.apache.hadoop.ipc.Server: Incorrect header or version mismatch from 192.168.3.13:46979 got version 8 expected version 7
2013-11-12 08:17:08,408 WARN org.apache.hadoop.ipc.Server: Incorrect header or version mismatch from 192.168.3.13:46980 got version 8 expected version 7
2013-11-12 08:17:09,710 WARN org.apache.hadoop.ipc.Server: Incorrect header or version mismatch from 192.168.3.13:46981 got version 8 expected version 7
2013-11-12 08:17:10,882 WARN org.apache.hadoop.ipc.Server: Incorrect header or version mismatch from 192.168.3.13:46982 got version 8 expected version 7 

Cause

In this case the namenode reports version mismatch because user was attempting to create a filespace on a different PHD cluster running PHD 1.0.1.  Hawq version 1.1.3 is not supported with PHD 1.0.1

Here is a table outlining the hawq and phd compatibility.  Hawq and PHD are tested and released in the same release cycle.  It is best to upgrade both hawq and PHD during maintenance planning to ensure compatibility and not one or the other.

Hawq PHD Apache Hadoop Release
1.1.0.0 1.0.1.0 2.0.2
1.1.3.0 1.1.0.0 2.0.5
1.1.4.0 1.1.1.0 2.0.5
1.2.0.1 2.0.1.0 2.2.0

Comments

Powered by Zendesk