Pivotal Knowledge Base

Follow

HAWQ Queries Failing after NameNode Failover

Environment

 Product  Version
 Pivotal HDB  2.0.0

Symptom

Whenever Standby Namenode is acting as active Namenode, you are not able to create HAWQ external tables. Once switched over to the active Namenode, external tables can be created in HAWQ.

Cause

The HAWQ filespace command

hawq filespace --movefilespace default --location=hdfs://hdfs-cluster/hawq_new_filespace

in the Hawq documentation is misleading. The users are told to replace “default” in the command with the current non-HA HDFS URI. But the same utility does not accept any other value than the “default” keyword. 

Resolution

We have to move the HAWQ file space from the old HDFS URI to the HA enabled HDFS URI. 

Old HDFS location: hdfs://hdm1.hdp.local/hawq_data (Default)

New HDFS location: hdfs://pivotalhdfs/hawq_data (HA enabled)

The following command will fail if we try to move the HDFS location to enable HAWQ to work with Namenode HA:

hawq filespace - - movefilespace hdfs://hdm1.hdp.local/hawq_data - -location =hdfs://pivotalhdfs/hawq_data

Instead, if we replace the prior location with “default,” utility will run and enable Hawq with Namenode HA.

hawq filespace - - movefilespace default - -location =hdfs://pivotalhdfs/hawq_data

Comments

Powered by Zendesk