Pivotal Knowledge Base

Follow

Pivotal HDB query errors with PXF user not found when isilon is used for HDFS

Environment

  • PHD 2.1.0.0
  • Pivotal HDB 1.2.1.1
  • PXF Service
  • Isilon OneFS

Symptom

gpadmin=# SELECT * from mytable;
ERROR:  remote component error (500) from '10.109.186.222:51200':  type  Exception report   message   org.apache.hadoop.ipc.RemoteException(java.lang.SecurityException): Username: 'pxf' not found. Make sure your client's username exists on the cluster    description   The server encountered an internal error that prevented it from fulfilling this request.    exception   javax.servlet.ServletException: org.apache.hadoop.ipc.RemoteException(java.lang.SecurityException): Username: 'pxf' not found. Make sure your client's username exists on the cluster (libchurl.c:848)

Error from PXF service log

26-Aug-2015 22:06:28.115 SEVERE [tomcat-http--6] org.apache.catalina.core.StandardWrapperValve.invoke Servlet.service() for servlet [PXF REST Service] in context with path [/pxf
] threw exception [org.apache.hadoop.ipc.RemoteException(java.lang.SecurityException): Username: 'pxf' not found. Make sure your client's username exists on the cluster] with ro
ot cause
 org.apache.hadoop.ipc.RemoteException(java.lang.SecurityException): Username: 'pxf' not found. Make sure your client's username exists on the cluster
        at org.apache.hadoop.ipc.Client.call(Client.java:1347)
        at org.apache.hadoop.ipc.Client.call(Client.java:1300)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
        at com.sun.proxy.$Proxy56.getFileInfo(Unknown Source)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
        at com.sun.proxy.$Proxy56.getFileInfo(Unknown Source)
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:688)
        at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1796)
        at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1116)
        at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1112)
        at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
        at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1112)
        at org.apache.hadoop.fs.FileSystem.globStatusInternal(FileSystem.java:1701)
        at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1647)
        at org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:222)
        at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:270)
        at com.pivotal.pxf.plugins.hdfs.HdfsDataFragmenter.getSplits(HdfsDataFragmenter.java:77)
        at com.pivotal.pxf.plugins.hdfs.HdfsDataFragmenter.getFragments(HdfsDataFragmenter.java:46)
        at com.pivotal.pxf.service.rest.FragmenterResource.getFragments(FragmenterResource.java:76)

Cause

In this case the "pxf" user exists on the isilon OneFS system, however, this is a multi-zone system and pxf user was not a added to the production zone used by the installed PXF service

Fix

Add the "pxf" user to the production zone to resolve. If further help is required then please contact Isilon support using using the EMC support portal

Comments

Powered by Zendesk