Pivotal Knowledge Base

Follow

Troubleshoot: GPText address already in use segment error

Environment

Product Version
 GPText  All
 OS  RHEL 6.x

Overview

The scope of this article is to troubleshoot GPText startup/segment recovery issues related to ports being already in use.

Symptom

GPText-start or GPText-recover will fail and in the solr startup.log shows an error similar to the following:

java bind exception - address already in use
FAILED selectchannelconnector@0.0.0.0:1254: java.net.bindexception
oejuc.abstractlifecycle:FAILED org.eclipse.jetty.server.server@36f3bc82

Checklist

  • Check which process is currently using the same specific port
  • Check if solr.xml and jetty.conf files are correct in the segments
  • Check the local port range in the Linux system: sysctl -a | grep net.ipv4.ip_local_port_range

Cause

As the error message suggests, the cause for this is that a GPText Solr instance cannot bind to its specified port because some other process is already using it.

Checking the local port range in the system might give an output similar to:

net.ipv4.ip_local_port_range = 1025 65535

This would mean that ports can be allocated by the OS for TCP and UDP traffic in a range from 1025 to 65535.

By default, GPText normally uses ports 11xx and 12xx and it can happen that another process is bind to one of those, as these port numbers fall inside the system port range 1025 < 11xx < 12xx < 65535.

Resolution

GPText ports should be out of the range set by "net.ipv4.ip_local_port_range". Otherwise, there is a risk to encounter port conflict issues.

In order to do so we can reconfigure "net.ipv4.ip_local_port_range" parameter.

  1. Stop GPText: gptext-stop
  2. Stop GPDB: gpstop -af
  3.  As root, apply the following changes to all segment servers:
    1. Change /etc/sysctl.conf parameter "net.ipv4.ip_local_port_range" to a range not overlapping with GPText ports (for instance, "net.ipv4.ip_local_port_range = 1300 65535")
    2. Reload sysctl.conf: sysctl -p
    3. Restart network service: /etc/rc.d/init.d/network restart
  4. Start GPDB: gpstart -a
  5. Start GPText: gptext-start

Note: To get current GPText configured ports, run gptext-state when GPText is up, or get the information from the jetty.conf files in the segments. GPText ports are specified during the GPText installation.

Comments

Powered by Zendesk