Pivotal Knowledge Base

Follow

How to get useful information in doppler

Environment:

   PCF 1.7

Purpose:

  As we all know, pcf has a streaming log system which plays a very important role for this PAAS platform. Several components in pcf has been involved in it. Metron agent, doppler, traffic controller and several clients. Among them, doppler and traffic controller has played a very important role. doppler is a scalable transmitter that transmit log information to next stage, when we have issue about retrieving log information we may need to debug and get information on doppler.

Demo:

##########
first, we ssh to etcd partition
##########
ubuntu@pivotal-ops-manager:~$
ubuntu@pivotal-ops-manager:~$ bosh ssh
RSA 1024 bit CA certificates are loaded due to old openssl compatibility
1. diego_database-partition-1506967bb2eea78b2b46/0 (e1f20540-52d6-4041-9148-647d15f882b1)
2. diego_cell-partition-1506967bb2eea78b2b46/1 (1334adf4-c115-44c5-93b7-e5b04e88d031)
3. cloud_controller-partition-1506967bb2eea78b2b46/0 (122690f3-88b7-401b-b519-f055decec276)
4. mysql_proxy-partition-1506967bb2eea78b2b46/0 (89b08fe8-6cf5-4ff3-8d57-23821d8d83f0)
5. diego_cell-partition-1506967bb2eea78b2b46/0 (8a8a7548-d6f1-4f5c-bcc3-9f914df15094)
6. smoke-tests/0 (70d41865-6482-4a37-b9fc-8f63d1741a0c)
7. diego_brain-partition-1506967bb2eea78b2b46/0 (35cd43ae-1f87-41cb-8207-66e72372736e)
8. clock_global-partition-1506967bb2eea78b2b46/0 (04a8d03a-ec51-47a1-abac-ed970f77a998)
9. uaa-partition-1506967bb2eea78b2b46/0 (08582c1b-7891-4c6e-a413-0411f699d9a6)
10. etcd_server-partition-1506967bb2eea78b2b46/0 (07009616-5aaa-4555-aa83-42c9061f6186)
11. nats-partition-1506967bb2eea78b2b46/0 (ebce5bb1-aabf-419e-9946-1b78181c6cdb)
12. diego_cell-partition-1506967bb2eea78b2b46/2 (98a605c8-2909-4609-bd0e-4299ad76cfd7)
13. loggregator_trafficcontroller-partition-1506967bb2eea78b2b46/0 (01e2efb3-d49d-4935-ab02-402bc67d49e4)
14. nfs_server-partition-1506967bb2eea78b2b46/0 (f5ad04d2-aec6-41a3-a535-75d04356de14)
15. cloud_controller_worker-partition-1506967bb2eea78b2b46/0 (9aeed684-c884-4a1a-861b-912c2b2de9e5)
16. mysql-partition-1506967bb2eea78b2b46/0 (36ed0315-22a1-4530-b568-ad6e7b823018)
17. doppler-partition-1506967bb2eea78b2b46/0 (74a9a8b7-fc5d-4351-9e63-a38a67b0f028)
18. ha_proxy-partition-1506967bb2eea78b2b46/0 (ffd4bfaa-f060-4230-807a-10a9992212fb)
19. consul_server-partition-1506967bb2eea78b2b46/0 (5de99499-4045-48b8-9226-e5937c84f93e)
20. router-partition-1506967bb2eea78b2b46/0 (c66d0314-86c9-43da-a606-100d49bd80ee)
Choose an instance: 10
Acting as user 'director' on deployment 'cf-2c3ea6cf6f11d78615c3' on 'p-bosh-05f96aa4a0bc7e91b12f'
Target deployment is 'cf-2c3ea6cf6f11d78615c3'

Setting up ssh artifacts

Director task 4214

Task 4214 done
Starting interactive shell on job etcd_server-partition-1506967bb2eea78b2b46/0
Unauthorized use is strictly prohibited. All access and activity
is subject to logging and monitoring.
Welcome to Ubuntu 14.04.4 LTS (GNU/Linux 3.19.0-61-generic x86_64)

* Documentation: https://help.ubuntu.com/

The programs included with the Ubuntu system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Ubuntu comes with ABSOLUTELY NO WARRANTY, to the extent permitted by
applicable law.

Last login: Fri Jul 29 02:31:29 2016 from 192.168.27.1
To run a command as administrator (user "root"), use "sudo <command>".
See "man sudo_root" for details.
 
##########
second, we recursively browse the tree in etcd
##########

bosh_uu52dzujc@abd3c716-fc4f-483d-bae8-5a1bd9918f60:~$
bosh_uu52dzujc@abd3c716-fc4f-483d-bae8-5a1bd9918f60:~$ /var/vcap/packages/etcd/etcdctl -C http://127.0.0.1:4001 ls / --recursive
/syslog_drain_binder
/syslog_drain_binder/leader
/doppler
/doppler/meta
/doppler/meta/1506967bb2eea78b2b46
/doppler/meta/1506967bb2eea78b2b46/doppler-partition-1506967bb2eea78b2b46
/doppler/meta/1506967bb2eea78b2b46/doppler-partition-1506967bb2eea78b2b46/0
/healthstatus
/healthstatus/doppler
/healthstatus/doppler/1506967bb2eea78b2b46
/healthstatus/doppler/1506967bb2eea78b2b46/doppler-partition-1506967bb2eea78b2b46
/healthstatus/doppler/1506967bb2eea78b2b46/doppler-partition-1506967bb2eea78b2b46/0
/loggregator
/loggregator/services
/loggregator/services/a73896fc-f3ea-4314-91ba-9f944c14443a
/loggregator/services/a73896fc-f3ea-4314-91ba-9f944c14443a/5f5587b54cf801b07cbfdf2e74fa2249c71ab82a
bosh_uu52dzujc@abd3c716-fc4f-483d-bae8-5a1bd9918f60:~$
 
##########
third, we get doppler information on leaf node
##########

bosh_uu52dzujc@abd3c716-fc4f-483d-bae8-5a1bd9918f60:~$ /var/vcap/packages/etcd/etcdctl -C http://127.0.0.1:4001 get /doppler/meta/1506967bb2eea78b2b46/doppler-partition-1506967bb2eea78b2b46/0
{"version":1,"endpoints":["udp://192.168.27.88:3457","tcp://192.168.27.88:3458","ws://192.168.27.88:8081"]}
bosh_uu52dzujc@abd3c716-fc4f-483d-bae8-5a1bd9918f60:~$
bosh_uu52dzujc@abd3c716-fc4f-483d-bae8-5a1bd9918f60:~$

Result:

from above information, we could see how many doppler instances are, what port they are using to monitor the traffic.

 

Comments

Powered by Zendesk